00000400:00080000:0.0F:1784290227.478941:0:83446:0:(debug.c:457:libcfs_run_debug_log_upcall()) Invoked LNET debug log upcall /usr/lib/lustre/lnet_debug_log_upcall /tmp/lustre-log.1784290227.83039 00010000:02000000:1.0F:1784290227.478987:0:83039:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 3:03, of 2 clients 1 recovered and 1 was evicted. 00000004:00000080:1.0:1784290227.491991:0:83039:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae5447f83e10 00100000:10000000:1.0:1784290227.492005:0:83039:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1784290227.492309:0:83027:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x682:0x0] 00000004:00080000:3.0F:1784290227.492367:0:83025:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x45c:0x0] 00000100:00100000:0.0:1784290227.492389:0:83027:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f977480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83027:1870961900994944:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784290227.492401:0:83025:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447aeb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83025:1870961900995072:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784290227.492466:0:83025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290227.492500:0:83025:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24506fea80 going to sleep for 20 seconds 00000100:00100000:2.0F:1784290227.492507:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900995072 00000100:00100000:0.0:1784290227.492507:0:83027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290227.492521:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900995072 00000100:00100000:0.0:1784290227.492542:0:83027:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2448574000 going to sleep for 20 seconds 00000100:00100000:0.0:1784290227.492560:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900994944 00000100:00100000:0.0:1784290227.492565:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900994944 00000100:00080000:3.0:1784290227.492583:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784290227.492590:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290227.492627:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4891 00000100:00100000:3.0:1784290227.492636:0:26251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4892 00000100:00100000:0.0:1784290227.492641:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:83025:x1870961900995072:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:0.0:1784290227.492649:0:9000:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784290227.492650:0:26251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:83027:x1870961900994944:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:3.0:1784290227.492657:0:26251:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:3.0:1784290227.492682:0:26251:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1697 -> diff = -31 00002000:00080000:0.0:1784290227.492682:0:9000:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1697 -> diff = -581 00002000:02000040:3.0:1784290227.492688:0:26251:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1667 to 0x2c0000401:1697) 00002000:02000040:0.0:1784290227.492690:0:9000:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1117 to 0x280000401:1697) 00002000:00010000:0.0:1784290227.492739:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290227.492749:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0bba045/0x5953bbf6b3072f24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.492778:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a1:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.492783:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.492791:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0bba045/0x5953bbf6b3072f24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.492809:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0bba045/0x5953bbf6b3072f24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.492820:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0bba045/0x5953bbf6b3072f24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.492829:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0bba045/0x5953bbf6b3072f24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.492874:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290227.492885:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290227.492892:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0bba045/0x5953bbf6b3072f24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.492917:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247b308a00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290227.492921:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0bba045/0x5953bbf6b3072f24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.492929:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0bba045/0x5953bbf6b3072f24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.492945:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0bba045/0x5953bbf6b3072f24 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.492950:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0bba045/0x5953bbf6b3072f24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.492964:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290227.492966:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290227.492967:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784290227.493007:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290227.493015:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebd29693/0x5953bbf6b3072f2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493025:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a0:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.493029:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.493034:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebd29693/0x5953bbf6b3072f2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493044:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebd29693/0x5953bbf6b3072f2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493053:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebd29693/0x5953bbf6b3072f2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493061:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebd29693/0x5953bbf6b3072f2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493083:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.493119:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.493125:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebd29693/0x5953bbf6b3072f2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493134:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247b308e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.493137:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebd29693/0x5953bbf6b3072f2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.493155:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.493156:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebd29693/0x5953bbf6b3072f2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493169:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af0be690/0x5953bbf6b3072f32 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493174:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebd29693/0x5953bbf6b3072f2b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493185:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69f:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:1.0:1784290227.493186:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebd29693/0x5953bbf6b3072f2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493198:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290227.493199:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.493202:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.493203:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.493204:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af0be690/0x5953bbf6b3072f32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493217:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af0be690/0x5953bbf6b3072f32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493227:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af0be690/0x5953bbf6b3072f32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493235:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af0be690/0x5953bbf6b3072f32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493257:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.493270:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.493275:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af0be690/0x5953bbf6b3072f32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493281:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247b308800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.493284:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af0be690/0x5953bbf6b3072f32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493297:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af0be690/0x5953bbf6b3072f32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493317:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af0be690/0x5953bbf6b3072f32 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493323:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af0be690/0x5953bbf6b3072f32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.493323:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290227.493338:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce0ee362/0x5953bbf6b3072f39 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493361:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.493364:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.493366:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.493385:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69e:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.493389:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.493394:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce0ee362/0x5953bbf6b3072f39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493406:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce0ee362/0x5953bbf6b3072f39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493415:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce0ee362/0x5953bbf6b3072f39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493437:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce0ee362/0x5953bbf6b3072f39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493457:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.493463:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.493468:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce0ee362/0x5953bbf6b3072f39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493474:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2447eef800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.493477:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce0ee362/0x5953bbf6b3072f39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493484:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce0ee362/0x5953bbf6b3072f39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493510:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce0ee362/0x5953bbf6b3072f39 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.493520:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.493532:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce0ee362/0x5953bbf6b3072f39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493534:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b2e32a6/0x5953bbf6b3072f40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493547:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.493550:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69d:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:1.0:1784290227.493551:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.493553:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.493558:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.493564:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b2e32a6/0x5953bbf6b3072f40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493577:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b2e32a6/0x5953bbf6b3072f40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493587:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b2e32a6/0x5953bbf6b3072f40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493607:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b2e32a6/0x5953bbf6b3072f40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493626:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784290227.493672:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290227.493678:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d60c0266/0x5953bbf6b3072f47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493696:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69c:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.493700:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.493705:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d60c0266/0x5953bbf6b3072f47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493716:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d60c0266/0x5953bbf6b3072f47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493727:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d60c0266/0x5953bbf6b3072f47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493736:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d60c0266/0x5953bbf6b3072f47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493754:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784290227.493760:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784290227.493768:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b2e32a6/0x5953bbf6b3072f40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493779:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2447eeea00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.493784:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b2e32a6/0x5953bbf6b3072f40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493794:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b2e32a6/0x5953bbf6b3072f40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.493810:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.493816:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b2e32a6/0x5953bbf6b3072f40 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493819:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5fc19f4/0x5953bbf6b3072f4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493839:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b2e32a6/0x5953bbf6b3072f40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493843:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69b:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.493854:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290227.493878:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290227.493880:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5fc19f4/0x5953bbf6b3072f4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493883:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d60c0266/0x5953bbf6b3072f47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493895:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5fc19f4/0x5953bbf6b3072f4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493897:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2447eee200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.493902:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d60c0266/0x5953bbf6b3072f47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493914:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d60c0266/0x5953bbf6b3072f47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493929:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d60c0266/0x5953bbf6b3072f47 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.493937:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5fc19f4/0x5953bbf6b3072f4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493938:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d60c0266/0x5953bbf6b3072f47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493961:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.493963:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5fc19f4/0x5953bbf6b3072f4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493964:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.493967:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.493987:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.493989:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.493994:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5fc19f4/0x5953bbf6b3072f4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.493999:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2447eefe00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.494002:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5fc19f4/0x5953bbf6b3072f4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494009:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5fc19f4/0x5953bbf6b3072f4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494024:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5fc19f4/0x5953bbf6b3072f4e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494030:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5fc19f4/0x5953bbf6b3072f4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.494035:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x69a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.494040:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.494043:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.494044:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057b073ab/0x5953bbf6b3072f55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494045:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.494056:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.494058:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69a:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.494064:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x69a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.494069:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057b073ab/0x5953bbf6b3072f55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494080:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057b073ab/0x5953bbf6b3072f55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494107:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057b073ab/0x5953bbf6b3072f55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494116:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057b073ab/0x5953bbf6b3072f55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494160:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.494174:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.494178:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057b073ab/0x5953bbf6b3072f55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494184:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2447eef400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.494187:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057b073ab/0x5953bbf6b3072f55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494194:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057b073ab/0x5953bbf6b3072f55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494202:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057b073ab/0x5953bbf6b3072f55 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494207:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057b073ab/0x5953bbf6b3072f55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.494207:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x699:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290227.494221:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000435c96ba/0x5953bbf6b3072f5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494244:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x699:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:1.0:1784290227.494245:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.494248:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.494251:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.494251:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x699:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.494259:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000435c96ba/0x5953bbf6b3072f5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494271:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000435c96ba/0x5953bbf6b3072f5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494280:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000435c96ba/0x5953bbf6b3072f5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494288:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000435c96ba/0x5953bbf6b3072f5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494305:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.494320:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.494324:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000435c96ba/0x5953bbf6b3072f5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494330:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2447eee000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.494332:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000435c96ba/0x5953bbf6b3072f5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494338:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000435c96ba/0x5953bbf6b3072f5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494363:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000435c96ba/0x5953bbf6b3072f5c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494368:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000435c96ba/0x5953bbf6b3072f5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494380:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.494382:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.494383:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784290227.494390:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x698:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290227.494398:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004aa48b9/0x5953bbf6b3072f63 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494407:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x698:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.494417:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x698:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.494422:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004aa48b9/0x5953bbf6b3072f63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494433:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004aa48b9/0x5953bbf6b3072f63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494442:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004aa48b9/0x5953bbf6b3072f63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494450:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004aa48b9/0x5953bbf6b3072f63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494467:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.494471:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.494475:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004aa48b9/0x5953bbf6b3072f63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494491:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2447eeee00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.494493:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004aa48b9/0x5953bbf6b3072f63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494499:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004aa48b9/0x5953bbf6b3072f63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494508:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004aa48b9/0x5953bbf6b3072f63 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494513:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004aa48b9/0x5953bbf6b3072f63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.494513:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x697:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290227.494528:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5fd1796/0x5953bbf6b3072f6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494533:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.494536:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.494538:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.494544:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x697:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.494548:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x697:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.494553:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5fd1796/0x5953bbf6b3072f6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494563:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5fd1796/0x5953bbf6b3072f6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494572:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5fd1796/0x5953bbf6b3072f6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494588:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5fd1796/0x5953bbf6b3072f6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494615:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.494619:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.494623:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5fd1796/0x5953bbf6b3072f6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494628:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2447eefc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.494631:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5fd1796/0x5953bbf6b3072f6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494636:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5fd1796/0x5953bbf6b3072f6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494652:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5fd1796/0x5953bbf6b3072f6a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494657:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5fd1796/0x5953bbf6b3072f6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.494665:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x696:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.494669:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.494672:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.494673:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a73d885e/0x5953bbf6b3072f71 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494674:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.494685:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x696:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.494689:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x696:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.494693:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a73d885e/0x5953bbf6b3072f71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494705:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a73d885e/0x5953bbf6b3072f71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494713:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a73d885e/0x5953bbf6b3072f71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494722:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a73d885e/0x5953bbf6b3072f71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494737:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.494743:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.494747:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a73d885e/0x5953bbf6b3072f71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494755:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2447eef000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.494759:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a73d885e/0x5953bbf6b3072f71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494780:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a73d885e/0x5953bbf6b3072f71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.494788:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x695:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.494793:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a73d885e/0x5953bbf6b3072f71 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494796:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7bf5002/0x5953bbf6b3072f78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494804:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a73d885e/0x5953bbf6b3072f71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494829:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x695:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.494840:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x695:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.494847:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7bf5002/0x5953bbf6b3072f78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494849:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.494852:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.494854:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.494878:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7bf5002/0x5953bbf6b3072f78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494887:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7bf5002/0x5953bbf6b3072f78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494895:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7bf5002/0x5953bbf6b3072f78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.494930:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.494938:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.494943:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7bf5002/0x5953bbf6b3072f78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494950:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2447eee800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.494954:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7bf5002/0x5953bbf6b3072f78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494961:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7bf5002/0x5953bbf6b3072f78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494972:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7bf5002/0x5953bbf6b3072f78 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494978:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7bf5002/0x5953bbf6b3072f78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.494985:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x694:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.494990:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.494994:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.494995:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce859fe/0x5953bbf6b3072f7f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.494996:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.495012:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x694:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.495016:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x694:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.495022:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce859fe/0x5953bbf6b3072f7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495050:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce859fe/0x5953bbf6b3072f7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495074:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce859fe/0x5953bbf6b3072f7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495082:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce859fe/0x5953bbf6b3072f7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495118:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.495134:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.495140:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce859fe/0x5953bbf6b3072f7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495169:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2447eeec00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.495173:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce859fe/0x5953bbf6b3072f7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.495173:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x693:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290227.495188:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c7aa952/0x5953bbf6b3072f86 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495189:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce859fe/0x5953bbf6b3072f7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495212:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce859fe/0x5953bbf6b3072f7f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495213:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x693:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.495223:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x693:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290227.495226:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce859fe/0x5953bbf6b3072f7f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495231:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c7aa952/0x5953bbf6b3072f86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495238:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.495240:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.495243:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.495245:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c7aa952/0x5953bbf6b3072f86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495256:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c7aa952/0x5953bbf6b3072f86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495264:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c7aa952/0x5953bbf6b3072f86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495297:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.495302:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.495317:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c7aa952/0x5953bbf6b3072f86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495322:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2447eee600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.495325:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c7aa952/0x5953bbf6b3072f86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495331:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c7aa952/0x5953bbf6b3072f86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495361:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c7aa952/0x5953bbf6b3072f86 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495366:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c7aa952/0x5953bbf6b3072f86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.495375:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x692:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.495377:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.495380:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.495384:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.495387:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8e14a1a/0x5953bbf6b3072f8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495399:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x692:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.495403:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x692:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.495408:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e14a1a/0x5953bbf6b3072f8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495418:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8e14a1a/0x5953bbf6b3072f8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495428:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8e14a1a/0x5953bbf6b3072f8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495436:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8e14a1a/0x5953bbf6b3072f8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495452:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.495458:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.495462:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8e14a1a/0x5953bbf6b3072f8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495467:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2447eef200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.495470:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8e14a1a/0x5953bbf6b3072f8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495476:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8e14a1a/0x5953bbf6b3072f8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495484:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8e14a1a/0x5953bbf6b3072f8d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495489:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8e14a1a/0x5953bbf6b3072f8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.495496:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x691:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290227.495510:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056eb8a5a/0x5953bbf6b3072f94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495516:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.495518:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.495522:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.495525:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x691:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.495552:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x691:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.495558:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056eb8a5a/0x5953bbf6b3072f94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495569:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056eb8a5a/0x5953bbf6b3072f94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495589:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056eb8a5a/0x5953bbf6b3072f94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495597:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056eb8a5a/0x5953bbf6b3072f94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495615:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.495620:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.495624:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056eb8a5a/0x5953bbf6b3072f94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495630:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2447eef600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.495633:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056eb8a5a/0x5953bbf6b3072f94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495639:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056eb8a5a/0x5953bbf6b3072f94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495647:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056eb8a5a/0x5953bbf6b3072f94 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495654:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056eb8a5a/0x5953bbf6b3072f94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495665:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.495666:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.495667:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784290227.495677:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x690:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290227.495685:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1ce9359/0x5953bbf6b3072f9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495694:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x690:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.495698:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x690:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.495702:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ce9359/0x5953bbf6b3072f9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495712:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1ce9359/0x5953bbf6b3072f9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495722:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1ce9359/0x5953bbf6b3072f9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495738:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ce9359/0x5953bbf6b3072f9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495755:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.495762:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.495768:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1ce9359/0x5953bbf6b3072f9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495799:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8c00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.495804:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1ce9359/0x5953bbf6b3072f9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495815:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1ce9359/0x5953bbf6b3072f9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.495817:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290227.495830:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aa8e530/0x5953bbf6b3072fa2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495836:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1ce9359/0x5953bbf6b3072f9b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495846:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68f:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:1.0:1784290227.495848:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1ce9359/0x5953bbf6b3072f9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495871:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290227.495878:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.495879:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003aa8e530/0x5953bbf6b3072fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495882:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.495885:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.495898:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003aa8e530/0x5953bbf6b3072fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495907:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aa8e530/0x5953bbf6b3072fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495916:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003aa8e530/0x5953bbf6b3072fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495934:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.495939:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.495943:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003aa8e530/0x5953bbf6b3072fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495949:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.495952:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003aa8e530/0x5953bbf6b3072fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495959:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003aa8e530/0x5953bbf6b3072fa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.495976:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003aa8e530/0x5953bbf6b3072fa2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.495981:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.495982:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003aa8e530/0x5953bbf6b3072fa2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.495996:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3072fa9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.496000:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.496001:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.496002:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.496016:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68e:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.496020:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.496025:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3072fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496036:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3072fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496046:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3072fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496055:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3072fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496073:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.496077:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.496081:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3072fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.496090:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9c00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.496093:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3072fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.496120:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3072fa9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.496133:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3072fa9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.496136:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.496149:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3072fa9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496151:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004130a9d4/0x5953bbf6b3072fb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496169:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68d:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.496179:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.496186:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004130a9d4/0x5953bbf6b3072fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.496189:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.496193:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.496197:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.496202:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004130a9d4/0x5953bbf6b3072fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496228:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004130a9d4/0x5953bbf6b3072fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496238:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004130a9d4/0x5953bbf6b3072fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496267:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.496275:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.496279:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004130a9d4/0x5953bbf6b3072fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.496285:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.496288:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004130a9d4/0x5953bbf6b3072fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.496295:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004130a9d4/0x5953bbf6b3072fb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.496304:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004130a9d4/0x5953bbf6b3072fb0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.496317:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004130a9d4/0x5953bbf6b3072fb0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.496325:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.496328:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.496332:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.496333:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.496335:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008857b437/0x5953bbf6b3072fb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496383:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68c:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.496387:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.496392:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008857b437/0x5953bbf6b3072fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496403:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008857b437/0x5953bbf6b3072fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496413:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008857b437/0x5953bbf6b3072fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496421:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008857b437/0x5953bbf6b3072fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496489:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290227.496506:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290227.496511:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008857b437/0x5953bbf6b3072fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.496520:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290227.496525:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008857b437/0x5953bbf6b3072fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.496534:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290227.496544:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1dd37d7/0x5953bbf6b3072fbe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.496552:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008857b437/0x5953bbf6b3072fb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496557:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68b:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.496566:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.496573:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1dd37d7/0x5953bbf6b3072fbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.496574:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008857b437/0x5953bbf6b3072fb7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.496602:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008857b437/0x5953bbf6b3072fb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496608:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1dd37d7/0x5953bbf6b3072fbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.496616:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290227.496618:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290227.496620:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.496621:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1dd37d7/0x5953bbf6b3072fbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496631:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1dd37d7/0x5953bbf6b3072fbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496650:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.496656:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.496660:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1dd37d7/0x5953bbf6b3072fbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.496675:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.496678:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1dd37d7/0x5953bbf6b3072fbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.496685:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1dd37d7/0x5953bbf6b3072fbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.496695:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x68a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.496696:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1dd37d7/0x5953bbf6b3072fbe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.496710:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1dd37d7/0x5953bbf6b3072fbe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496710:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe4b26db/0x5953bbf6b3072fc5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496735:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68a:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:1.0:1784290227.496738:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.496740:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.496741:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.496748:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x68a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.496753:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe4b26db/0x5953bbf6b3072fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496764:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe4b26db/0x5953bbf6b3072fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496783:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe4b26db/0x5953bbf6b3072fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496790:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe4b26db/0x5953bbf6b3072fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496805:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.496816:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.496822:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe4b26db/0x5953bbf6b3072fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.496832:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9a00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.496836:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe4b26db/0x5953bbf6b3072fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.496844:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe4b26db/0x5953bbf6b3072fc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.496849:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x689:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290227.496876:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ebc3a6e/0x5953bbf6b3072fcc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.496881:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe4b26db/0x5953bbf6b3072fc5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.496894:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe4b26db/0x5953bbf6b3072fc5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496894:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x689:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.496904:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x689:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.496911:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ebc3a6e/0x5953bbf6b3072fcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.496913:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.496915:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.496918:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.496929:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ebc3a6e/0x5953bbf6b3072fcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496939:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ebc3a6e/0x5953bbf6b3072fcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496958:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ebc3a6e/0x5953bbf6b3072fcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.496975:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.496980:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.496984:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ebc3a6e/0x5953bbf6b3072fcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.496990:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.496993:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ebc3a6e/0x5953bbf6b3072fcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.496999:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ebc3a6e/0x5953bbf6b3072fcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497007:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ebc3a6e/0x5953bbf6b3072fcc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497012:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ebc3a6e/0x5953bbf6b3072fcc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.497024:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x688:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290227.497032:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c739b56b/0x5953bbf6b3072fd3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497033:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.497036:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.497038:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.497047:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x688:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.497051:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x688:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.497055:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c739b56b/0x5953bbf6b3072fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497066:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c739b56b/0x5953bbf6b3072fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497075:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c739b56b/0x5953bbf6b3072fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497084:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c739b56b/0x5953bbf6b3072fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497101:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.497109:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.497115:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c739b56b/0x5953bbf6b3072fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497136:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.497140:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c739b56b/0x5953bbf6b3072fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497149:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c739b56b/0x5953bbf6b3072fd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497159:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c739b56b/0x5953bbf6b3072fd3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497165:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c739b56b/0x5953bbf6b3072fd3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.497176:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x687:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.497177:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.497180:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.497183:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.497187:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863234df/0x5953bbf6b3072fda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497204:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x687:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.497207:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x687:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.497212:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000863234df/0x5953bbf6b3072fda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497223:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000863234df/0x5953bbf6b3072fda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497233:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863234df/0x5953bbf6b3072fda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497242:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000863234df/0x5953bbf6b3072fda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497262:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290227.497278:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290227.497283:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000863234df/0x5953bbf6b3072fda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.497290:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290227.497293:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000863234df/0x5953bbf6b3072fda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.497311:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000863234df/0x5953bbf6b3072fda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.497320:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x686:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290227.497321:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000863234df/0x5953bbf6b3072fda lrc: 1/0,0 mode: --/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497333:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000949211db/0x5953bbf6b3072fe1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.497361:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000863234df/0x5953bbf6b3072fda lrc: 0/0,0 mode: --/PW res: [0x280000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497385:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x686:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.497389:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x686:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290227.497390:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290227.497393:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290227.497396:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.497397:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000949211db/0x5953bbf6b3072fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497412:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000949211db/0x5953bbf6b3072fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497434:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000949211db/0x5953bbf6b3072fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497443:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000949211db/0x5953bbf6b3072fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497459:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.497466:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.497470:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000949211db/0x5953bbf6b3072fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497485:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.497489:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000949211db/0x5953bbf6b3072fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497495:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000949211db/0x5953bbf6b3072fe1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497505:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000949211db/0x5953bbf6b3072fe1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.497507:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x685:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.497521:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000949211db/0x5953bbf6b3072fe1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497522:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078c85ddc/0x5953bbf6b3072fe8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497540:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.497541:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x685:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:1.0:1784290227.497543:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.497546:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.497548:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x685:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.497555:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078c85ddc/0x5953bbf6b3072fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497566:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078c85ddc/0x5953bbf6b3072fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497574:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078c85ddc/0x5953bbf6b3072fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497593:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078c85ddc/0x5953bbf6b3072fe8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497623:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.497627:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.497631:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078c85ddc/0x5953bbf6b3072fe8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497637:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.497640:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078c85ddc/0x5953bbf6b3072fe8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497645:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078c85ddc/0x5953bbf6b3072fe8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497660:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078c85ddc/0x5953bbf6b3072fe8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497665:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078c85ddc/0x5953bbf6b3072fe8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.497676:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x684:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.497677:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.497679:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.497681:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.497688:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007df1a0df/0x5953bbf6b3072fef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497698:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x684:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.497702:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x684:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.497706:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007df1a0df/0x5953bbf6b3072fef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497717:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007df1a0df/0x5953bbf6b3072fef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497727:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007df1a0df/0x5953bbf6b3072fef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497735:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007df1a0df/0x5953bbf6b3072fef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497752:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.497758:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.497764:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007df1a0df/0x5953bbf6b3072fef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497773:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.497789:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007df1a0df/0x5953bbf6b3072fef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497799:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007df1a0df/0x5953bbf6b3072fef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.497805:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x683:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.497813:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007df1a0df/0x5953bbf6b3072fef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497814:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074ee36b3/0x5953bbf6b3072ff6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497834:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007df1a0df/0x5953bbf6b3072fef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497838:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x683:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.497855:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x683:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290227.497876:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.497877:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074ee36b3/0x5953bbf6b3072ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497879:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.497881:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.497895:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074ee36b3/0x5953bbf6b3072ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497904:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074ee36b3/0x5953bbf6b3072ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497913:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074ee36b3/0x5953bbf6b3072ff6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497929:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.497934:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.497938:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074ee36b3/0x5953bbf6b3072ff6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497944:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8a00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.497947:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074ee36b3/0x5953bbf6b3072ff6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497954:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074ee36b3/0x5953bbf6b3072ff6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497964:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074ee36b3/0x5953bbf6b3072ff6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.497969:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074ee36b3/0x5953bbf6b3072ff6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290227.497976:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x682:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.497978:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.497981:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.497985:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290227.497988:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3559906/0x5953bbf6b3072ffd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.497999:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x682:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:0.0:1784290227.498003:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x682:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290227.498007:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3559906/0x5953bbf6b3072ffd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.498018:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3559906/0x5953bbf6b3072ffd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.498028:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3559906/0x5953bbf6b3072ffd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.498044:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3559906/0x5953bbf6b3072ffd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290227.498063:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290227.498090:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290227.498096:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3559906/0x5953bbf6b3072ffd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.498104:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290227.498107:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3559906/0x5953bbf6b3072ffd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.498115:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3559906/0x5953bbf6b3072ffd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.498137:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3559906/0x5953bbf6b3072ffd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.498144:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3559906/0x5953bbf6b3072ffd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.498159:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290227.498162:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290227.498163:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784290227.499249:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290227.499255:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020e7cac0/0x5953bbf6b3073004 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499265:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a1:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:3.0:1784290227.499269:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290227.499272:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020e7cac0/0x5953bbf6b3073004 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499285:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020e7cac0/0x5953bbf6b3073004 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499292:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020e7cac0/0x5953bbf6b3073004 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499299:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020e7cac0/0x5953bbf6b3073004 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499337:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.499371:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.499377:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020e7cac0/0x5953bbf6b3073004 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.499395:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd2a800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.499399:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020e7cac0/0x5953bbf6b3073004 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.499406:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020e7cac0/0x5953bbf6b3073004 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.499417:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020e7cac0/0x5953bbf6b3073004 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.499423:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020e7cac0/0x5953bbf6b3073004 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.499437:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.499438:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.499443:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.499445:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005737f8b1/0x5953bbf6b307300b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.499446:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.499455:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a0:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:3.0:1784290227.499459:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290227.499462:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005737f8b1/0x5953bbf6b307300b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499470:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005737f8b1/0x5953bbf6b307300b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499477:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005737f8b1/0x5953bbf6b307300b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499483:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005737f8b1/0x5953bbf6b307300b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499496:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.499504:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.499509:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005737f8b1/0x5953bbf6b307300b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.499516:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd2bc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.499519:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005737f8b1/0x5953bbf6b307300b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.499525:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005737f8b1/0x5953bbf6b307300b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.499535:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290227.499543:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000959868fb/0x5953bbf6b3073012 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.499544:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005737f8b1/0x5953bbf6b307300b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499564:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69f:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:1.0:1784290227.499566:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005737f8b1/0x5953bbf6b307300b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499576:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290227.499579:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.499581:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000959868fb/0x5953bbf6b3073012 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.499583:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.499586:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.499594:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000959868fb/0x5953bbf6b3073012 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499602:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000959868fb/0x5953bbf6b3073012 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499608:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000959868fb/0x5953bbf6b3073012 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499621:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.499626:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.499631:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000959868fb/0x5953bbf6b3073012 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.499637:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd2a600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.499641:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000959868fb/0x5953bbf6b3073012 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.499648:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000959868fb/0x5953bbf6b3073012 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.499655:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000959868fb/0x5953bbf6b3073012 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.499664:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000959868fb/0x5953bbf6b3073012 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.499673:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290227.499685:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb7b0f22/0x5953bbf6b3073019 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499691:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69e:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:1.0:1784290227.499693:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.499695:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290227.499697:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.499700:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb7b0f22/0x5953bbf6b3073019 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.499700:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.499710:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb7b0f22/0x5953bbf6b3073019 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499717:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb7b0f22/0x5953bbf6b3073019 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499730:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb7b0f22/0x5953bbf6b3073019 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499743:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.499749:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.499756:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb7b0f22/0x5953bbf6b3073019 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.499767:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd2b800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.499772:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb7b0f22/0x5953bbf6b3073019 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.499782:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb7b0f22/0x5953bbf6b3073019 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.499788:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290227.499796:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc43acd3/0x5953bbf6b3073020 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.499800:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb7b0f22/0x5953bbf6b3073019 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499813:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69d:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:1.0:1784290227.499816:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb7b0f22/0x5953bbf6b3073019 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499818:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290227.499827:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc43acd3/0x5953bbf6b3073020 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499836:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc43acd3/0x5953bbf6b3073020 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.499838:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.499842:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.499845:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc43acd3/0x5953bbf6b3073020 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.499846:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.499854:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc43acd3/0x5953bbf6b3073020 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499881:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290227.499907:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290227.499914:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc43acd3/0x5953bbf6b3073020 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.499917:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290227.499927:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006551534c/0x5953bbf6b3073027 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.499931:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd2aa00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290227.499936:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc43acd3/0x5953bbf6b3073020 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499944:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69c:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:3.0:1784290227.499950:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290227.499953:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc43acd3/0x5953bbf6b3073020 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499954:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006551534c/0x5953bbf6b3073027 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499979:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006551534c/0x5953bbf6b3073027 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.499983:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc43acd3/0x5953bbf6b3073020 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.499988:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006551534c/0x5953bbf6b3073027 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.499996:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc43acd3/0x5953bbf6b3073020 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500000:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006551534c/0x5953bbf6b3073027 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.500017:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290227.500021:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784290227.500021:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006551534c/0x5953bbf6b3073027 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.500030:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd2b000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290227.500033:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006551534c/0x5953bbf6b3073027 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.500038:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290227.500040:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006551534c/0x5953bbf6b3073027 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.500064:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006551534c/0x5953bbf6b3073027 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.500066:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290227.500077:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caf59bac/0x5953bbf6b307302e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.500078:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006551534c/0x5953bbf6b3073027 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500098:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69b:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:3.0:1784290227.500101:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290227.500105:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000caf59bac/0x5953bbf6b307302e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.500106:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290227.500110:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290227.500113:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.500118:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000caf59bac/0x5953bbf6b307302e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500136:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caf59bac/0x5953bbf6b307302e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500143:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000caf59bac/0x5953bbf6b307302e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500157:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.500173:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.500179:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000caf59bac/0x5953bbf6b307302e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.500191:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd2ba00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.500195:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000caf59bac/0x5953bbf6b307302e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.500199:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x69a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.500203:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000caf59bac/0x5953bbf6b307302e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500205:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071d0a5ef/0x5953bbf6b3073035 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500227:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69a:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:3.0:1784290227.500230:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x69a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290227.500230:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000caf59bac/0x5953bbf6b307302e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500240:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071d0a5ef/0x5953bbf6b3073035 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.500245:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000caf59bac/0x5953bbf6b307302e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500257:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071d0a5ef/0x5953bbf6b3073035 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500265:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071d0a5ef/0x5953bbf6b3073035 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.500268:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.500272:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.500275:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071d0a5ef/0x5953bbf6b3073035 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.500276:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.500301:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.500307:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.500312:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071d0a5ef/0x5953bbf6b3073035 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.500319:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd2b400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.500322:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071d0a5ef/0x5953bbf6b3073035 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.500328:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071d0a5ef/0x5953bbf6b3073035 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.500363:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071d0a5ef/0x5953bbf6b3073035 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.500367:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x699:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.500374:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071d0a5ef/0x5953bbf6b3073035 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x69a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500376:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bc12f17/0x5953bbf6b307303c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500391:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x699:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:3.0:1784290227.500394:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x699:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290227.500397:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.500398:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bc12f17/0x5953bbf6b307303c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.500401:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.500404:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.500410:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bc12f17/0x5953bbf6b307303c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500418:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bc12f17/0x5953bbf6b307303c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500423:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bc12f17/0x5953bbf6b307303c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500434:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.500441:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.500445:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bc12f17/0x5953bbf6b307303c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.500452:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.500454:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bc12f17/0x5953bbf6b307303c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.500462:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bc12f17/0x5953bbf6b307303c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.500471:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x698:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.500472:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bc12f17/0x5953bbf6b307303c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500479:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4e1d8dd/0x5953bbf6b3073043 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.500482:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bc12f17/0x5953bbf6b307303c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x699:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500494:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x698:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:3.0:1784290227.500509:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x698:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290227.500515:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4e1d8dd/0x5953bbf6b3073043 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.500520:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.500524:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.500525:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4e1d8dd/0x5953bbf6b3073043 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.500528:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.500537:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4e1d8dd/0x5953bbf6b3073043 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500543:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4e1d8dd/0x5953bbf6b3073043 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500555:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.500561:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.500566:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4e1d8dd/0x5953bbf6b3073043 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.500573:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.500577:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4e1d8dd/0x5953bbf6b3073043 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.500583:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4e1d8dd/0x5953bbf6b3073043 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.500593:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4e1d8dd/0x5953bbf6b3073043 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.500595:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x697:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.500606:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4e1d8dd/0x5953bbf6b3073043 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x698:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500607:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007441f48a/0x5953bbf6b307304a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500630:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x697:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:3.0:1784290227.500632:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x697:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290227.500634:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.500636:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007441f48a/0x5953bbf6b307304a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.500638:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.500642:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.500648:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007441f48a/0x5953bbf6b307304a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500656:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007441f48a/0x5953bbf6b307304a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500667:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007441f48a/0x5953bbf6b307304a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500682:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290227.500702:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290227.500708:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007441f48a/0x5953bbf6b307304a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.500715:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290227.500718:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007441f48a/0x5953bbf6b307304a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.500724:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x696:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290227.500726:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007441f48a/0x5953bbf6b307304a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500730:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d329f88/0x5953bbf6b3073051 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500742:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x696:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:2.0:1784290227.500742:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007441f48a/0x5953bbf6b307304a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500751:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x696:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290227.500759:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d329f88/0x5953bbf6b3073051 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.500761:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007441f48a/0x5953bbf6b307304a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x697:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500783:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d329f88/0x5953bbf6b3073051 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500808:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d329f88/0x5953bbf6b3073051 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500815:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d329f88/0x5953bbf6b3073051 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.500817:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290227.500822:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290227.500827:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290227.500833:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784290227.500838:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d329f88/0x5953bbf6b3073051 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.500845:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290227.500849:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d329f88/0x5953bbf6b3073051 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.500850:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290227.500871:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d329f88/0x5953bbf6b3073051 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.500883:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d329f88/0x5953bbf6b3073051 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.500884:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x695:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290227.500894:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5a31b39/0x5953bbf6b3073058 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.500896:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d329f88/0x5953bbf6b3073051 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x696:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.500908:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.500910:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x695:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:2.0:1784290227.500911:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.500916:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x695:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290227.500916:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.500923:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5a31b39/0x5953bbf6b3073058 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500931:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5a31b39/0x5953bbf6b3073058 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500938:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5a31b39/0x5953bbf6b3073058 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500945:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5a31b39/0x5953bbf6b3073058 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.500958:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.500967:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.500972:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5a31b39/0x5953bbf6b3073058 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.500987:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.500990:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5a31b39/0x5953bbf6b3073058 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.500998:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5a31b39/0x5953bbf6b3073058 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.500999:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x694:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290227.501010:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096d702c9/0x5953bbf6b307305f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501016:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5a31b39/0x5953bbf6b3073058 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501018:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x694:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:3.0:1784290227.501027:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x694:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290227.501036:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5a31b39/0x5953bbf6b3073058 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x695:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501037:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096d702c9/0x5953bbf6b307305f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501064:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096d702c9/0x5953bbf6b307305f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501070:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.501072:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.501074:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.501084:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096d702c9/0x5953bbf6b307305f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501091:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096d702c9/0x5953bbf6b307305f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501103:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.501113:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.501120:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096d702c9/0x5953bbf6b307305f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501130:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236dc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.501146:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096d702c9/0x5953bbf6b307305f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.501154:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x693:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.501154:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096d702c9/0x5953bbf6b307305f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501160:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084275446/0x5953bbf6b3073066 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501189:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x693:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:3.0:1784290227.501192:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x693:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290227.501194:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096d702c9/0x5953bbf6b307305f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501196:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084275446/0x5953bbf6b3073066 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501212:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096d702c9/0x5953bbf6b307305f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x694:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501216:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084275446/0x5953bbf6b3073066 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501225:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084275446/0x5953bbf6b3073066 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501227:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.501231:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.501235:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084275446/0x5953bbf6b3073066 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501235:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.501259:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.501266:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.501270:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084275446/0x5953bbf6b3073066 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501278:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.501281:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084275446/0x5953bbf6b3073066 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501287:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084275446/0x5953bbf6b3073066 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501298:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084275446/0x5953bbf6b3073066 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.501302:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x692:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.501303:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084275446/0x5953bbf6b3073066 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x693:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501310:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb30d43f/0x5953bbf6b307306d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501323:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x692:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:3.0:1784290227.501330:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x692:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290227.501333:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb30d43f/0x5953bbf6b307306d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501357:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.501360:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb30d43f/0x5953bbf6b307306d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501361:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.501365:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.501371:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb30d43f/0x5953bbf6b307306d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501377:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb30d43f/0x5953bbf6b307306d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501388:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.501395:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.501400:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb30d43f/0x5953bbf6b307306d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501407:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236cc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.501411:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb30d43f/0x5953bbf6b307306d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501417:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb30d43f/0x5953bbf6b307306d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.501419:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x691:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290227.501431:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4eccbe6/0x5953bbf6b3073074 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501434:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb30d43f/0x5953bbf6b307306d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501438:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x691:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:1.0:1784290227.501442:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb30d43f/0x5953bbf6b307306d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x692:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501452:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x691:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290227.501458:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4eccbe6/0x5953bbf6b3073074 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501463:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.501467:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.501468:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4eccbe6/0x5953bbf6b3073074 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501470:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.501479:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4eccbe6/0x5953bbf6b3073074 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501485:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4eccbe6/0x5953bbf6b3073074 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501499:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290227.501514:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290227.501522:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4eccbe6/0x5953bbf6b3073074 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.501542:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x690:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290227.501546:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290227.501547:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028bfd575/0x5953bbf6b307307b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.501555:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4eccbe6/0x5953bbf6b3073074 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501557:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x690:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:3.0:1784290227.501564:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x690:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290227.501572:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028bfd575/0x5953bbf6b307307b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.501575:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4eccbe6/0x5953bbf6b3073074 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501586:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028bfd575/0x5953bbf6b307307b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.501592:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4eccbe6/0x5953bbf6b3073074 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501594:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028bfd575/0x5953bbf6b307307b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.501600:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4eccbe6/0x5953bbf6b3073074 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x691:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501622:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028bfd575/0x5953bbf6b307307b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.501630:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290227.501633:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290227.501636:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028bfd575/0x5953bbf6b307307b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501638:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784290227.501644:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290227.501645:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290227.501650:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028bfd575/0x5953bbf6b307307b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.501656:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028bfd575/0x5953bbf6b307307b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.501675:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028bfd575/0x5953bbf6b307307b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.501681:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028bfd575/0x5953bbf6b307307b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x690:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.501683:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290227.501693:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e925d7e1/0x5953bbf6b3073082 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.501698:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.501701:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68f:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:2.0:1784290227.501701:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290227.501705:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.501707:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290227.501711:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e925d7e1/0x5953bbf6b3073082 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501719:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e925d7e1/0x5953bbf6b3073082 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501726:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e925d7e1/0x5953bbf6b3073082 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501731:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e925d7e1/0x5953bbf6b3073082 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501743:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.501751:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.501758:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e925d7e1/0x5953bbf6b3073082 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501775:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d600 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:3.0:1784290227.501778:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.501781:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e925d7e1/0x5953bbf6b3073082 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501784:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021fd6b20/0x5953bbf6b3073089 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501796:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e925d7e1/0x5953bbf6b3073082 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501799:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68e:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:3.0:1784290227.501817:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290227.501824:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021fd6b20/0x5953bbf6b3073089 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501829:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e925d7e1/0x5953bbf6b3073082 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501833:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021fd6b20/0x5953bbf6b3073089 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501840:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e925d7e1/0x5953bbf6b3073082 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501846:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021fd6b20/0x5953bbf6b3073089 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501854:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021fd6b20/0x5953bbf6b3073089 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501872:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.501876:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.501879:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021fd6b20/0x5953bbf6b3073089 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501882:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784290227.501891:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.501894:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021fd6b20/0x5953bbf6b3073089 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.501899:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.501902:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021fd6b20/0x5953bbf6b3073089 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501923:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021fd6b20/0x5953bbf6b3073089 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.501925:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290227.501935:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043b61dcb/0x5953bbf6b3073090 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501937:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021fd6b20/0x5953bbf6b3073089 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.501953:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68d:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:3.0:1784290227.501958:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290227.501961:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b61dcb/0x5953bbf6b3073090 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501965:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.501970:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.501971:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043b61dcb/0x5953bbf6b3073090 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.501973:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.501992:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043b61dcb/0x5953bbf6b3073090 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502000:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043b61dcb/0x5953bbf6b3073090 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502013:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.502022:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.502027:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043b61dcb/0x5953bbf6b3073090 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502032:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236da00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.502035:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043b61dcb/0x5953bbf6b3073090 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502043:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043b61dcb/0x5953bbf6b3073090 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502053:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043b61dcb/0x5953bbf6b3073090 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.502058:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.502059:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043b61dcb/0x5953bbf6b3073090 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502067:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f477e25/0x5953bbf6b3073097 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502077:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68c:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:3.0:1784290227.502085:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290227.502089:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f477e25/0x5953bbf6b3073097 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502096:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.502097:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f477e25/0x5953bbf6b3073097 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502101:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.502105:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.502109:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f477e25/0x5953bbf6b3073097 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502116:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f477e25/0x5953bbf6b3073097 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502138:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.502148:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.502152:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f477e25/0x5953bbf6b3073097 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502159:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236de00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.502163:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f477e25/0x5953bbf6b3073097 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502171:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f477e25/0x5953bbf6b3073097 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502181:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f477e25/0x5953bbf6b3073097 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.502186:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.502188:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f477e25/0x5953bbf6b3073097 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502193:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000197cd913/0x5953bbf6b307309e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502204:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68b:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:3.0:1784290227.502207:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290227.502207:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.502210:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000197cd913/0x5953bbf6b307309e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502212:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.502215:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.502223:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000197cd913/0x5953bbf6b307309e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502229:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000197cd913/0x5953bbf6b307309e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502235:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000197cd913/0x5953bbf6b307309e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502248:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290227.502263:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290227.502268:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000197cd913/0x5953bbf6b307309e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.502275:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236ca00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290227.502279:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000197cd913/0x5953bbf6b307309e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.502283:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x68a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290227.502285:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000197cd913/0x5953bbf6b307309e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502288:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007494bd03/0x5953bbf6b30730a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502304:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68a:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:2.0:1784290227.502307:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000197cd913/0x5953bbf6b307309e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502317:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x68a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290227.502323:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000197cd913/0x5953bbf6b307309e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502324:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007494bd03/0x5953bbf6b30730a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502359:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007494bd03/0x5953bbf6b30730a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502368:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007494bd03/0x5953bbf6b30730a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502379:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007494bd03/0x5953bbf6b30730a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.502384:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290227.502388:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290227.502391:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007494bd03/0x5953bbf6b30730a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502393:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784290227.502401:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290227.502402:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236ce00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290227.502406:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007494bd03/0x5953bbf6b30730a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.502412:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007494bd03/0x5953bbf6b30730a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.502421:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007494bd03/0x5953bbf6b30730a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.502426:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007494bd03/0x5953bbf6b30730a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x68a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.502439:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x689:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290227.502440:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290227.502444:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.502447:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b94ffa88/0x5953bbf6b30730ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290227.502448:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.502455:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x689:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:3.0:1784290227.502459:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x689:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290227.502462:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b94ffa88/0x5953bbf6b30730ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502470:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b94ffa88/0x5953bbf6b30730ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502477:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b94ffa88/0x5953bbf6b30730ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502488:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b94ffa88/0x5953bbf6b30730ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502500:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.502508:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.502513:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b94ffa88/0x5953bbf6b30730ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502526:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.502530:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b94ffa88/0x5953bbf6b30730ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502536:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b94ffa88/0x5953bbf6b30730ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.502546:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x688:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.502547:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b94ffa88/0x5953bbf6b30730ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502552:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078c48985/0x5953bbf6b30730b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502559:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b94ffa88/0x5953bbf6b30730ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x689:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502567:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x688:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:3.0:1784290227.502572:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x688:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290227.502576:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078c48985/0x5953bbf6b30730b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502580:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.502584:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.502585:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078c48985/0x5953bbf6b30730b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502587:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.502595:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078c48985/0x5953bbf6b30730b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502601:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078c48985/0x5953bbf6b30730b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502613:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.502620:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.502625:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078c48985/0x5953bbf6b30730b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502631:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebe600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.502634:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078c48985/0x5953bbf6b30730b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502641:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078c48985/0x5953bbf6b30730b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.502646:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x687:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290227.502655:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f3bd2c5/0x5953bbf6b30730ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502662:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078c48985/0x5953bbf6b30730b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502680:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x687:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:1.0:1784290227.502681:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078c48985/0x5953bbf6b30730b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x688:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502688:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x687:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290227.502697:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f3bd2c5/0x5953bbf6b30730ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502703:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.502706:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.502707:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f3bd2c5/0x5953bbf6b30730ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502708:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.502716:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f3bd2c5/0x5953bbf6b30730ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502723:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f3bd2c5/0x5953bbf6b30730ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502736:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.502741:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.502746:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f3bd2c5/0x5953bbf6b30730ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502756:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.502761:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f3bd2c5/0x5953bbf6b30730ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502772:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f3bd2c5/0x5953bbf6b30730ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.502776:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x686:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290227.502785:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028afd70b/0x5953bbf6b30730c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502792:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x686:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:1.0:1784290227.502794:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f3bd2c5/0x5953bbf6b30730ba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502795:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x686:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290227.502804:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028afd70b/0x5953bbf6b30730c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502831:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f3bd2c5/0x5953bbf6b30730ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x687:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502832:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028afd70b/0x5953bbf6b30730c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1784290227.502846:0:9000:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1116 00010000:00010000:3.0:1784290227.502891:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028afd70b/0x5953bbf6b30730c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502899:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028afd70b/0x5953bbf6b30730c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502899:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.502903:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.502906:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.502915:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.502919:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.502924:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028afd70b/0x5953bbf6b30730c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502935:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebfc00 already unused, calling callback (ffffffffc0ec3230) 00000100:00100000:0.0:1784290227.502935:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447aeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:83025:x1870961900995072:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10294us (10463us total) trans 0 rc 0/0 00010000:00010000:1.0:1784290227.502941:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028afd70b/0x5953bbf6b30730c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.502949:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x685:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290227.502951:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028afd70b/0x5953bbf6b30730c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290227.502954:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4891 00010000:00010000:3.0:1784290227.502960:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017f9c418/0x5953bbf6b30730c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502970:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x685:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:1.0:1784290227.502971:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028afd70b/0x5953bbf6b30730c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502974:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x685:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1784290227.502979:0:83025:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447aeb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83025:1870961900995072:0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1784290227.502985:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017f9c418/0x5953bbf6b30730c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.502992:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028afd70b/0x5953bbf6b30730c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x686:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.502997:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017f9c418/0x5953bbf6b30730c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784290227.502999:0:83025:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x6a1:0x0] from OST, last_created [0x280000401:0x6a1:0x0]last_used is [0x280000401:0x45c:0x0] 00010000:00010000:1.0:1784290227.503005:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.503008:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290227.503012:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.503015:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017f9c418/0x5953bbf6b30730c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.503022:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017f9c418/0x5953bbf6b30730c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.503044:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290227.503053:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.503058:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017f9c418/0x5953bbf6b30730c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290227.503070:0:83025:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475819c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83025:1870961900995328:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1784290227.503076:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebfe00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.503082:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017f9c418/0x5953bbf6b30730c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290227.503083:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x684:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1784290227.503090:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247581a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961900995200:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784290227.503094:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000682c7ab7/0x5953bbf6b30730cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.503109:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x684:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:1.0:1784290227.503109:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017f9c418/0x5953bbf6b30730c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290227.503118:0:83025:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784290227.503119:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x684:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290227.503123:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000682c7ab7/0x5953bbf6b30730cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.503141:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000682c7ab7/0x5953bbf6b30730cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.503148:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000682c7ab7/0x5953bbf6b30730cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.503150:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017f9c418/0x5953bbf6b30730c8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290227.503155:0:83025:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2450541e40 going to sleep for 20 seconds 00000100:00100000:0.0:1784290227.503158:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784290227.503169:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000682c7ab7/0x5953bbf6b30730cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.503171:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017f9c418/0x5953bbf6b30730c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x685:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290227.503183:0:8999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900995328 00000100:00100000:2.0:1784290227.503199:0:8999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900995328 00010000:00010000:1.0:1784290227.503204:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290227.503206:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784290227.503208:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000682c7ab7/0x5953bbf6b30730cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.503215:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebe400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.503218:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000682c7ab7/0x5953bbf6b30730cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.503225:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000682c7ab7/0x5953bbf6b30730cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.503235:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000682c7ab7/0x5953bbf6b30730cf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290227.503236:0:8999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4893 00000100:00100000:0.0:1784290227.503238:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900995200 00002000:00010000:3.0:1784290227.503242:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x683:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:0.0:1784290227.503246:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900995200 00000100:00100000:2.0:1784290227.503249:0:8999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475819880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:83025:x1870961900995328:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1784290227.503255:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1125135/0x5953bbf6b30730d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:2.0:1784290227.503262:0:8999:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:1.0:1784290227.503263:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000682c7ab7/0x5953bbf6b30730cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x684:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.503269:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x683:0x0].0x0 since=1968s v=(0 0) 00010000:00010000:1.0:1784290227.503279:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.503280:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x683:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290227.503284:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.503286:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1125135/0x5953bbf6b30730d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.503289:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1784290227.503291:0:8999:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1698 00000100:00100000:0.0:1784290227.503292:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00010000:00010000:1.0:1784290227.503297:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290227.503306:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1125135/0x5953bbf6b30730d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290227.503309:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961900995200:12345-0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784290227.503323:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1125135/0x5953bbf6b30730d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:0.0:1784290227.503323:0:26373:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:3.0:1784290227.503332:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1125135/0x5953bbf6b30730d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290227.503361:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00000024:0.0:1784290227.503365:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 896 free 3923529728 avail 3692007424 00010000:00010000:1.0:1784290227.503369:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290227.503374:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1125135/0x5953bbf6b30730d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.503382:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebec00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290227.503385:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1125135/0x5953bbf6b30730d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1784290227.503392:0:26251:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1666 00010000:00010000:1.0:1784290227.503393:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1125135/0x5953bbf6b30730d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.503406:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1125135/0x5953bbf6b30730d6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290227.503414:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1125135/0x5953bbf6b30730d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x683:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290227.503421:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961900995200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (266us total) trans 0 rc 0/0 00010000:00010000:1.0:1784290227.503431:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290227.503432:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00010000:00010000:1.0:1784290227.503442:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290227.503446:0:26251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:83027:x1870961900994944:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10798us (10940us total) trans 0 rc 0/0 00010000:00010000:1.0:1784290227.503447:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290227.503456:0:26251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4892 00000100:00100000:0.0:1784290227.503491:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247581a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961900995200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784290227.503496:0:83027:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f977480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83027:1870961900994944:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1784290227.503508:0:83027:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x6a1:0x0] from OST, last_created [0x2c0000401:0x6a1:0x0]last_used is [0x2c0000401:0x682:0x0] 00000100:00100000:1.0:1784290227.503555:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961900995456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784290227.503564:0:83027:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f977480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83027:1870961900995584:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1784290227.503600:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290227.503606:0:83027:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290227.503633:0:83027:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2449b9cf00 going to sleep for 20 seconds 00000100:00100000:3.0:1784290227.503657:0:26261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900995584 00000100:00100000:0.0:1784290227.503658:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900995456 00000100:00100000:3.0:1784290227.503661:0:26261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900995584 00000100:00100000:0.0:1784290227.503665:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900995456 00000100:00100000:3.0:1784290227.503695:0:26261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4894 00000100:00100000:0.0:1784290227.503708:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:3.0:1784290227.503714:0:26261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:83027:x1870961900995584:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:3.0:1784290227.503718:0:26261:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784290227.503724:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961900995456:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:0.0:1784290227.503730:0:8406:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:3.0:1784290227.503741:0:26261:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1698 00002000:00000024:0.0:1784290227.503750:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290227.503803:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961900995456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290227.503822:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1784290227.503825:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961900995456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290227.505581:0:8999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475819880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:83025:x1870961900995328:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2335us (2467us total) trans 4294968624 rc 0/0 00000100:00100000:2.0:1784290227.505589:0:8999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4893 00000100:00100000:0.0:1784290227.505624:0:83025:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2475819c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83025:1870961900995328:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1784290227.505642:0:83025:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x6a1:0x0]-[0x280000401:0x6c1:0x0] 00000100:00100000:3.0:1784290227.505770:0:26261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:83027:x1870961900995584:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2062us (2167us total) trans 4294968623 rc 0/0 00000100:00100000:3.0:1784290227.505776:0:26261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4894 00000100:00100000:0.0:1784290227.505809:0:83027:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f977480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83027:1870961900995584:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784290227.505818:0:83027:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x6a1:0x0]-[0x2c0000401:0x6c1:0x0] 00010000:00010000:1.0:1784290227.751515:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1784290228.391471:0:23867:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9c245f7ef100 x1870961900993664/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1784290237 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290228.391619:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961900995712:0@lo:400:kworker.0 00000100:00080000:1.0:1784290228.391624:0:60390:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1784290228.391637:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245f7ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1870961900993664:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 1017663us (1017908us total) trans 0 rc 0/0 00000100:00080000:1.0:1784290228.391638:0:60390:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1784290228.391657:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3702 00000100:00080000:0.0:1784290228.391695:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1784290228.391715:0:3616:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9c2468ad7800 x1870961900993664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290257 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290228.391718:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784290228.391737:0:3616:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9c2468ad7800 x1870961900993664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290257 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290228.391747:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:00100000:1.0:1784290228.391761:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1870961900996096:0@lo:400:kworker.0 00000100:00100000:3.0:1784290228.391763:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1870961900995840:0@lo:400:kworker.0 00000100:02000000:0.0:1784290228.391775:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1784290228.391788:0:3616:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000124aa97): req@ffff9c247c536680 x1870961900910592/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290053 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290228.391806:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1870961900996224:0@lo:400:kworker.0 00000100:00100000:0.0:1784290228.391807:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961900993664:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:1.0:1784290228.391847:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290228.391904:0:83013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900995712 00000100:00100000:3.0:1784290228.391915:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900996096 00000100:00100000:2.0:1784290228.391915:0:83013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900995712 00000100:00100000:3.0:1784290228.391925:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900996096 00000100:00100000:1.0:1784290228.391936:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961900996608:0@lo:400:kworker.0 00000100:00100000:0.0:1784290228.391940:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961900995968:0@lo:400:kworker.0 00000100:00100000:2.0:1784290228.391984:0:83013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1784290228.392003:0:83013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23441c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3620:x1870961900995712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290228.392005:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290228.392015:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000020:02000000:2.0:1784290228.392020:0:83013:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784290228.392036:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1870961900996096:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784290228.392044:0:66008:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784290228.392059:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900996608 00000100:00100000:0.0:1784290228.392068:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900996608 00000100:00100000:1.0:1784290228.392087:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1870961900997120:0@lo:400:kworker.0 00000100:00100000:2.0:1784290228.392129:0:83013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23441c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3620:x1870961900995712:12345-0@lo:400:kworker.0 Request processed in 130us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290228.392131:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:3.0:1784290228.392141:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1870961900996096:12345-0@lo:400:kworker.0 Request processed in 107us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290228.392156:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290228.392160:0:83013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1784290228.392161:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1870961900996608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290228.392169:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000020:02000000:0.0:1784290228.392178:0:65989:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784290228.392204:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900997120 00000100:00100000:3.0:1784290228.392212:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900997120 00000100:00100000:1.0:1784290228.392225:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1870961900996096:0@lo:400:kworker.0 00000100:00100000:1.0:1784290228.392251:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1784290228.392256:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784290228.392267:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247580a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961900997248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784290228.392274:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:0.0:1784290228.392284:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1870961900996608:12345-0@lo:400:kworker.0 Request processed in 130us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290228.392289:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290228.392299:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1870961900997120:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784290228.392307:0:66008:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784290228.392308:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:1.0:1784290228.392322:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290228.392332:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961900996352:0@lo:400:kworker.0 00000100:00100000:0.0:1784290228.392384:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900995840 00000100:00100000:0.0:1784290228.392391:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900995840 00000100:00100000:1.0:1784290228.392427:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961900996608:0@lo:400:kworker.0 00000100:00100000:3.0:1784290228.392439:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1870961900997120:12345-0@lo:400:kworker.0 Request processed in 143us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290228.392446:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290228.392454:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:1.0:1784290228.392456:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1870961900997120:0@lo:400:kworker.0 00000100:00100000:0.0:1784290228.392476:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1870961900995840:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1784290228.392484:0:65989:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784290228.392491:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:2.0:1784290228.392518:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961900996864:0@lo:400:kworker.0 00000100:00100000:1.0:1784290228.392527:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900997248 00000100:00100000:1.0:1784290228.392535:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900997248 00000100:00100000:0.0:1784290228.392552:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1870961900995840:12345-0@lo:400:kworker.0 Request processed in 81us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290228.392565:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:3.0:1784290228.392569:0:26255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900996352 00000100:00100000:2.0:1784290228.392579:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290228.392582:0:26255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900996352 00000100:00100000:1.0:1784290228.392596:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3708 00000100:00080000:0.0:1784290228.392601:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784290228.392616:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1870961900997248:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:1.0:1784290228.392636:0:8412:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784290228.392645:0:26255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900996864 00000100:00100000:0.0:1784290228.392653:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290228.392655:0:26255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900996864 00000100:00100000:2.0:1784290228.392660:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1784290228.392678:0:8412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444655104 avail 1298415616 00000100:00100000:3.0:1784290228.392709:0:26255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00100000:0.0:1784290228.392715:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961900996736:0@lo:400:kworker.0 00000100:00100000:3.0:1784290228.392730:0:26255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961900996352:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784290228.392737:0:26255:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1784290228.392744:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1870961900995840:0@lo:400:kworker.0 00000100:00100000:1.0:1784290228.392781:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1870961900997248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 170us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290228.392791:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290228.392796:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900910592 00000100:00100000:1.0:1784290228.392804:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3708 00000100:00100000:2.0:1784290228.392805:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900910592 00000100:00100000:3.0:1784290228.392828:0:26255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961900996352:12345-0@lo:400:kworker.0 Request processed in 103us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290228.392842:0:26255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00100000:1.0:1784290228.392843:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900996736 00000100:00100000:2.0:1784290228.392876:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3709 00000100:00100000:1.0:1784290228.392877:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900996736 00000100:00100000:0.0:1784290228.392882:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961900995712:0@lo:400:kworker.0 00000100:00100000:3.0:1784290228.392896:0:26255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:2.0:1784290228.392903:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3617:x1870961900910592:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:2.0:1784290228.392911:0:22091:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784290228.392921:0:26255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961900996864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290228.392932:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3710 00000020:02000000:3.0:1784290228.392933:0:26255:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1784290228.392933:0:22091:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444655104 avail 1298415616 00000100:00100000:0.0:1784290228.392936:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900996224 00000100:00100000:0.0:1784290228.392947:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900996224 00000100:00100000:1.0:1784290228.392957:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247580b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961900996736:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1784290228.392964:0:8412:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784290228.393012:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:2.0:1784290228.393031:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3617:x1870961900910592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290228.393032:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1870961900996224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290228.393038:0:26255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961900996864:12345-0@lo:400:kworker.0 Request processed in 122us (458us total) trans 0 rc 0/0 00000020:02000000:0.0:1784290228.393052:0:66004:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1784290228.393059:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247580b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961900996736:12345-0@lo:400:kworker.0 Request processed in 105us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290228.393069:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3709 00000100:00100000:3.0:1784290228.393070:0:26255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00100000:1.0:1784290228.393086:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3710 00000100:00100000:0.0:1784290228.393125:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1870961900996224:12345-0@lo:400:kworker.0 Request processed in 98us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290228.393137:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:2.0:1784290228.393146:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447aeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961900996352:0@lo:400:kworker.0 00000100:00100000:1.0:1784290228.393148:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290228.393175:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900995968 00000100:00100000:2.0:1784290228.393181:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961900996864:0@lo:400:kworker.0 00000100:00100000:0.0:1784290228.393182:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900995968 00000100:00080000:3.0:1784290228.393183:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784290228.393204:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961900996480:0@lo:400:kworker.0 00000100:00100000:2.0:1784290228.393227:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961900910592:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784290228.393257:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:1.0:1784290228.393271:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290228.393280:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961900995968:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1784290228.393296:0:66004:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00080000:2.0:1784290228.393310:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784290228.393330:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961900996992:0@lo:400:kworker.0 00000100:00100000:2.0:1784290228.393383:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900996480 00000100:00100000:2.0:1784290228.393390:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900996480 00000100:00100000:0.0:1784290228.393396:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961900995968:12345-0@lo:400:kworker.0 Request processed in 120us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290228.393408:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:1.0:1784290228.393432:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290228.393457:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900996992 00000100:00100000:2.0:1784290228.393463:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900996992 00000100:00100000:3.0:1784290228.393476:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247580a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961900997248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784290228.393479:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1870961900996224:0@lo:400:kworker.0 00000100:00100000:2.0:1784290228.393511:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462 00000100:00100000:2.0:1784290228.393527:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961900996480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290228.393532:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961900996736:0@lo:400:kworker.0 00000100:00100000:1.0:1784290228.393535:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961900995968:0@lo:400:kworker.0 00000020:02000000:2.0:1784290228.393539:0:26252:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784290228.393573:0:26259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00100000:3.0:1784290228.393597:0:26259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961900996992:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784290228.393607:0:26259:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1784290228.393615:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961900996480:12345-0@lo:400:kworker.0 Request processed in 87us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290228.393634:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961900996480:0@lo:400:kworker.0 00000100:00100000:2.0:1784290228.393646:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462 00000100:00100000:3.0:1784290228.393688:0:26259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961900996992:12345-0@lo:400:kworker.0 Request processed in 98us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290228.393693:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961900996992:0@lo:400:kworker.0 00000100:00100000:3.0:1784290228.393709:0:26259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00010000:00010000:1.0:1784290228.775558:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290229.799625:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290230.439744:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784290230.439777:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961900997376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784290230.439896:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290230.439971:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900997376 00000100:00100000:2.0:1784290230.439986:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900997376 00000100:00100000:2.0:1784290230.440063:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3711 00000100:00100000:2.0:1784290230.440082:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247580b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961900997376:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:2.0:1784290230.440096:0:22091:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1784290230.440151:0:22091:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:2.0:1784290230.440250:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247580b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961900997376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 172us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290230.440262:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3711 00000100:00100000:0.0:1784290230.440416:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961900997376:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784290230.823561:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290231.847599:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290232.423551:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1870961900997760:0@lo:400:kworker.0 00000100:00100000:2.0:1784290232.423580:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1870961900997888:0@lo:400:kworker.0 00000100:00100000:3.0:1784290232.423601:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1870961900997632:0@lo:400:kworker.0 00000100:00100000:1.0:1784290232.423609:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961900997504:0@lo:400:kworker.0 00000100:00100000:0.0:1784290232.423626:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290232.423654:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900997760 00000100:00100000:2.0:1784290232.423662:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900997760 00000100:00100000:1.0:1784290232.423676:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290232.423683:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290232.423691:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961900998272:0@lo:400:kworker.0 00000100:00100000:2.0:1784290232.423725:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900997632 00000100:00100000:2.0:1784290232.423730:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900997632 00000100:00100000:1.0:1784290232.423735:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1870961900998016:0@lo:400:kworker.0 00000100:00100000:3.0:1784290232.423738:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961900998144:0@lo:400:kworker.0 00000100:00100000:0.0:1784290232.423738:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290232.423757:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:2.0:1784290232.423770:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247580a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1870961900997760:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1784290232.423776:0:74876:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784290232.423786:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961900998784:0@lo:400:kworker.0 00000100:00100000:1.0:1784290232.423790:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290232.423797:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290232.423834:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1870961900998528:0@lo:400:kworker.0 00000100:00100000:3.0:1784290232.423850:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961900998656:0@lo:400:kworker.0 00000100:00100000:0.0:1784290232.423859:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290232.423867:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247580a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1870961900997760:12345-0@lo:400:kworker.0 Request processed in 99us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290232.423875:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:1.0:1784290232.423882:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290232.423894:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290232.423904:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900998016 00000100:00100000:2.0:1784290232.423909:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900998016 00000100:00100000:1.0:1784290232.423915:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1870961900999040:0@lo:400:kworker.0 00000100:00100000:0.0:1784290232.423915:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1870961900997760:0@lo:400:kworker.0 00000100:00100000:2.0:1784290232.423932:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900998528 00000100:00100000:2.0:1784290232.423936:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900998528 00000100:00100000:1.0:1784290232.423956:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290232.423960:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:0.0:1784290232.423963:0:26253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900998272 00000100:00100000:2.0:1784290232.423969:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:0.0:1784290232.423970:0:26253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900998272 00000100:00100000:3.0:1784290232.423975:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1870961900997632:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784290232.423981:0:66008:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1784290232.423985:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1870961900998016:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1784290232.424000:0:74876:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1784290232.424001:0:83012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900997504 00000100:00100000:1.0:1784290232.424007:0:83012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900997504 00000100:00100000:0.0:1784290232.424010:0:26253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900998784 00000100:00100000:0.0:1784290232.424015:0:26253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900998784 00000100:00100000:3.0:1784290232.424034:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1870961900997632:12345-0@lo:400:kworker.0 Request processed in 64us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290232.424043:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:1.0:1784290232.424049:0:83012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784290232.424065:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900999040 00000100:00100000:0.0:1784290232.424066:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464 00000100:00100000:2.0:1784290232.424067:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1870961900998016:12345-0@lo:400:kworker.0 Request processed in 86us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290232.424067:0:83012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3618:x1870961900997504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290232.424070:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900999040 00000020:02000000:1.0:1784290232.424081:0:83012:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1784290232.424086:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:0.0:1784290232.424092:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961900998272:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1784290232.424100:0:26253:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784290232.424122:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:2.0:1784290232.424132:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:1.0:1784290232.424137:0:83012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3618:x1870961900997504:12345-0@lo:400:kworker.0 Request processed in 74us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290232.424143:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1870961900998528:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784290232.424150:0:66008:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1784290232.424153:0:83012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784290232.424154:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1870961900999040:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1784290232.424162:0:74876:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784290232.424177:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961900998272:12345-0@lo:400:kworker.0 Request processed in 91us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290232.424190:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464 00000100:00100000:1.0:1784290232.424194:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900998144 00000100:00100000:1.0:1784290232.424199:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900998144 00000100:00100000:3.0:1784290232.424201:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1870961900998528:12345-0@lo:400:kworker.0 Request processed in 68us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290232.424210:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:0.0:1784290232.424218:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:1.0:1784290232.424234:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900998656 00000100:00100000:2.0:1784290232.424235:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1870961900999040:12345-0@lo:400:kworker.0 Request processed in 88us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290232.424237:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961900998784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290232.424239:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900998656 00000020:02000000:0.0:1784290232.424250:0:26253:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1784290232.424252:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1784290232.424258:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3712 00000100:00100000:3.0:1784290232.424269:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345b77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1870961900998144:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1784290232.424274:0:23867:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1784290232.424280:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3713 00000100:00080000:2.0:1784290232.424285:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784290232.424292:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784290232.424293:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961900998656:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784290232.424297:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:02000000:1.0:1784290232.424299:0:8412:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784290232.424307:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961900998784:12345-0@lo:400:kworker.0 Request processed in 77us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290232.424319:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00100000:3.0:1784290232.424326:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345b77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1870961900998144:12345-0@lo:400:kworker.0 Request processed in 59us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290232.424334:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3712 00000100:00100000:1.0:1784290232.424377:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961900998656:12345-0@lo:400:kworker.0 Request processed in 88us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290232.424384:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3713 00000100:00100000:2.0:1784290232.424395:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1870961900997632:0@lo:400:kworker.0 00000100:00100000:2.0:1784290232.424420:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961900998144:0@lo:400:kworker.0 00000100:00100000:0.0:1784290232.424420:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961900998272:0@lo:400:kworker.0 00000100:00100000:1.0:1784290232.424447:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961900997504:0@lo:400:kworker.0 00000100:00100000:2.0:1784290232.424449:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961900998656:0@lo:400:kworker.0 00000100:00100000:3.0:1784290232.424454:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290232.424458:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961900998784:0@lo:400:kworker.0 00000100:00100000:1.0:1784290232.424483:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1870961900998016:0@lo:400:kworker.0 00000100:00100000:3.0:1784290232.424499:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961900998400:0@lo:400:kworker.0 00000100:00100000:2.0:1784290232.424499:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900997888 00000100:00100000:1.0:1784290232.424504:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1870961900998528:0@lo:400:kworker.0 00000100:00100000:2.0:1784290232.424506:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900997888 00000100:00100000:1.0:1784290232.424527:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1870961900999040:0@lo:400:kworker.0 00000100:00080000:0.0:1784290232.424545:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784290232.424547:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290232.424556:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:2.0:1784290232.424567:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1870961900997888:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1784290232.424570:0:66008:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784290232.424574:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961900998912:0@lo:400:kworker.0 00000100:00100000:0.0:1784290232.424587:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900998400 00000100:00100000:0.0:1784290232.424594:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900998400 00000100:00100000:3.0:1784290232.424613:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290232.424618:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1870961900997888:12345-0@lo:400:kworker.0 Request processed in 54us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290232.424624:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00080000:1.0:1784290232.424649:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290232.424654:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900998912 00000100:00100000:3.0:1784290232.424659:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1870961900997888:0@lo:400:kworker.0 00000100:00100000:0.0:1784290232.424661:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900998912 00000100:00100000:2.0:1784290232.424678:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00100000:2.0:1784290232.424690:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961900998400:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784290232.424695:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:02000000:2.0:1784290232.424704:0:9000:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784290232.424713:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00100000:0.0:1784290232.424727:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961900998912:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1784290232.424733:0:26258:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1784290232.424744:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961900998400:12345-0@lo:400:kworker.0 Request processed in 57us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290232.424752:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000100:00100000:3.0:1784290232.424771:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961900998400:0@lo:400:kworker.0 00000100:00100000:3.0:1784290232.424795:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961900998912:0@lo:400:kworker.0 00000100:00100000:0.0:1784290232.424808:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961900998912:12345-0@lo:400:kworker.0 Request processed in 83us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290232.424929:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00100000:3.0:1784290232.487542:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961900999296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784290232.487548:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961900999168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784290232.487614:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290232.487652:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290232.487686:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900999296 00000100:00100000:2.0:1784290232.487694:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900999168 00000100:00100000:3.0:1784290232.487695:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900999296 00000100:00100000:2.0:1784290232.487700:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900999168 00000100:00100000:3.0:1784290232.487756:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:2.0:1784290232.487766:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:3.0:1784290232.487771:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961900999296:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:3.0:1784290232.487780:0:26373:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1784290232.487782:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961900999168:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:2.0:1784290232.487790:0:17967:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1784290232.487809:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1784290232.487825:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290232.487878:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961900999296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290232.487885:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:2.0:1784290232.487888:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961900999168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290232.487896:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:0.0:1784290232.487943:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2475c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961900999296:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290232.487948:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961900999168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784290232.837629:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290232.837675:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290232.837697:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290232.837699:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896192512 00000100:00100000:0.0:1784290232.837722:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896192512 00000100:00100000:3.0:1784290232.837733:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290232.837736:0:83013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896192256 00000100:00100000:2.0:1784290232.837744:0:83013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896192256 00000100:00100000:3.0:1784290232.837777:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896192384 00000100:00080000:1.0:1784290232.837779:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784290232.837783:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896192384 00000100:00100000:2.0:1784290232.837800:0:83013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 152 00000100:00100000:1.0:1784290232.837819:0:26251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896192640 00000100:00100000:0.0:1784290232.837821:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 590 00000100:00100000:1.0:1784290232.837827:0:26251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896192640 00000100:00100000:2.0:1784290232.837829:0:83013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+10:2397:x1870961896192256:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290232.837835:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 948 00000100:00100000:0.0:1784290232.837854:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896192512:12345-192.168.202.6@tcp:400:kworker.0 00000020:02000000:2.0:1784290232.837858:0:83013:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000020:02000000:0.0:1784290232.837861:0:65990:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1784290232.837863:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2396:x1870961896192384:12345-192.168.202.6@tcp:38:kworker.0 00000100:00080000:1.0:1784290232.837872:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:02000000:3.0:1784290232.837877:0:74876:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:3.0:1784290232.837901:0:74876:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp t90194313217 exp 0000000000000000 cur 1974 last 0 00000100:00100000:1.0:1784290232.837909:0:26251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1468 00000100:00100000:1.0:1784290232.837920:0:26251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896192640:12345-192.168.202.6@tcp:400:kworker.0 00000020:02000000:1.0:1784290232.837926:0:26251:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1784290232.837933:0:83013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+10:2397:x1870961896192256:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 121us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290232.837934:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896192512:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 97us (309us total) trans 0 rc 0/0 00000020:00000080:3.0:1784290232.837947:0:74876:0:(genops.c:1406:class_connect()) connect: client bd808cf4-dd54-45f0-9b2b-1434e8330e5d, cookie 0x5953bbf6b30730dd 00000100:00100000:2.0:1784290232.837950:0:83013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 152 00000100:00100000:0.0:1784290232.837951:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 590 00000004:00100000:3.0:1784290232.837976:0:74876:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1784290232.838007:0:26251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896192640:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 90us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290232.838013:0:26251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1468 00000100:00080000:3.0:1784290232.838106:0:74876:0:(import.c:65:import_set_state_nolock()) ffff9c24481c7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784290232.838240:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896192384:12345-192.168.202.6@tcp:38:kworker.0 Request processed in 378us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290232.838247:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 948 00000001:00100000:2.0:1784290232.838919:0:83007:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000100:00100000:3.0:1784290232.843879:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290232.843936:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896192768 00000100:00100000:2.0:1784290232.843942:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896192768 00000100:00100000:2.0:1784290232.843974:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 949 00000100:00100000:2.0:1784290232.843982:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:63853:x1870961896192768:12345-192.168.202.6@tcp:41:lfs.0 00000020:02000000:2.0:1784290232.843987:0:66008:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1784290232.844014:0:66008:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:2.0:1784290232.844053:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:63853:x1870961896192768:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 72us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290232.844059:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 949 00000100:00100000:1.0:1784290232.845804:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290232.845886:0:26261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896192896 00000100:00100000:3.0:1784290232.845891:0:26261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896192896 00000100:00100000:3.0:1784290232.845917:0:26261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4895 00000100:00100000:3.0:1784290232.845922:0:26261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2396:x1870961896192896:12345-192.168.202.6@tcp:8:lfs.0 00000020:02000000:3.0:1784290232.845927:0:26261:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:3.0:1784290232.845943:0:26261:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp t0 exp 0000000000000000 cur 1974 last 0 00000020:00000080:3.0:1784290232.845960:0:26261:0:(genops.c:1406:class_connect()) connect: client bd808cf4-dd54-45f0-9b2b-1434e8330e5d, cookie 0x5953bbf6b30730e4 00002000:00100000:3.0:1784290232.845966:0:26261:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bd808cf4-dd54-45f0-9b2b-1434e8330e5d/ffff9c24481c4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ad ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784290232.845972:0:26261:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784290232.846013:0:26261:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784290232.846026:0:26261:0:(import.c:65:import_set_state_nolock()) ffff9c24481c0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784290232.846061:0:26261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896192896:12345-192.168.202.6@tcp:8:lfs.0 Request processed in 137us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290232.846068:0:26261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4895 00000100:00100000:1.0:1784290232.846993:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290232.847047:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896193024 00000100:00100000:0.0:1784290232.847053:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896193024 00000100:00100000:0.0:1784290232.847087:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1088 00000100:00100000:0.0:1784290232.847095:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:63853:x1870961896193024:12345-192.168.202.6@tcp:13:lfs.0 00000020:02000000:0.0:1784290232.847100:0:8405:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1784290232.847112:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290232.847146:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:63853:x1870961896193024:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 52us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290232.847153:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1088 00000001:00100000:2.0:1784290232.847492:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000001:00080000:2.0:1784290232.847500:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968624 is committed 00000100:00100000:0.0:1784290232.848059:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290232.848113:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896193152 00000100:00100000:3.0:1784290232.848120:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896193152 00000100:00100000:3.0:1784290232.848165:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1089 00000100:00100000:3.0:1784290232.848179:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:63853:x1870961896193152:12345-192.168.202.6@tcp:13:lfs.0 00000020:02000000:3.0:1784290232.848184:0:26373:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1784290232.848194:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290232.848229:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:63853:x1870961896193152:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 50us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290232.848234:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1089 00010000:00010000:1.0:1784290232.871564:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290232.999592:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247581a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961900999552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784290232.999600:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961900999424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784290232.999685:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290232.999777:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900999552 00000100:00100000:3.0:1784290232.999781:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290232.999791:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900999552 00000100:00100000:1.0:1784290232.999868:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900999424 00000100:00100000:1.0:1784290232.999875:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900999424 00000100:00100000:1.0:1784290232.999917:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:1.0:1784290232.999935:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961900999552:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784290232.999935:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000020:02000000:1.0:1784290232.999948:0:8405:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1784290232.999961:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961900999424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784290232.999972:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000020:02000000:0.0:1784290232.999972:0:8406:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1784290232.999997:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290233.000041:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961900999552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290233.000063:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:2.0:1784290233.000084:0:3618:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968624 gen 2 00000100:00100000:0.0:1784290233.000094:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961900999424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290233.000120:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1784290233.000128:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247581a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961900999552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784290233.000129:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961900999424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784290233.511566:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961900999680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784290233.511640:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290233.511696:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900999680 00000100:00100000:2.0:1784290233.511706:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900999680 00000100:00100000:2.0:1784290233.511756:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3714 00000100:00100000:2.0:1784290233.511767:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1870961900999680:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:2.0:1784290233.511773:0:23867:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1784290233.511826:0:23867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444655104 avail 1298415616 00000100:00100000:2.0:1784290233.511883:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1870961900999680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290233.511891:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3714 00000100:00100000:1.0:1784290233.511925:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961900999680:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1784290233.513253:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968623 is committed 00010000:00010000:1.0:1784290233.895623:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290234.160552:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290234.160677:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896193280 00000100:00100000:0.0:1784290234.160692:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896193280 00000100:00100000:0.0:1784290234.160766:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 950 00000100:00100000:0.0:1784290234.160778:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:63946:x1870961896193280:12345-192.168.202.6@tcp:101:lfs.0 00000020:02000000:0.0:1784290234.160788:0:65990:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:0.0:1784290234.160828:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290234.160854:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8400/0x5953bbf6b30730eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2192 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784290234.161963:0:65990:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1051us 00010000:00010000:0.0:1784290234.171445:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b30730f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290234.171469:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b30730f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290234.171486:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b30730f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290234.171556:0:65990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784290234.171561:0:65990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1784290234.171605:0:65990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b30730f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290234.171652:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8400/0x5953bbf6b30730eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2192 expref: 7 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290234.171675:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b30730f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2192 expref: 6 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290234.171697:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c244405df00) 00010000:00010000:0.0:1784290234.171701:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784290234.171706:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef8a00, rc 0) 00000100:00100000:0.0:1784290234.171791:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:63946:x1870961896193280:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 11012us (11249us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290234.171826:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 950 00000100:00100000:1.0:1784290234.174469:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290234.174524:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896193408 00000100:00100000:2.0:1784290234.174534:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896193408 00000100:00100000:2.0:1784290234.174603:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 951 00000100:00100000:2.0:1784290234.174619:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:63946:x1870961896193408:12345-192.168.202.6@tcp:41:lfs.0 00000020:02000000:2.0:1784290234.174629:0:66004:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1784290234.174663:0:66004:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444655104 avail 1298415616 00000100:00100000:2.0:1784290234.174726:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447717480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:63946:x1870961896193408:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 112us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290234.174736:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 951 00000100:00100000:3.0:1784290234.183867:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290234.183954:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896193536 00000100:00100000:2.0:1784290234.183972:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896193536 00000100:00100000:2.0:1784290234.184022:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 952 00000100:00100000:2.0:1784290234.184037:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:63464:x1870961896193536:12345-192.168.202.6@tcp:101:multiop.0 00000020:02000000:2.0:1784290234.184046:0:65988:0:(tgt_handler.c:766:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:2.0:1784290234.184061:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290234.184081:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b30730f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2199 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184146:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073100 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184169:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073100 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184179:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073100 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184193:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3073107 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184202:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3073107 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184209:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3073107 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184430:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b307310e lrc: 3/1,0 mode: --/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184441:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b307310e lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184463:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b307310e lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784290234.184495:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a041:0x1:0x0]: returning size 0 00000004:00200000:2.0:1784290234.184499:0:65988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1784290234.184527:0:65988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b307310e lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184540:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b307310e lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184551:0:65988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073100 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184559:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073100 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184566:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073100 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184573:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073100 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184580:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290234.184584:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073100 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184592:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073100 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184603:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c244405df00) 00010000:00010000:2.0:1784290234.184606:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290234.184618:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073100 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184626:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073100 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184639:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3073107 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184646:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3073107 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184653:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3073107 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184658:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450abc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290234.184661:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3073107 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184668:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3073107 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184675:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff9c244acdc600) 00010000:00010000:2.0:1784290234.184678:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290234.184681:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3073107 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184687:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3073107 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184718:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b30730f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2199 expref: 8 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184745:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b307310e lrc: 3/0,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2199 expref: 7 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290234.184754:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff9c244acdc000) 00010000:00010000:2.0:1784290234.184756:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784290234.184759:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aa200, rc 0) 00000100:00100000:2.0:1784290234.184828:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:63464:x1870961896193536:12345-192.168.202.6@tcp:101:multiop.0 Request processed in 795us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290234.184836:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 952 00010000:00010000:1.0:1784290234.919734:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290235.182720:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290235.182771:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896193792 00000100:00100000:2.0:1784290235.182782:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896193792 00000100:00080000:3.0:1784290235.182858:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784290235.182874:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 953 00000100:00100000:2.0:1784290235.182888:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:64066:x1870961896193792:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:2.0:1784290235.182940:0:65989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1784290235.182969:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b307310e lrc: 0/0,0 mode: --/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2199 expref: 7 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.182989:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff9c244acdc000) 00010000:00010000:2.0:1784290235.183009:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b30730f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2192 expref: 6 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.183020:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c244405df00) 00010000:00010000:2.0:1784290235.183027:0:65989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290235.183049:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073115 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.183072:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073115 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.183082:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073115 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.183094:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307311c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.183101:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307311c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.183107:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307311c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.183181:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3073123 lrc: 3/0,1 mode: --/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.183188:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3073123 lrc: 3/0,1 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.183195:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3073123 lrc: 3/0,1 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784290235.183553:0:65989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5a:0x0].2, 64 off8320 00000004:00080000:2.0:1784290235.183571:0:65989:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1976423228281ns, next at 1977423224190ns, rc = 0 00010000:00010000:2.0:1784290235.183652:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b307312a lrc: 3/0,1 mode: --/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.183668:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b307312a lrc: 3/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.183694:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b307312a lrc: 3/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.183704:0:65989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b307312a lrc: 4/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.183713:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b307312a lrc: 4/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.183722:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b307312a lrc: 3/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.183754:0:65989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290235.183806:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290235.183817:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3073123 lrc: 3/0,1 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290235.183819:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b307312a lrc: 2/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.183858:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3073123 lrc: 2/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.183870:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3073123 lrc: 3/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290235.183871:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290235.183882:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b307312a lrc: 2/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.183884:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450abc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290235.183894:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3073123 lrc: 3/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290235.183902:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b307312a lrc: 3/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.183907:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3073123 lrc: 4/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290235.183922:0:7429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff9c244acdc100) 00010000:00010000:0.0:1784290235.183928:0:7429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784290235.183933:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b307312a lrc: 1/0,0 mode: --/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.183939:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff9c244acdc100) 00010000:00010000:0.0:1784290235.183942:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b307312a lrc: 0/0,0 mode: --/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.183946:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784290235.183960:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290235.183963:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3073123 lrc: 2/0,0 mode: --/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290235.183965:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290235.183969:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290235.183979:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3073123 lrc: 0/0,0 mode: --/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.184008:0:65989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073115 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.184019:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073115 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.184028:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073115 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.184037:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073115 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.184044:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290235.184048:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073115 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.184057:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073115 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.184069:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c244acdc600) 00010000:00010000:2.0:1784290235.184073:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290235.184076:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073115 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.184085:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073115 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784290235.184103:0:65989:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f3574041 reply state 000000002668bb8a transno 94489280513 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307311c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.184127:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307311c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290235.184137:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff9c244acdcb00) 00010000:00010000:2.0:1784290235.184141:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290235.184145:0:65989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784290235.184226:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:64066:x1870961896193792:12345-192.168.202.6@tcp:36:rm.0 Request processed in 1340us (1514us total) trans 94489280513 rc 0/0 00000100:00100000:2.0:1784290235.184237:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 953 00000100:00100000:1.0:1784290235.559491:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784290235.559521:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961900999808:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784290235.559602:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290235.559674:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900999808 00000100:00100000:3.0:1784290235.559686:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900999808 00000100:00100000:3.0:1784290235.559757:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3715 00000100:00100000:3.0:1784290235.559772:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961900999808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784290235.559833:0:8413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:3.0:1784290235.559899:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961900999808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290235.559908:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3715 00000100:00100000:1.0:1784290235.559971:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961900999808:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1784290235.943576:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290236.967433:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290237.607505:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961900999936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784290237.607514:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901000192:0@lo:400:kworker.0 00000100:00100000:1.0:1784290237.607535:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1870961901000448:0@lo:400:kworker.0 00000100:00100000:3.0:1784290237.607587:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290237.607590:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290237.607592:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290237.607618:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1870961901000320:0@lo:400:kworker.0 00000100:00100000:3.0:1784290237.607624:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901000064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290237.607660:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901000960:0@lo:400:kworker.0 00000100:00100000:3.0:1784290237.607665:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290237.607665:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1870961901000704:0@lo:400:kworker.0 00000100:00100000:0.0:1784290237.607678:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290237.607708:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1870961901000576:0@lo:400:kworker.0 00000100:00100000:1.0:1784290237.607715:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290237.607718:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901000832:0@lo:400:kworker.0 00000100:00100000:2.0:1784290237.607726:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290237.607746:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901001472:0@lo:400:kworker.0 00000100:00100000:3.0:1784290237.607750:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961900999936 00000100:00100000:3.0:1784290237.607756:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961900999936 00000100:00100000:0.0:1784290237.607780:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290237.607787:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1870961901001216:0@lo:400:kworker.0 00000100:00100000:1.0:1784290237.607796:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290237.607826:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901001344:0@lo:400:kworker.0 00000100:00100000:3.0:1784290237.607836:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901000064 00000100:00100000:3.0:1784290237.607840:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901000064 00000100:00100000:2.0:1784290237.607851:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290237.607866:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290237.607867:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901000448 00000100:00100000:1.0:1784290237.607872:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901000448 00000100:00100000:3.0:1784290237.607874:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:2.0:1784290237.607886:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1870961901001728:0@lo:400:kworker.0 00000100:00100000:3.0:1784290237.607887:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961900999936:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784290237.607912:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901000320 00000100:00100000:1.0:1784290237.607913:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901000704 00000100:00100000:1.0:1784290237.607918:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901000704 00000100:00100000:0.0:1784290237.607918:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901000320 00002000:00000024:3.0:1784290237.607920:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784290237.607928:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290237.607947:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901001216 00000100:00100000:0.0:1784290237.607948:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901001728 00000100:00100000:0.0:1784290237.607952:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901001728 00000100:00100000:1.0:1784290237.607956:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901001216 00000100:00100000:0.0:1784290237.607977:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:2.0:1784290237.607983:0:83012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901000192 00000100:00100000:1.0:1784290237.607983:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:3.0:1784290237.607990:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961900999936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290237.607991:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1870961901000704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290237.607991:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1870961901000448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290237.608001:0:83012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901000192 00000100:00100000:3.0:1784290237.608006:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00100000:3.0:1784290237.608028:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:3.0:1784290237.608037:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901000064:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290237.608052:0:83012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00002000:00000024:3.0:1784290237.608054:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290237.608059:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1870961901000704:12345-0@lo:400:kworker.0 Request processed in 67us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290237.608059:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1870961901000448:12345-0@lo:400:kworker.0 Request processed in 71us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290237.608069:0:83012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3618:x1870961901000192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290237.608075:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00100000:1.0:1784290237.608084:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:3.0:1784290237.608100:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901000064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290237.608102:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:1.0:1784290237.608110:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:3.0:1784290237.608114:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1784290237.608116:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1870961901000320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290237.608120:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1870961901001728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290237.608131:0:83012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3618:x1870961901000192:12345-0@lo:400:kworker.0 Request processed in 65us (545us total) trans 0 rc 0/0 00000100:00080000:3.0:1784290237.608140:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784290237.608141:0:83012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:3.0:1784290237.608148:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784290237.608154:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784290237.608159:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784290237.608163:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1870961901001728:12345-0@lo:400:kworker.0 Request processed in 41us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290237.608164:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1870961901000320:12345-0@lo:400:kworker.0 Request processed in 51us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290237.608173:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:0.0:1784290237.608181:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:2.0:1784290237.608199:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:2.0:1784290237.608219:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1870961901001216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290237.608224:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901000832 00000100:00100000:1.0:1784290237.608225:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901000960 00000100:00100000:1.0:1784290237.608230:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901000960 00000100:00100000:0.0:1784290237.608230:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901000832 00000100:00100000:3.0:1784290237.608238:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290237.608265:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901001472 00000100:00100000:0.0:1784290237.608265:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901001344 00000100:00100000:3.0:1784290237.608266:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901001088:0@lo:400:kworker.0 00000100:00100000:1.0:1784290237.608270:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901001472 00000100:00100000:0.0:1784290237.608270:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901001344 00000100:00100000:2.0:1784290237.608276:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1870961901001216:12345-0@lo:400:kworker.0 Request processed in 59us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290237.608298:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00100000:3.0:1784290237.608303:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290237.608315:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901001088 00000100:00100000:0.0:1784290237.608315:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3716 00000100:00100000:1.0:1784290237.608319:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901001088 00000100:00100000:0.0:1784290237.608326:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1870961901000832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290237.608328:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901001600:0@lo:400:kworker.0 00000100:00100000:2.0:1784290237.608328:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901000576 00000100:00100000:2.0:1784290237.608336:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901000576 00000100:00100000:1.0:1784290237.608397:0:26262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:1.0:1784290237.608409:0:26262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901000960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290237.608433:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290237.608439:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:0.0:1784290237.608441:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1870961901000832:12345-0@lo:400:kworker.0 Request processed in 115us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290237.608456:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1870961901000576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290237.608462:0:26262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901000960:12345-0@lo:400:kworker.0 Request processed in 55us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290237.608466:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3716 00000100:00100000:1.0:1784290237.608473:0:26262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00100000:3.0:1784290237.608485:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447716a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961900999936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290237.608488:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901001600 00000100:00100000:0.0:1784290237.608489:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3717 00000100:00100000:1.0:1784290237.608492:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901001600 00000100:00100000:0.0:1784290237.608500:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901001344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290237.608520:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1870961901000576:12345-0@lo:400:kworker.0 Request processed in 68us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290237.608522:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901000064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290237.608531:0:26262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:2.0:1784290237.608540:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:1.0:1784290237.608545:0:26262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901001472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290237.608549:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901001344:12345-0@lo:400:kworker.0 Request processed in 52us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290237.608558:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3717 00000100:00100000:3.0:1784290237.608564:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1870961901000576:0@lo:400:kworker.0 00000100:00100000:2.0:1784290237.608591:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:1.0:1784290237.608592:0:26262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901001472:12345-0@lo:400:kworker.0 Request processed in 49us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290237.608601:0:26259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00100000:2.0:1784290237.608608:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901001088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290237.608614:0:26259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3617:x1870961901001600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290237.608619:0:26262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00100000:0.0:1784290237.608638:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1870961901000320:0@lo:400:kworker.0 00000100:00080000:1.0:1784290237.608652:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290237.608655:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901000832:0@lo:400:kworker.0 00000100:00080000:1.0:1784290237.608658:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784290237.608660:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784290237.608670:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901001344:0@lo:400:kworker.0 00000100:00100000:3.0:1784290237.608691:0:26259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3617:x1870961901001600:12345-0@lo:400:kworker.0 Request processed in 80us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290237.608692:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901001088:12345-0@lo:400:kworker.0 Request processed in 84us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290237.608699:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901000960:0@lo:400:kworker.0 00000100:00100000:3.0:1784290237.608703:0:26259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00000100:00100000:2.0:1784290237.608713:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:1.0:1784290237.608726:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901001472:0@lo:400:kworker.0 00000100:00100000:0.0:1784290237.608727:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1870961901000704:0@lo:400:kworker.0 00000100:00100000:1.0:1784290237.608741:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1870961901000448:0@lo:400:kworker.0 00000100:00100000:0.0:1784290237.608747:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1870961901001216:0@lo:400:kworker.0 00000100:00100000:3.0:1784290237.608759:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901001088:0@lo:400:kworker.0 00000100:00100000:0.0:1784290237.608784:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1870961901001728:0@lo:400:kworker.0 00000100:00100000:3.0:1784290237.608789:0:3617:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968623 gen 2 00000100:00100000:3.0:1784290237.608819:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901001600:0@lo:400:kworker.0 00000100:00100000:0.0:1784290237.608822:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901000192:0@lo:400:kworker.0 00000001:02000400:0.0:1784290237.721321:0:83744:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130a: DoM file create (setstripe) replay ========================================================== 08:10:37 (1784290237) 00000100:00100000:1.0:1784290237.957629:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290237.957688:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290237.957694:0:83013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896193920 00000100:00100000:2.0:1784290237.957706:0:83013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896193920 00000100:00100000:1.0:1784290237.957737:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290237.957777:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896194048 00000100:00100000:3.0:1784290237.957782:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896194048 00000100:00100000:2.0:1784290237.957796:0:83013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 154 00000100:00100000:1.0:1784290237.957809:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290237.957810:0:83013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+10:2398:x1870961896193920:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290237.957823:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896194176 00000100:00100000:0.0:1784290237.957830:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896194176 00000100:00100000:3.0:1784290237.957845:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 597 00000100:00100000:1.0:1784290237.957854:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290237.957860:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2397:x1870961896194048:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290237.957876:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 598 00000100:00100000:0.0:1784290237.957891:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896194176:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290237.957892:0:83013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+10:2398:x1870961896193920:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 80us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290237.957904:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2397:x1870961896194048:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 48us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290237.957911:0:83013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 154 00000100:00100000:3.0:1784290237.957916:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 597 00000100:00080000:3.0:1784290237.957942:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784290237.957943:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896194176:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 57us (221us total) trans 0 rc 0/0 00000100:00080000:3.0:1784290237.957947:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784290237.957952:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 598 00000100:00100000:3.0:1784290237.957969:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896194304 00000100:00100000:3.0:1784290237.957973:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896194304 00000100:00100000:2.0:1784290237.958022:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896194432 00000100:00100000:2.0:1784290237.958029:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896194432 00000100:00100000:3.0:1784290237.958096:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1473 00000100:00100000:3.0:1784290237.958106:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2397:x1870961896194304:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290237.958112:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1474 00000100:00100000:0.0:1784290237.958123:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896194432:12345-192.168.202.6@tcp:400:kworker.0 00000100:00080000:2.0:1784290237.958136:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784290237.958150:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784290237.958181:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896194432:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 55us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290237.958182:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2397:x1870961896194304:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 72us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290237.958189:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1474 00000100:00100000:3.0:1784290237.958201:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1473 00010000:00010000:2.0:1784290237.992449:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784290238.024423:0:83007:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280513 is committed 00000004:00080000:1.0:1784290238.024432:0:83007:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:3.0:1784290238.024451:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307311c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.024463:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307311c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.024470:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307311c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.024475:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290238.024479:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307311c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.024485:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307311c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.024499:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff9c244acdcb00) 00010000:00010000:3.0:1784290238.024502:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290238.024506:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307311c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.024511:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307311c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290238.024572:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784290238.024588:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901001856:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784290238.024646:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290238.024686:0:26260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901001856 00000100:00100000:1.0:1784290238.024696:0:26260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901001856 00000100:00100000:1.0:1784290238.024748:0:26260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4896 00000100:00100000:1.0:1784290238.024758:0:26260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901001856:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1784290238.024801:0:26260:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:1666 count 1 00010000:00010000:1.0:1784290238.024821:0:26260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f24ab283/0x5953bbf6b3073131 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.024839:0:26260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b3072cd1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2168 expref: 5 pid: 8999 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.024846:0:26260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x682:0x0].0x0 since=203s v=(0 0) 00010000:00010000:1.0:1784290238.024855:0:26260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x682:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290238.024859:0:26260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f24ab283/0x5953bbf6b3073131 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.024879:0:26260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b3072cd1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2168 expref: 5 pid: 8999 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.024890:0:26260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b3072cd1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2168 expref: 5 pid: 8999 timeout: 2079 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290238.024899:0:26260:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:26260:1870961901001984:192.168.202.6@tcp:104: 00000100:00100000:1.0:1784290238.024964:0:26260:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474cf80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290238.026064:0:26260:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:26260:1870961901001984:192.168.202.6@tcp:104: 00010000:00010000:3.0:1784290238.026089:0:26260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f24ab283/0x5953bbf6b3073131 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290238.026337:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290238.026430:0:10356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896194560 00000100:00100000:1.0:1784290238.026436:0:10356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896194560 00010000:00010000:1.0:1784290238.026454:0:10356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b3072cd1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2168 expref: 6 pid: 8999 timeout: 2079 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290238.026482:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2572 00000100:00100000:1.0:1784290238.026490:0:10356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2400:x1870961896194560:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784290238.026498:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290238.026503:0:10356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b3072cd1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2168 expref: 6 pid: 8999 timeout: 2079 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.026512:0:10356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b3072cd1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2168 expref: 6 pid: 8999 timeout: 2079 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.026540:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b3072cd1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x682:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2168 expref: 6 pid: 8999 timeout: 2079 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.026549:0:10356:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x682:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290238.026552:0:10356:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x682:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290238.026557:0:10356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f24ab283/0x5953bbf6b3073131 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.026563:0:10356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f24ab283/0x5953bbf6b3073131 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.026584:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290238.026603:0:26260:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f24ab283/0x5953bbf6b3073131 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.026612:0:26260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f24ab283/0x5953bbf6b3073131 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290238.026617:0:10356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2400:x1870961896194560:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 126us (281us total) trans 0 rc 0/0 00010000:00010000:3.0:1784290238.026623:0:26260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f24ab283/0x5953bbf6b3073131 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290238.026635:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2572 00010000:00010000:3.0:1784290238.026637:0:26260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f24ab283/0x5953bbf6b3073131 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.026672:0:26260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784290238.026893:0:26260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901001856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2136us (2245us total) trans 4294968624 rc 0/0 00000100:00100000:3.0:1784290238.026901:0:26260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4896 00000004:00080000:1.0:1784290238.026921:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c2468792d80/2, rc 0, transno 4294968624 00000100:00100000:1.0:1784290238.026928:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468792d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901001856:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1784290238.026934:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290238.026944:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f24ab283/0x5953bbf6b3073131 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.026954:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2440031e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290238.026959:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f24ab283/0x5953bbf6b3073131 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.026983:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f24ab283/0x5953bbf6b3073131 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.026998:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f24ab283/0x5953bbf6b3073131 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.027008:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f24ab283/0x5953bbf6b3073131 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x682:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.027028:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290238.027031:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290238.027033:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784290238.027668:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968624 is committed 00000100:00100000:1.0:1784290238.043322:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290238.043378:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896194688 00000100:00100000:1.0:1784290238.043386:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896194688 00000100:00100000:1.0:1784290238.043440:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 954 00000100:00100000:1.0:1784290238.043449:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:64654:x1870961896194688:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1784290238.043465:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290238.043480:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031600/0x5953bbf6b3073138 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b21a0 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.043564:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031400/0x5953bbf6b307313f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.043576:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031400/0x5953bbf6b307313f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.043585:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031400/0x5953bbf6b307313f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290238.043639:0:74876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784290238.043643:0:74876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:1.0:1784290238.043665:0:74876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031400/0x5953bbf6b307313f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.043695:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031600/0x5953bbf6b3073138 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21a0 expref: 7 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.043721:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031400/0x5953bbf6b307313f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21a0 expref: 6 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.043731:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2449a35500) 00010000:00010000:1.0:1784290238.043735:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784290238.043739:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2440031400, rc 0) 00000100:00100000:1.0:1784290238.043800:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:64654:x1870961896194688:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 351us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290238.043806:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 954 00000100:00100000:3.0:1784290238.045950:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290238.045992:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896194816 00000100:00100000:0.0:1784290238.045998:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896194816 00000100:00100000:0.0:1784290238.046035:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 955 00000100:00100000:0.0:1784290238.046043:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:64654:x1870961896194816:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:0.0:1784290238.046076:0:65988:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444655104 avail 1298415616 00000100:00100000:0.0:1784290238.046117:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:64654:x1870961896194816:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 75us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290238.046124:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 955 00000100:00100000:3.0:1784290238.046955:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290238.046995:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896194944 00000100:00100000:0.0:1784290238.047002:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896194944 00000100:00100000:0.0:1784290238.047043:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 956 00000100:00100000:0.0:1784290238.047053:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:64654:x1870961896194944:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:0.0:1784290238.047077:0:66008:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:0.0:1784290238.047170:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:64654:x1870961896194944:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 117us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290238.047180:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 956 00000100:00100000:1.0:1784290238.048369:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290238.048422:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896195072 00000100:00100000:0.0:1784290238.048428:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896195072 00000100:00100000:0.0:1784290238.048461:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1094 00000100:00100000:0.0:1784290238.048470:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:64654:x1870961896195072:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:0.0:1784290238.048494:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290238.048533:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:64654:x1870961896195072:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 65us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290238.048539:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1094 00000100:00100000:0.0:1784290238.049441:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290238.049477:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896195200 00000100:00100000:1.0:1784290238.049490:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896195200 00000100:00100000:1.0:1784290238.049524:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1095 00000100:00100000:1.0:1784290238.049531:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:64654:x1870961896195200:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:1.0:1784290238.049543:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290238.049579:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:64654:x1870961896195200:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 49us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290238.049585:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1095 00000100:00100000:3.0:1784290238.069182:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290238.069228:0:65998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896195328 00000100:00100000:1.0:1784290238.069237:0:65998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896195328 00000100:00100000:1.0:1784290238.069288:0:65998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:1.0:1784290238.069298:0:65998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23446dec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:64661:x1870961896195328:12345-192.168.202.6@tcp:700:mcreate.0 00000100:00100000:1.0:1784290238.069412:0:65998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23446dec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:64661:x1870961896195328:12345-192.168.202.6@tcp:700:mcreate.0 Request processed in 116us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290238.069420:0:65998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:0.0:1784290238.070376:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290238.070428:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896195584 00000100:00100000:3.0:1784290238.070435:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896195584 00000100:00100000:3.0:1784290238.070473:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 957 00000100:00100000:3.0:1784290238.070483:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:64661:x1870961896195584:12345-192.168.202.6@tcp:36:mcreate.0 00010000:00010000:3.0:1784290238.070521:0:66004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290238.070545:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031400/0x5953bbf6b307313f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21a0 expref: 6 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.070572:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2449a35500) 00010000:00010000:3.0:1784290238.070583:0:66004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290238.070647:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073146 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.070664:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073146 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.070677:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073146 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.070694:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b307314d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.070704:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b307314d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.070714:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b307314d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.071063:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073146 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.071072:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073146 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.071078:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073146 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.071083:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073146 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.071087:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebfa00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290238.071090:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073146 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.071106:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073146 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.071115:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246d9d9300) 00010000:00010000:3.0:1784290238.071117:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290238.071120:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073146 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.071126:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073146 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290238.071140:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000014c3a75 reply state 000000001a7409e9 transno 94489280514 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b307314d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.071152:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b307314d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.071161:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c246d9d9200) 00010000:00010000:3.0:1784290238.071165:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290238.071168:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290238.071255:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:64661:x1870961896195584:12345-192.168.202.6@tcp:36:mcreate.0 Request processed in 772us (888us total) trans 94489280514 rc 0/0 00000100:00100000:3.0:1784290238.071266:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 957 00000100:00100000:1.0:1784290238.077118:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290238.077163:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896195712 00000100:00100000:2.0:1784290238.077169:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896195712 00000100:00100000:2.0:1784290238.077206:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 958 00000100:00100000:2.0:1784290238.077215:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:64664:x1870961896195712:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:2.0:1784290238.077240:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290238.077254:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073154 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b21a7 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290238.077294:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b307315b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290238.077303:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b307315b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290238.077311:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b307315b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784290238.077334:0:65989:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784290238.077337:0:65989:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1784290238.077378:0:65989:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b307315b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290238.077399:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3073154 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21a7 expref: 9 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290238.077413:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b307315b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21a7 expref: 8 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290238.077431:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c24688e7100) 00010000:00010000:2.0:1784290238.077434:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784290238.077436:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aa200, rc 0) 00000100:00100000:2.0:1784290238.077471:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:64664:x1870961896195712:12345-192.168.202.6@tcp:101:rm.0 Request processed in 258us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290238.077477:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 958 00000100:00100000:0.0:1784290238.078538:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290238.078586:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896195840 00000100:00100000:1.0:1784290238.078591:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896195840 00000100:00100000:1.0:1784290238.078624:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 959 00000100:00100000:1.0:1784290238.078633:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:64664:x1870961896195840:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:1.0:1784290238.078641:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290238.078651:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031600/0x5953bbf6b3073162 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b21ae expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078686:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031400/0x5953bbf6b3073169 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078709:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031400/0x5953bbf6b3073169 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078735:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031400/0x5953bbf6b3073169 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078771:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030c00/0x5953bbf6b3073170 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078780:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030c00/0x5953bbf6b3073170 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078786:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030c00/0x5953bbf6b3073170 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078834:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031e00/0x5953bbf6b3073177 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078840:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031e00/0x5953bbf6b3073177 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078846:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031e00/0x5953bbf6b3073177 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290238.078867:0:65990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x1:0x0]: returning size 0 00000004:00200000:1.0:1784290238.078869:0:65990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:1.0:1784290238.078880:0:65990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031e00/0x5953bbf6b3073177 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078887:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031e00/0x5953bbf6b3073177 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078893:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031400/0x5953bbf6b3073169 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078907:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031400/0x5953bbf6b3073169 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078913:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031400/0x5953bbf6b3073169 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078918:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2440031400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290238.078921:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031400/0x5953bbf6b3073169 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078926:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031400/0x5953bbf6b3073169 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078934:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c24688e7100) 00010000:00010000:1.0:1784290238.078936:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290238.078939:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031400/0x5953bbf6b3073169 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078943:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031400/0x5953bbf6b3073169 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078952:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030c00/0x5953bbf6b3073170 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078957:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030c00/0x5953bbf6b3073170 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078961:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030c00/0x5953bbf6b3073170 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078965:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2440030c00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290238.078972:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030c00/0x5953bbf6b3073170 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078977:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030c00/0x5953bbf6b3073170 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078982:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c246d9d9200) 00010000:00010000:1.0:1784290238.078984:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290238.078986:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030c00/0x5953bbf6b3073170 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.078990:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030c00/0x5953bbf6b3073170 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.079006:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031600/0x5953bbf6b3073162 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21ae expref: 10 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.079014:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031e00/0x5953bbf6b3073177 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21ae expref: 9 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.079019:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9c2449a35800) 00010000:00010000:1.0:1784290238.079021:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784290238.079023:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2440031e00, rc 0) 00000100:00100000:1.0:1784290238.079056:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:64664:x1870961896195840:12345-192.168.202.6@tcp:101:rm.0 Request processed in 425us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290238.079063:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 959 00000100:00100000:2.0:1784290238.080232:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290238.080265:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896196096 00000100:00100000:1.0:1784290238.080270:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896196096 00000100:00100000:1.0:1784290238.080298:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 960 00000100:00100000:1.0:1784290238.080303:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:64664:x1870961896196096:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:1.0:1784290238.080334:0:74876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784290238.080456:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031e00/0x5953bbf6b3073177 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21ae expref: 9 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080471:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9c2449a35800) 00010000:00010000:1.0:1784290238.080489:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b307315b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21a7 expref: 8 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080503:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c24688e7100) 00010000:00010000:1.0:1784290238.080513:0:74876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290238.080525:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030000/0x5953bbf6b307317e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080532:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030000/0x5953bbf6b307317e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080540:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030000/0x5953bbf6b307317e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080548:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030200/0x5953bbf6b3073185 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080554:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030200/0x5953bbf6b3073185 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080561:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030200/0x5953bbf6b3073185 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080596:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030400/0x5953bbf6b307318c lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080612:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030400/0x5953bbf6b307318c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080619:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030400/0x5953bbf6b307318c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080754:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031000/0x5953bbf6b3073193 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080780:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031000/0x5953bbf6b3073193 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080787:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031000/0x5953bbf6b3073193 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080793:0:74876:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031000/0x5953bbf6b3073193 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080810:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031000/0x5953bbf6b3073193 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080814:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031000/0x5953bbf6b3073193 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080832:0:74876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290238.080843:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030400/0x5953bbf6b307318c lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080848:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030400/0x5953bbf6b307318c lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080852:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030400/0x5953bbf6b307318c lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080863:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2440030400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290238.080867:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290238.080867:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030400/0x5953bbf6b307318c lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080877:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030400/0x5953bbf6b307318c lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.080880:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031000/0x5953bbf6b3073193 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080891:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9c2449a35400) 00010000:00010000:1.0:1784290238.080894:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784290238.080897:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030400/0x5953bbf6b307318c lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080902:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030400/0x5953bbf6b307318c lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080916:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030000/0x5953bbf6b307317e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080932:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030000/0x5953bbf6b307317e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.080938:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2440031000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290238.080941:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030000/0x5953bbf6b307317e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.080947:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031000/0x5953bbf6b3073193 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080948:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2440030000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290238.080953:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030000/0x5953bbf6b307317e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080961:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030000/0x5953bbf6b307317e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.080983:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031000/0x5953bbf6b3073193 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.080984:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2449a35700) 00010000:00010000:1.0:1784290238.080990:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290238.080994:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030000/0x5953bbf6b307317e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.081001:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030000/0x5953bbf6b307317e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.081005:0:7429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9c2449a35400) 00010000:00010000:3.0:1784290238.081010:0:7429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000004:00010000:1.0:1784290238.081012:0:74876:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004a2249fc reply state 000000001ec2d13d transno 94489280515 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030200/0x5953bbf6b3073185 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.081016:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031000/0x5953bbf6b3073193 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.081023:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030200/0x5953bbf6b3073185 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290238.081028:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031000/0x5953bbf6b3073193 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290238.081031:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c246d9d9200) 00010000:00010000:1.0:1784290238.081037:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784290238.081041:0:74876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784290238.081057:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290238.081062:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290238.081064:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290238.081085:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:64664:x1870961896196096:12345-192.168.202.6@tcp:36:rm.0 Request processed in 780us (852us total) trans 94489280515 rc 0/0 00000100:00100000:1.0:1784290238.081091:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 960 00000100:00100000:2.0:1784290238.119497:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784290238.119500:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784290238.119519:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901002240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290238.119520:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901002112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784290238.119592:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290238.119635:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901002112 00000100:00100000:0.0:1784290238.119636:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290238.119657:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901002112 00000100:00100000:3.0:1784290238.119729:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901002240 00000100:00100000:3.0:1784290238.119735:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901002240 00000100:00100000:0.0:1784290238.119743:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:0.0:1784290238.119774:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901002112:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784290238.119815:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00002000:00000024:0.0:1784290238.119827:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290238.119828:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901002240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784290238.119847:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290238.119885:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901002112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290238.119892:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:3.0:1784290238.119911:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901002240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290238.119921:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901002112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784290238.119922:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:1.0:1784290238.119955:0:3618:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968624 gen 2 00000004:00080000:1.0:1784290238.119964:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c2468792d80, transno 4294968624 00000100:00100000:1.0:1784290238.119991:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901002240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784290238.631685:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901002368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784290238.631834:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290238.631926:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901002368 00000100:00100000:0.0:1784290238.631939:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901002368 00000100:00100000:0.0:1784290238.632023:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3718 00000100:00100000:0.0:1784290238.632036:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1870961901002368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1784290238.632085:0:8412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444655104 avail 1298415616 00010000:00000080:0.0:1784290238.632113:0:8412:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2469c88000 x1870961901002368/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:259/0 lens 224/368 e 0 to 0 dl 1784290249 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290238.632207:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1870961901002368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 169us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290238.632249:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3718 00000100:00100000:1.0:1784290238.632309:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901002368:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1784290239.015474:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290240.040894:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784290240.515891:0:84143:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1784290240.546383:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290240.546461:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896196224 00000100:00100000:0.0:1784290240.546472:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896196224 00000100:00080000:2.0:1784290240.546531:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784290240.546557:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 961 00000100:00100000:0.0:1784290240.546570:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:64730:x1870961896196224:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1784290240.546595:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290240.546615:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9200/0x5953bbf6b307319a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b21b5 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290240.546676:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8600/0x5953bbf6b30731a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290240.546689:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8600/0x5953bbf6b30731a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290240.546700:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8600/0x5953bbf6b30731a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290240.546799:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784290240.546803:0:65988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1784290240.546822:0:65988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8600/0x5953bbf6b30731a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290240.546844:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9200/0x5953bbf6b307319a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21b5 expref: 11 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290240.546861:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8600/0x5953bbf6b30731a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21b5 expref: 10 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290240.546882:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c244405dd00) 00010000:00010000:0.0:1784290240.546886:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784290240.546889:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef8600, rc 0) 00010000:00000080:0.0:1784290240.546897:0:65988:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2468792d80 x1870961896196224/t0(0) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:261/0 lens 576/688 e 0 to 0 dl 1784290251 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290240.546956:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:64730:x1870961896196224:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 390us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290240.546965:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 961 00000100:00100000:2.0:1784290240.548796:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290240.548837:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896196352 00000100:00100000:3.0:1784290240.548844:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896196352 00000100:00100000:3.0:1784290240.548886:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 962 00000100:00100000:3.0:1784290240.548896:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:64730:x1870961896196352:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1784290240.548916:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290240.548929:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b30731a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b21bc expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.548967:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b30731af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.548977:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b30731af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.548985:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b30731af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.548997:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b30731b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.549004:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b30731b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.549009:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b30731b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.549050:0:66008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b30731af lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.549057:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b30731af lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.549062:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b30731af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.549067:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b30731af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.549081:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290240.549085:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b30731af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.549092:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b30731af lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.549102:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c244405dd00) 00010000:00010000:3.0:1784290240.549105:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290240.549108:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b30731af lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.549113:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b30731af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.549126:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b30731b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.549132:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b30731b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.549137:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b30731b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.549141:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290240.549144:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b30731b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.549148:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b30731b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.549186:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9c245a793e00) 00010000:00010000:3.0:1784290240.549190:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290240.549193:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b30731b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.549201:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b30731b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.549233:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b30731a8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21bc expref: 11 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.549247:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c244405dd00) 00010000:00010000:3.0:1784290240.549250:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290240.549255:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b30731a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21bc expref: 11 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.549265:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebfa00, rc 0) 00010000:00000080:3.0:1784290240.549273:0:66008:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2468792a00 x1870961896196352/t0(0) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:261/0 lens 592/584 e 0 to 0 dl 1784290251 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290240.549328:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:64730:x1870961896196352:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 432us (531us total) trans 0 rc 301/301 00000100:00100000:3.0:1784290240.549336:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 962 00000100:00100000:2.0:1784290240.551454:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290240.551497:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896196608 00000100:00100000:3.0:1784290240.551503:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896196608 00000100:00100000:3.0:1784290240.551547:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 963 00000100:00100000:3.0:1784290240.551558:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:64730:x1870961896196608:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1784290240.551566:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290240.551575:0:66004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784290240.551588:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8600/0x5953bbf6b30731a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21b5 expref: 10 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.551606:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c244405dd00) 00010000:00010000:3.0:1784290240.551614:0:66004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290240.551623:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b30731bd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b21c3 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.551674:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b30731c4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.551682:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b30731c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.551689:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b30731c4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.551700:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe000/0x5953bbf6b30731cb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.551706:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe000/0x5953bbf6b30731cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.551712:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe000/0x5953bbf6b30731cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.552113:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30731d2 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.552124:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30731d2 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.552146:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30731d2 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290240.552156:0:66004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00010000:00010000:3.0:1784290240.552191:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b30731c4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.552200:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b30731c4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.552206:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b30731c4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.552212:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b30731c4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.552218:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebe800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290240.552221:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b30731c4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.552227:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b30731c4 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.552235:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c245a793800) 00010000:00010000:3.0:1784290240.552237:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290240.552241:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b30731c4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.552247:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b30731c4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290240.552263:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a4ee14c2 reply state 00000000c08540f9 transno 94489280516 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe000/0x5953bbf6b30731cb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.552283:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe000/0x5953bbf6b30731cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.552291:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9c245a793600) 00010000:00010000:3.0:1784290240.552294:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290240.552298:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784290240.552324:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b30731bd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21c3 expref: 12 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.552341:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30731d2 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21c3 expref: 11 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.552352:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff9c245a793400) 00010000:00010000:3.0:1784290240.552419:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784290240.552423:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebee00, rc 0) 00010000:00000080:3.0:1784290240.552432:0:66004:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c234434f800 x1870961896196608/t94489280516(0) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:261/0 lens 536/608 e 0 to 0 dl 1784290251 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290240.552487:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:64730:x1870961896196608:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 930us (1034us total) trans 94489280516 rc 0/0 00000100:00100000:3.0:1784290240.552498:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 963 00000100:00100000:2.0:1784290240.554590:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290240.554625:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896196864 00000100:00100000:3.0:1784290240.554630:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896196864 00000100:00100000:3.0:1784290240.554668:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 964 00000100:00100000:3.0:1784290240.554677:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:64730:x1870961896196864:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1784290240.554689:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290240.554701:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe200/0x5953bbf6b30731e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b21ca expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.554779:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b30731e7 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.554789:0:65989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30731d2 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21c3 expref: 13 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.554796:0:65989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b30731e7 lrc: 4/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.554826:0:65989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30731d2 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21c3 expref: 13 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.554838:0:65989:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30731d2 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21c3 expref: 13 pid: 66004 timeout: 2081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290240.554851:0:65989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f977800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:65989:1870961901002496:192.168.202.6@tcp:104: 00000100:00100000:3.0:1784290240.554924:0:65989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2482055b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784290240.555881:0:65989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f977800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:65989:1870961901002496:192.168.202.6@tcp:104: 00010000:00010000:3.0:1784290240.555910:0:65989:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b30731e7 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290240.556458:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290240.556509:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896196992 00000100:00100000:3.0:1784290240.556516:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896196992 00010000:00010000:3.0:1784290240.556606:0:19591:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30731d2 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21c3 expref: 14 pid: 66004 timeout: 2081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290240.556637:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2573 00000100:00100000:3.0:1784290240.556656:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245818f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+14:2400:x1870961896196992:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784290240.556666:0:19591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290240.556672:0:19591:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30731d2 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21c3 expref: 14 pid: 66004 timeout: 2081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.556682:0:19591:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30731d2 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21c3 expref: 14 pid: 66004 timeout: 2081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.556712:0:19591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30731d2 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21c3 expref: 14 pid: 66004 timeout: 2081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.556724:0:19591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff9c245a793400) 00010000:00010000:3.0:1784290240.556728:0:19591:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b30731e7 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.556751:0:19591:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b30731e7 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.556758:0:19591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b30731e7 lrc: 4/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290240.556794:0:19591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290240.556807:0:65989:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b30731e7 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290240.556817:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b30731e7 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290240.556828:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245818f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:2400:x1870961896196992:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 176us (371us total) trans 0 rc 0/0 00000004:00200000:2.0:1784290240.556829:0:65989:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00000100:00100000:3.0:1784290240.556840:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2573 00010000:00010000:2.0:1784290240.556967:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b30731e7 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290240.556985:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b30731e7 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290240.556991:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b30731e7 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290240.556995:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebec00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290240.556998:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b30731e7 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290240.557003:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b30731e7 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290240.557012:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff9c245a793400) 00010000:00010000:2.0:1784290240.557015:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784290240.557017:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b30731e7 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290240.557022:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b30731e7 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290240.557057:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe200/0x5953bbf6b30731e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21ca expref: 13 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290240.557065:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c245a793500) 00010000:00010000:2.0:1784290240.557068:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784290240.557072:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe200/0x5953bbf6b30731e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21ca expref: 13 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290240.557082:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebe200, rc 0) 00010000:00000080:2.0:1784290240.557093:0:65989:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c234434e680 x1870961896196864/t94489280517(0) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:261/0 lens 712/824 e 0 to 0 dl 1784290251 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290240.557135:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:64730:x1870961896196864:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 2459us (2546us total) trans 94489280517 rc 301/301 00000100:00100000:2.0:1784290240.557145:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 964 00000100:00100000:2.0:1784290240.558823:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290240.558868:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896197248 00000100:00100000:3.0:1784290240.558873:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896197248 00000100:00100000:3.0:1784290240.558906:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 209 00000100:00100000:3.0:1784290240.558914:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:64730:x1870961896197248:12345-192.168.202.6@tcp:35:lfs.0 00010000:00000080:3.0:1784290240.559028:0:65991:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c234434dc00 x1870961896197248/t94489280518(0) o35->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:261/0 lens 392/456 e 0 to 0 dl 1784290251 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290240.559067:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:64730:x1870961896197248:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 155us (246us total) trans 94489280518 rc 0/0 00000100:00100000:3.0:1784290240.559074:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 209 00000100:00100000:0.0:1784290240.560431:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290240.560470:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896197504 00000100:00100000:3.0:1784290240.560476:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896197504 00000100:00100000:3.0:1784290240.560514:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 210 00000100:00100000:3.0:1784290240.560522:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:64730:x1870961896197504:12345-192.168.202.6@tcp:35:lfs.0 00010000:00000080:3.0:1784290240.560605:0:65992:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2447b95f80 x1870961896197504/t94489280519(0) o35->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:261/0 lens 392/456 e 0 to 0 dl 1784290251 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290240.560647:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+14:64730:x1870961896197504:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 127us (219us total) trans 94489280519 rc 0/0 00000100:00100000:3.0:1784290240.560653:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 210 00000100:00100000:2.0:1784290240.679532:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901002624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784290240.679615:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290240.679677:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901002624 00000100:00100000:0.0:1784290240.679689:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901002624 00000100:00100000:0.0:1784290240.679797:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3719 00000100:00100000:0.0:1784290240.679814:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901002624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784290240.679869:0:22091:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:0.0:1784290240.679950:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901002624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290240.679958:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3719 00000100:00100000:2.0:1784290240.680036:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901002624:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784290241.063480:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784290241.348688:0:84240:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1784290241.348800:0:84240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450abe00/0x5953bbf6b3072df0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3072df7 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.348820:0:84240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450abe00/0x5953bbf6b3072df0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3072df7 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.348832:0:84240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450abe00/0x5953bbf6b3072df0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3072df7 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.348842:0:84240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c23450abe00/0x5953bbf6b3072df0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3072df7 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.348899:0:84240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784290241.348907:0:84240:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1784290241.348958:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1784290241.348964:0:84240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784290241.348973:0:84240:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1784290241.348976:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c23450abe00/0x5953bbf6b3072df0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3072df7 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784290241.348981:0:84240:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1784290241.348999:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450abe00 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:2.0:1784290241.349007:0:19681:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c23450abe00/0x5953bbf6b3072df0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3072df7 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290241.349021:0:19681:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450abe00/0x5953bbf6b3072df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3072df7 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784290241.349025:0:84240:0:(import.c:65:import_set_state_nolock()) ffff9c246d8a9800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:00010000:2.0:1784290241.349042:0:19681:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450abe00/0x5953bbf6b3072df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3072df7 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290241.349052:0:19681:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784290241.349056:0:19681:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784290241.349060:0:19681:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1784290241.349104:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901002752:0@lo:39:umount.0 00010000:00010000:2.0:1784290241.349113:0:19681:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c23450abe00/0x5953bbf6b3072df0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3072df7 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290241.349137:0:19681:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784290241.349186:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c23450abe00/0x5953bbf6b3072df0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3072df7 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290241.349199:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450abe00/0x5953bbf6b3072df0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3072df7 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290241.349202:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290241.349222:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901002880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290241.349231:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290241.349240:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290241.349246:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290241.349301:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290241.349310:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901002752 00000100:00100000:2.0:1784290241.349322:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901002752 00000100:00100000:1.0:1784290241.349437:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901002880 00000100:00100000:1.0:1784290241.349448:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901002880 00000100:00100000:2.0:1784290241.349477:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:2.0:1784290241.349501:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1870961901002752:12345-0@lo:39:umount.0 00000020:00000080:2.0:1784290241.349539:0:65990:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072f0f 00000100:00100000:1.0:1784290241.349548:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00080000:2.0:1784290241.349559:0:65990:0:(import.c:65:import_set_state_nolock()) ffff9c2344b55800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784290241.349569:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f977800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3620:x1870961901002880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290241.349591:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00000080:2.0:1784290241.349614:0:65990:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c246d5a3b80 x1870961901002752/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:262/0 lens 224/224 e 0 to 0 dl 1784290252 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1784290241.349619:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd2ae00/0x5953bbf6b3072df7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3072df0 expref: 24 pid: 83014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290241.349663:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784290241.349780:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f977800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3620:x1870961901002880:12345-0@lo:103:ldlm_bl.0 Request processed in 217us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290241.349796:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:2.0:1784290241.349806:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3616:x1870961901002752:12345-0@lo:39:umount.0 Request processed in 309us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290241.349822:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:3.0:1784290241.349833:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901002880:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1784290241.349842:0:65990:0:(genops.c:906:class_export_put()) final put ffff9c2344b52800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1784290241.349901:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784290241.349901:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2344b52800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1784290241.349947:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246d8a9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784290241.349969:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901002752:0@lo:39:umount.0 00000020:00000080:2.0:1784290241.350006:0:9947:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2344b55800 for lustre-MDT0000 00000100:00080000:3.0:1784290241.350009:0:84240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784290241.350017:0:84240:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784290241.350024:0:84240:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1784290241.351554:0:84240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247b308000/0x5953bbf6b3072d10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3072d17 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.351568:0:84240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247b308000/0x5953bbf6b3072d10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3072d17 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.351576:0:84240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247b308000/0x5953bbf6b3072d10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3072d17 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.351584:0:84240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c247b308000/0x5953bbf6b3072d10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3072d17 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.351634:0:84240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290241.351648:0:84240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c248216c200/0x5953bbf6b3072e13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3072e1a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290241.351648:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290241.351663:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247b308000/0x5953bbf6b3072d10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3072d17 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.351666:0:84240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c248216c200/0x5953bbf6b3072e13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3072e1a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290241.351701:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247b308000 already unused, calling callback (ffffffffc14a9c20) 00010000:00010000:3.0:1784290241.351703:0:84240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c248216c200/0x5953bbf6b3072e13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3072e1a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290241.351713:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247b308000/0x5953bbf6b3072d10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3072d17 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.351720:0:84240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c248216c200/0x5953bbf6b3072e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3072e1a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290241.351761:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247b308000/0x5953bbf6b3072d10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3072d17 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.351766:0:84240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:00010000:1.0:1784290241.351783:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247b308000/0x5953bbf6b3072d10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3072d17 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.351785:0:84240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247b309e00/0x5953bbf6b3072de2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3072de9 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290241.351808:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1784290241.351816:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784290241.351824:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c248216c200/0x5953bbf6b3072e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3072e1a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290241.351827:0:6476:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1784290241.351828:0:84240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247b309e00/0x5953bbf6b3072de2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3072de9 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290241.351860:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247b308000/0x5953bbf6b3072d10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3072d17 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.351862:0:84240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247b309e00/0x5953bbf6b3072de2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3072de9 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.351906:0:84240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c247b309e00/0x5953bbf6b3072de2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3072de9 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290241.351911:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784290241.351912:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c248216c200 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:2.0:1784290241.351925:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c248216c200/0x5953bbf6b3072e13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3072e1a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290241.351939:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c248216c200/0x5953bbf6b3072e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3072e1a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.351944:0:84240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:00010000:2.0:1784290241.351951:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c248216c200/0x5953bbf6b3072e13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3072e1a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290241.351956:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247b308000/0x5953bbf6b3072d10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3072d17 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.351957:0:84240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247b309600/0x5953bbf6b3072d02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3072d09 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290241.351977:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1784290241.351990:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1784290241.352001:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1784290241.352001:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247b308000/0x5953bbf6b3072d10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3072d17 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.352007:0:84240:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247b309600/0x5953bbf6b3072d02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3072d09 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290241.352039:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c248216c200/0x5953bbf6b3072e13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3072e1a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.352044:0:84240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247b309600/0x5953bbf6b3072d02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3072d09 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290241.352049:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290241.352062:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247b309e00/0x5953bbf6b3072de2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3072de9 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290241.352068:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784290241.352085:0:84240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c247b309600/0x5953bbf6b3072d02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3072d09 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290241.352090:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247b309e00 already unused, calling callback (ffffffffc14a9c20) 00010000:00010000:2.0:1784290241.352092:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c248216c200/0x5953bbf6b3072e13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3072e1a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290241.352102:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247b309e00/0x5953bbf6b3072de2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3072de9 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.352119:0:84240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784290241.352137:0:84240:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1784290241.352137:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c248216c200/0x5953bbf6b3072e13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3072e1a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290241.352141:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247b309e00/0x5953bbf6b3072de2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3072de9 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290241.352149:0:84240:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:00010000:1.0:1784290241.352178:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247b309e00/0x5953bbf6b3072de2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3072de9 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290241.352186:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784290241.352188:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1784290241.352192:0:6476:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1784290241.352197:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247b309600/0x5953bbf6b3072d02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3072d09 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784290241.352199:0:84240:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 10000000:01000000:1.0:1784290241.352200:0:6476:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:01000000:3.0:1784290241.352211:0:84240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00010000:00010000:2.0:1784290241.352219:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247b309600 already unused, calling callback (ffffffffc14a9c20) 00000020:00000080:3.0:1784290241.352221:0:84240:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 10000000:00010000:2.0:1784290241.352228:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247b309600/0x5953bbf6b3072d02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3072d09 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000400:3.0:1784290241.352233:0:84240:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1784290241.352240:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247b309e00/0x5953bbf6b3072de2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3072de9 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290241.352277:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784290241.352285:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247b309600/0x5953bbf6b3072d02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3072d09 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290241.352298:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247b309600/0x5953bbf6b3072d02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3072d09 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290241.352306:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1784290241.352311:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1784290241.352311:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247b309e00/0x5953bbf6b3072de2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3072de9 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290241.352321:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1784290241.352427:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247b309600/0x5953bbf6b3072d02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3072d09 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290241.352438:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784290241.352456:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247b309600/0x5953bbf6b3072d02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3072d09 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290241.352465:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247b309600/0x5953bbf6b3072d02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3072d09 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290241.352489:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290241.352494:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290241.352501:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290241.352518:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290241.352534:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901003264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290241.352596:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784290241.352679:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247b309e00/0x5953bbf6b3072de2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3072de9 expref: -99 pid: 83006 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290241.352690:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1784290241.352707:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290241.352709:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901003392:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290241.352716:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290241.352725:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290241.352770:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901003008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290241.352786:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290241.352855:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290241.352898:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901003264 00000100:00100000:2.0:1784290241.352907:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901003264 00000100:00100000:1.0:1784290241.352922:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784290241.352940:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901003136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290241.352980:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901003392 00000100:00100000:2.0:1784290241.352991:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901003392 00000100:00100000:1.0:1784290241.352992:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290241.353048:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901003008 00000100:00100000:2.0:1784290241.353055:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901003008 00000100:00100000:1.0:1784290241.353078:0:10356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901003136 00000100:00100000:1.0:1784290241.353088:0:10356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901003136 00000100:00100000:2.0:1784290241.353117:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:2.0:1784290241.353138:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+26:3619:x1870961901003264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290241.353154:0:19592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784290241.353162:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00010000:00010000:2.0:1784290241.353180:0:19592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c23450aa400/0x5953bbf6b3072de9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3072de2 expref: 26 pid: 83016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290241.353183:0:10356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2e54cd1c-9dbd-4e31-b60e-998135d46053+26:3619:x1870961901003392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290241.353212:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290241.353215:0:19592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290241.353241:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd2a000/0x5953bbf6b3072d09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3072d02 expref: 25 pid: 83012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290241.353261:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784290241.353288:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3619:x1870961901003264:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290241.353305:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:1.0:1784290241.353336:0:10356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3619:x1870961901003392:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290241.353378:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:2.0:1784290241.353398:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3617:x1870961901003008:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290241.353407:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00010000:00010000:2.0:1784290241.353414:0:19592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290241.353439:0:19592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd2ac00/0x5953bbf6b3072d17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3072d10 expref: 22 pid: 83013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290241.353452:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00010000:00010000:2.0:1784290241.353457:0:19592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784290241.353474:0:10356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:3617:x1870961901003136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290241.353491:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290241.353529:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c23450aac00/0x5953bbf6b3072e1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3072e13 expref: 21 pid: 83012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290241.353530:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c8a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:3617:x1870961901003008:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290241.353563:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00010000:00010000:1.0:1784290241.353569:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784290241.353643:0:10356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:3617:x1870961901003136:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290241.353654:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:2.0:1784290241.353948:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901003136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290241.353960:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901003008:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290241.354003:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290241.354021:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901003392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290241.354035:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901003264:0@lo:103:ldlm_bl.0 00000004:00000080:3.0:1784290241.354613:0:84240:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:3.0:1784290241.355678:0:83007:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280519 is committed 00010000:00010000:1.0:1784290241.355750:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b307314d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290241.355768:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b307314d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290241.355778:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b307314d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290241.355786:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290241.355792:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b307314d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290241.355802:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b307314d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290241.355826:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c246d9d9200) 00000020:00000080:3.0:1784290241.355830:0:84240:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00010000:00010000:1.0:1784290241.355832:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290241.355843:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b307314d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290241.355849:0:84240:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c24481c6800 bd808cf4-dd54-45f0-9b2b-1434e8330e5d 192.168.202.6@tcp 7 (0 0 0) 0 0 0 2: ffff9c24688dd000 94489280519 stale:0 00010000:00010000:1.0:1784290241.355865:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b307314d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290241.355871:0:84240:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c247f8f0800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784290241.355899:0:84240:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2344b51000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784290241.355911:0:84240:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2343905800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1784290241.355920:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030200/0x5953bbf6b3073185 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290241.355921:0:84240:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2343837800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784290241.355930:0:84240:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9c23440d4d40) has exports, disconnecting them 00000020:00080000:3.0:1784290241.355944:0:84240:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.6@tcp (ffff9c24481c6800), last request at 1784290240 00010000:00010000:1.0:1784290241.355950:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030200/0x5953bbf6b3073185 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290241.355965:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030200/0x5953bbf6b3073185 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784290241.355970:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30730dd 00010000:00010000:1.0:1784290241.355976:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2440030200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290241.355985:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030200/0x5953bbf6b3073185 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784290241.355991:0:84240:0:(import.c:65:import_set_state_nolock()) ffff9c24481c7800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1784290241.355995:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030200/0x5953bbf6b3073185 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290241.356015:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c246d9d9200) 00010000:00010000:1.0:1784290241.356020:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290241.356025:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030200/0x5953bbf6b3073185 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.356032:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290241.356033:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440030200/0x5953bbf6b3073185 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290241.356054:0:84240:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.6@tcp (ffff9c24481c6800): rc 0 00000020:00080000:3.0:1784290241.356065:0:84240:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c247f8f0800), last request at 1784290046 00000020:00000080:3.0:1784290241.356075:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072f08 00000100:00080000:3.0:1784290241.356081:0:84240:0:(import.c:65:import_set_state_nolock()) ffff9c247f8f6000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1784290241.356086:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe000/0x5953bbf6b30731cb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290241.356098:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe000/0x5953bbf6b30731cb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290241.356109:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe000/0x5953bbf6b30731cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290241.356111:0:84240:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c247f8f0800): rc 0 00010000:00010000:2.0:1784290241.356118:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784290241.356123:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c247f8f0800/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:1.0:1784290241.356135:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebe000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290241.356154:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe000/0x5953bbf6b30731cb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290241.356155:0:84240:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2344b51000), last request at 1784290237 00000020:00000080:3.0:1784290241.356168:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072f01 00010000:00010000:1.0:1784290241.356177:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe000/0x5953bbf6b30731cb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784290241.356178:0:84240:0:(import.c:65:import_set_state_nolock()) ffff9c2344b50800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1784290241.356200:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247f8f0800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1784290241.356206:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9c245a793600) 00000020:00080000:3.0:1784290241.356216:0:84240:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2344b51000): rc 0 00010000:00010000:1.0:1784290241.356217:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290241.356219:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290241.356228:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe000/0x5953bbf6b30731cb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784290241.356229:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c2344b51000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:1.0:1784290241.356246:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe000/0x5953bbf6b30731cb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290241.356263:0:84240:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2343905800), last request at 1784290237 00000020:00000080:3.0:1784290241.356273:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072efa 00000020:00000080:1.0:1784290241.356294:0:3603:0:(genops.c:906:class_export_put()) final put ffff9c24481c6800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000100:00080000:3.0:1784290241.356305:0:84240:0:(import.c:65:import_set_state_nolock()) ffff9c2343901800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1784290241.356308:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c247f8f6000 for lustre-MDT0000 00000020:00000080:0.0:1784290241.356326:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2344b51000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:1.0:1784290241.356408:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784290241.356449:0:84240:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2343905800): rc 0 00000020:00000080:3.0:1784290241.356454:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c2343905800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1784290241.356481:0:84240:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2343837800), last request at 1784290040 00000020:00000080:0.0:1784290241.356482:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c24481c6800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d for lustre-MDT0000 00000020:00000080:3.0:1784290241.356492:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072d64 00000100:00080000:3.0:1784290241.356509:0:84240:0:(import.c:65:import_set_state_nolock()) ffff9c2345895800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784290241.356538:0:84240:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2343837800): rc 0 00000020:00000080:3.0:1784290241.356543:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c2343837800/lustre-MDT0001-mdtlov_UUID 00010000:00010000:2.0:1784290241.356548:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:3.0:1784290241.356563:0:84240:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae5440d7fae0 00000020:00000080:0.0:1784290241.356579:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2344b50800 for lustre-MDT0000 00000100:00080000:3.0:1784290241.356590:0:84240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784290241.356599:0:84240:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378738 gen 3 00000020:00000080:0.0:1784290241.356607:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343905800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1784290241.356673:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c24481c7800 for lustre-MDT0000 00000020:00000080:0.0:1784290241.356685:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343837800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1784290241.356779:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2343901800 for lustre-MDT0000 00000020:00000080:0.0:1784290241.356791:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2345895800 for lustre-MDT0000 00000100:00080000:3.0:1784290241.357990:0:84240:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1784290241.358020:0:84240:0:(import.c:65:import_set_state_nolock()) ffff9c2474cc5800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784290241.358163:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901003520:0@lo:39:umount.0 00000100:00100000:0.0:1784290241.358240:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784290241.358257:0:84240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784290241.358264:0:84240:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968624 gen 3 00000004:00080000:3.0:1784290241.358294:0:84240:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784290241.358320:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901003520 00000100:00100000:1.0:1784290241.358331:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901003520 00000100:00100000:1.0:1784290241.358443:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3720 00000100:00100000:1.0:1784290241.358460:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3616:x1870961901003520:12345-0@lo:39:umount.0 00000100:00080000:3.0:1784290241.358471:0:84240:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:00000080:1.0:1784290241.358489:0:23867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072da3 00000100:00080000:3.0:1784290241.358499:0:84240:0:(import.c:65:import_set_state_nolock()) ffff9c247e400000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1784290241.358505:0:23867:0:(import.c:65:import_set_state_nolock()) ffff9c2474ee3000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1784290241.358529:0:84240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784290241.358535:0:84240:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968624 gen 3 00000001:00000004:1.0:1784290241.358539:0:23867:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378738 00000004:00080000:3.0:1784290241.358557:0:84240:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784290241.358587:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901003648:0@lo:9:umount.0 00000100:00100000:0.0:1784290241.358654:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784290241.358676:0:84240:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1784290241.358701:0:84240:0:(import.c:65:import_set_state_nolock()) ffff9c2345638000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784290241.358760:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901003648 00000100:00100000:0.0:1784290241.358774:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901003648 00000100:00100000:1.0:1784290241.358813:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3616:x1870961901003520:12345-0@lo:39:umount.0 Request processed in 355us (573us total) trans 81604378739 rc 0/0 00000100:00100000:1.0:1784290241.358827:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3720 00000100:00080000:2.0:1784290241.358837:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784290241.358880:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784290241.358882:0:84240:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c23440d4d40) has no exports 00000100:00100000:0.0:1784290241.358905:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4897 00000100:00100000:0.0:1784290241.358925:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3616:x1870961901003648:12345-0@lo:9:umount.0 00000020:00000080:0.0:1784290241.358953:0:26258:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072dbf 00000100:00080000:0.0:1784290241.358966:0:26258:0:(import.c:65:import_set_state_nolock()) ffff9c246dcf9000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1784290241.359038:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1784290241.359046:0:26258:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968624 00000100:00100000:0.0:1784290241.359275:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+2:3616:x1870961901003648:12345-0@lo:9:umount.0 Request processed in 357us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290241.359288:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4897 00000100:00100000:0.0:1784290241.359438:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901003776:0@lo:9:umount.0 00000020:00080000:2.0:1784290241.359462:0:84240:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c23440d4d40) has no exports 00000100:00100000:0.0:1784290241.359495:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290241.359563:0:26251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901003776 00000100:00080000:0.0:1784290241.359565:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c247e400000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784290241.359576:0:26251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901003776 00000004:00080000:0.0:1784290241.359593:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784290241.359602:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784290241.359609:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901003648:0@lo:9:umount.0 00000100:00080000:0.0:1784290241.359648:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2474cc5800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784290241.359658:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901003520:0@lo:39:umount.0 00000100:00100000:1.0:1784290241.359669:0:26251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4898 00000100:00100000:1.0:1784290241.359703:0:26251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3616:x1870961901003776:12345-0@lo:9:umount.0 00000020:00000080:1.0:1784290241.359749:0:26251:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072dcd 00000100:00080000:1.0:1784290241.359765:0:26251:0:(import.c:65:import_set_state_nolock()) ffff9c246dcfe000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784290241.359819:0:26251:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968624 00000100:00080000:0.0:1784290241.359872:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784290241.359902:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290241.360029:0:26251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+2:3616:x1870961901003776:12345-0@lo:9:umount.0 Request processed in 330us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290241.360044:0:26251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4898 00000100:00080000:0.0:1784290241.360096:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2345638000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784290241.360121:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784290241.360126:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784290241.360133:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901003776:0@lo:9:umount.0 00000020:00000080:2.0:1784290241.399212:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072d79 00000020:00000080:2.0:1784290241.399228:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c247036b800/lustre-QMT0000_UUID 00000020:01000000:2.0:1784290241.399246:0:84240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1784290241.399319:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247036b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1784290241.399403:0:84240:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784290241.399419:0:84240:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784290241.399424:0:84240:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9c23440d0000) has no exports 00000020:00000080:3.0:1784290241.399645:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072d72 00000020:00000080:3.0:1784290241.399654:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c247036c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784290241.399749:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247036c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784290241.399759:0:84240:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784290241.399772:0:84240:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1784290241.399776:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c2458115000/lustre-QMT0000_UUID 00000020:00000080:3.0:1784290241.399780:0:84240:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458115000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1784290241.399793:0:84240:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1784290241.399934:0:84240:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2468879120 - data ffff9c247091f0d8/ffff9c247e44c000 00000020:01000000:3.0:1784290241.400115:0:84240:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c247f9acde0 - data ffff9c247572ed80/ffff9c2474512c00 00000100:00080000:1.0:1784290241.439957:0:84240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784290241.439966:0:84240:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378738 gen 4 00000100:00100000:1.0:1784290241.439984:0:84240:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c247f976d80 x1870961901003520/t81604378739(81604378739) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290251 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290241.440015:0:84240:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1784290241.441674:0:84240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784290241.441681:0:84240:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968624 gen 4 00000004:00080000:1.0:1784290241.441703:0:84240:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784290241.441707:0:84240:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784290241.442016:0:83024:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784290241.442024:0:83024:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x58:0x0] index 1 count 1 00000040:00080000:3.0:1784290241.442041:0:83024:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 22 count 2 00000100:00080000:1.0:1784290241.442893:0:84240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784290241.442897:0:84240:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968624 gen 4 00000004:00080000:1.0:1784290241.442914:0:84240:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784290241.442916:0:84240:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784290241.443116:0:83026:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784290241.443129:0:83026:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5a:0x0] index 2 count 1 00000040:00080000:3.0:1784290241.443140:0:83026:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 22 count 2 00000020:00000080:1.0:1784290241.444020:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072d2c 00000020:00000080:1.0:1784290241.444030:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c2474cc6000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784290241.444064:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2474cc6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784290241.445425:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072d48 00000020:00000080:1.0:1784290241.445434:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c2343830800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784290241.445454:0:84240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1784290241.445462:0:84240:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784290241.445473:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343830800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1784290241.445476:0:84240:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784290241.445486:0:84240:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9c23440d3380) has no exports 00000004:01000000:1.0:1784290241.445806:0:84240:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1784290241.445818:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072dc6 00000020:00000080:1.0:1784290241.445832:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c247e4b2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784290241.445846:0:84240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1784290241.445850:0:84240:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784290241.445860:0:84240:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:0.0:1784290241.445865:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247e4b2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00080000:1.0:1784290241.445866:0:84240:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9c246ff6cd40) has no exports 00000020:00000080:1.0:1784290241.445876:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072db8 00000020:00000080:1.0:1784290241.445886:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c2345639000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784290241.445906:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2345639000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1784290241.446439:0:84240:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1784290241.446445:0:84240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784290241.446448:0:84240:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968624 gen 5 00000004:00080000:1.0:1784290241.446454:0:84240:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784290241.446457:0:84240:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784290241.446497:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2345638000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784290241.446530:0:84240:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290241.446543:0:84240:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784290241.446548:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c2342ef6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784290241.446553:0:84240:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2342ef6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1784290241.446562:0:84240:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784290241.446653:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072daa 00000020:00000080:1.0:1784290241.446660:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c2342ef3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784290241.446679:0:84240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1784290241.446685:0:84240:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784290241.446695:0:84240:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:0.0:1784290241.446696:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2342ef3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00080000:1.0:1784290241.446702:0:84240:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9c246ff13380) has no exports 00000020:00000080:1.0:1784290241.446711:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072d9c 00000020:00000080:1.0:1784290241.446719:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c247e403000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784290241.446761:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247e403000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1784290241.447506:0:84240:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1784290241.447511:0:84240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784290241.447515:0:84240:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968624 gen 5 00000004:00080000:1.0:1784290241.447520:0:84240:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784290241.447523:0:84240:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784290241.447561:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c247e400000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784290241.447597:0:84240:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290241.447621:0:84240:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784290241.447627:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c2458841800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784290241.447631:0:84240:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458841800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1784290241.447647:0:84240:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1784290241.447721:0:84240:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1784290241.447750:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072d8e 00000020:00000080:1.0:1784290241.447756:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c2458843000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784290241.447773:0:84240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1784290241.447778:0:84240:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784290241.447787:0:84240:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784290241.447792:0:84240:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9c246ff14d40) has no exports 00000020:00000080:1.0:1784290241.447798:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072d87 00000020:00000080:0.0:1784290241.447803:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458843000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1784290241.447804:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c2474cc5000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784290241.447835:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2474cc5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1784290241.451942:0:84240:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1784290241.451954:0:84240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784290241.451958:0:84240:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378738 gen 5 00000100:00100000:1.0:1784290241.451966:0:84240:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784290241.452011:0:9947:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2474cc5800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1784290241.452036:0:84240:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290241.452051:0:84240:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784290241.452057:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c247e4b0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784290241.452061:0:84240:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247e4b0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1784290241.452070:0:84240:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784290241.452224:0:84240:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290241.452228:0:84240:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784290241.452231:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c2345f44000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784290241.452233:0:84240:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2345f44000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1784290241.452236:0:84240:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784290241.452318:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072d4f 00000020:00000080:1.0:1784290241.452324:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c2343834000/lustre-MDD0000_UUID 00000020:01000000:1.0:1784290241.452336:0:84240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1784290241.452380:0:84240:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784290241.452388:0:84240:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784290241.452394:0:84240:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9c23440d19c0) has no exports 00000020:00000080:3.0:1784290241.452396:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343834000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1784290241.452426:0:84240:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290241.452433:0:84240:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1784290241.452436:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c2343830000/lustre-MDD0000_UUID 00000020:00000080:1.0:1784290241.452439:0:84240:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343830000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1784290241.452444:0:84240:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1784290241.452478:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072d56 00000020:00000080:1.0:1784290241.452483:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c2343835800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1784290241.452496:0:84240:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c23458dc800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1784290241.452500:0:84240:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c23458dc800 3 00000020:01000004:1.0:1784290241.452505:0:84240:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c23458dc800 from lustre-MDT0000 00000020:00000080:3.0:1784290241.452513:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343835800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784290241.452547:0:84240:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290241.452553:0:84240:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1784290241.452556:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c2474cc4800/lustre-MDT0000_UUID 00000020:00000080:1.0:1784290241.452559:0:84240:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2474cc4800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1784290241.452567:0:84240:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1784290241.452602:0:84240:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1784290241.452605:0:84240:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1784290241.452609:0:84240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1784290241.452613:0:84240:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784290241.452618:0:84240:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1784290241.452627:0:84240:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c247f8f7000 bdffa268-fb6a-4248-991c-0ad16fac303f 192.168.202.6@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784290241.452633:0:84240:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c247e4b6800 2e54cd1c-9dbd-4e31-b60e-998135d46053 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784290241.452639:0:84240:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff9c246ff10000) has exports, disconnecting them 00000020:00080000:1.0:1784290241.452644:0:84240:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.6@tcp (ffff9c247f8f7000), last request at 1784290043 00000020:00000080:1.0:1784290241.452666:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072ed7 00000020:00010000:1.0:1784290241.452671:0:84240:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c247f8f7000: total 0 00000100:00080000:1.0:1784290241.452677:0:84240:0:(import.c:65:import_set_state_nolock()) ffff9c247f8f5800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784290241.452696:0:84240:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.6@tcp (ffff9c247f8f7000): rc 0 00000020:00080000:1.0:1784290241.452707:0:84240:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c247e4b6800), last request at 1784290040 00000020:00010000:0.0:1784290241.452720:0:6476:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c247f8f7000: total 0 00010000:00010000:0.0:1784290241.452853:0:6476:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c247f8f7000, canceled 0 locks, left on hash table 4. 00000020:00000080:1.0:1784290241.452885:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072cf4 00000020:00010000:1.0:1784290241.452890:0:84240:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c247e4b6800: total 0 00000100:00080000:1.0:1784290241.452894:0:84240:0:(import.c:65:import_set_state_nolock()) ffff9c247e4b6000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784290241.452902:0:84240:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c247e4b6800): rc 0 00000020:00080000:1.0:1784290241.452906:0:84240:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9c246ff10000) has no exports 00010000:00010000:0.0:1784290241.452917:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247b308200/0x5953bbf6b3072ede lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2176 expref: 5 pid: 83013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:3.0:1784290241.452928:0:19681:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c247e4b6800: total 0 00010000:00010000:0.0:1784290241.452955:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2440030a00/0x5953bbf6b3072eec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2184 expref: 4 pid: 83012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290241.452993:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2440031800/0x5953bbf6b3072ef3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b218b expref: 3 pid: 83013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.453030:0:19681:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c247e4b6800, canceled 0 locks, left on hash table 13. 00000100:00100000:2.0:1784290241.453041:0:83012:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c245850fc00:83012] 0 exiting: rc = 1 00010000:00010000:0.0:1784290241.453046:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247b309a00/0x5953bbf6b3072ee5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b217d expref: 2 pid: 83014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290241.453047:0:83013:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c23417b7400:83013] 1 exiting: rc = 0 00010000:00010000:3.0:1784290241.453077:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247b309800/0x5953bbf6b3072e98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3072e91 expref: 14 pid: 83014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290241.453078:0:6476:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c247f8f7000, canceled 4 locks, left on hash table 0. 00010000:00010000:3.0:1784290241.453130:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247b309c00/0x5953bbf6b3072e28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3072e21 expref: 13 pid: 83016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1784290241.453159:0:6476:0:(genops.c:906:class_export_put()) final put ffff9c247f8f7000/bdffa268-fb6a-4248-991c-0ad16fac303f 00010000:00010000:3.0:1784290241.453178:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c248216ce00/0x5953bbf6b3072ea6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3072e9f expref: 12 pid: 83012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290241.453196:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290241.453204:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290241.453209:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290241.453215:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c23450aa000/0x5953bbf6b3072e36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3072e2f expref: 11 pid: 83013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1784290241.453227:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247f8f7000/bdffa268-fb6a-4248-991c-0ad16fac303f for MGS 00000100:00100000:2.0:1784290241.453235:0:83014:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c246a468200:83014] 2 exiting: rc = 0 00000100:00100000:1.0:1784290241.453262:0:83016:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9c2345e5ee00:83016] 3 exiting: rc = 0 00010000:00010000:3.0:1784290241.453271:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c23450aa600/0x5953bbf6b3072e44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3072e3d expref: 10 pid: 83014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1784290241.453300:0:9947:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c247f8f5800 for MGS 00010000:00010000:3.0:1784290241.453315:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c248216ca00/0x5953bbf6b3072ec2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3072ebb expref: 9 pid: 83016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290241.453428:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd2a200/0x5953bbf6b3072e52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3072e4b expref: 8 pid: 83012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290241.453467:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290241.453486:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c248216d200/0x5953bbf6b3072eb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3072ead expref: 7 pid: 83014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290241.453488:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.453506:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290241.453516:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd2b600/0x5953bbf6b3072e6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3072e67 expref: 6 pid: 83012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290241.453527:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.453542:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.453558:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290241.453579:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c248216de00/0x5953bbf6b3072ed0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3072ec9 expref: 5 pid: 83014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290241.453579:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.453599:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290241.453614:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd2a400/0x5953bbf6b3072e60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3072e59 expref: 4 pid: 83014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290241.453628:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290241.453658:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd2b200/0x5953bbf6b3072e7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3072e75 expref: 3 pid: 83013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290241.453659:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.453681:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290241.453698:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd2be00/0x5953bbf6b3072e8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3072e83 expref: 2 pid: 83016 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290241.453700:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.453718:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290241.453725:0:19681:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c247e4b6800, canceled 13 locks, left on hash table 0. 00000100:00100000:0.0:1784290241.453758:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.453794:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1784290241.453799:0:19681:0:(genops.c:906:class_export_put()) final put ffff9c247e4b6800/2e54cd1c-9dbd-4e31-b60e-998135d46053 00000100:00100000:0.0:1784290241.453811:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290241.453824:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290241.453829:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290241.453833:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784290241.453835:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247e4b6800/2e54cd1c-9dbd-4e31-b60e-998135d46053 for MGS 00010000:00010000:3.0:1784290241.453842:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290241.453854:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.453881:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1784290241.453891:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c247e4b6000 for MGS 00000100:00100000:0.0:1784290241.453905:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.453923:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.453957:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.453970:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.453978:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.453991:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454004:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454016:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454027:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454040:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454054:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454067:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454078:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454090:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454102:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454113:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454124:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454136:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454147:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454159:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454175:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454190:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454207:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454218:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454228:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454239:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454251:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454263:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454274:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454286:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454299:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454310:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454321:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454332:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454342:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454408:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454424:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454451:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454468:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454483:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454497:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454509:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454520:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454532:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290241.454543:0:84240:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1784290241.455585:0:84240:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c246d004d20 - data ffff9c24708f1ca8/ffff9c2468ea7000 00000020:01000000:0.0:1784290241.455851:0:84240:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c244aa209c0 - data ffff9c247095b6c0/ffff9c24691fc400 00000020:00000080:0.0:1784290241.456774:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072ced 00000020:00000080:0.0:1784290241.456783:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c245fd7d800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1784290241.456801:0:84240:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c23458dc800 from MGS, refs=2 00000020:01000004:0.0:1784290241.456805:0:84240:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c23458dc800 2 00000020:01000004:0.0:1784290241.456808:0:84240:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c23458dc800 from MGS 00000020:00000080:1.0:1784290241.456817:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c245fd7d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784290241.456847:0:84240:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784290241.456853:0:84240:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1784290241.456856:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c246d58b000/MGS 00000020:00000080:0.0:1784290241.456858:0:84240:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246d58b000/MGS for MGS 00000020:01000000:0.0:1784290241.456865:0:84240:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1784290241.456914:0:84240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1784290241.456917:0:84240:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784290241.456924:0:84240:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784290241.456928:0:84240:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c246d8ae000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784290241.456933:0:84240:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9c247d26b380) has exports, disconnecting them 00000020:00080000:0.0:1784290241.456938:0:84240:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c246d8ae000), last request at 1784290040 00000020:00000080:0.0:1784290241.456942:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072e05 00000020:00080000:0.0:1784290241.456956:0:84240:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c246d8ae000): rc 0 00000020:00000080:0.0:1784290241.456960:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c246d8ae000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784290241.456994:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246d8ae000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1784290241.460137:0:84240:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1784290241.460144:0:84240:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784290241.460149:0:84240:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784290241.460173:0:84240:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784290241.460209:0:9947:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246d8a9800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784290241.460493:0:84240:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784290241.460505:0:84240:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1784290241.460510:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c24444ad000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1784290241.460514:0:84240:0:(genops.c:865:class_export_destroy()) destroying export ffff9c24444ad000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1784290241.460521:0:84240:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1784290241.460580:0:84240:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c23458dc800 1 00000020:00000080:0.0:1784290241.460585:0:84240:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3072cdf 00000020:00000080:0.0:1784290241.460591:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c23458da800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1784290241.460606:0:84240:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1784290241.460611:0:84240:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784290241.460614:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c23458da800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784290241.460616:0:84240:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784290241.460623:0:84240:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9c246ff119c0) has no exports 00000020:00000080:0.0:1784290241.474245:0:84240:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784290241.474259:0:84240:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1784290241.474266:0:84240:0:(genops.c:906:class_export_put()) final put ffff9c23458dc000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784290241.474272:0:84240:0:(genops.c:865:class_export_destroy()) destroying export ffff9c23458dc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1784290241.474284:0:84240:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1784290241.474462:0:84240:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c23458dd800 00000020:02000400:0.0:1784290241.474516:0:84240:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1784290242.087509:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290242.727562:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901004032:0@lo:400:kworker.0 00000100:00100000:1.0:1784290242.727573:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901004288:0@lo:13:osp-pre-1-1.0 00000400:00000100:3.0:1784290242.727638:0:3618:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870961901004032 offset 0 length 224: 4 00000100:00100000:0.0:1784290242.727657:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901003904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290242.727672:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290242.727731:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1870961901004544:0@lo:400:kworker.0 00000100:00100000:0.0:1784290242.727780:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290242.727788:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901004800:0@lo:400:kworker.0 00000100:00100000:2.0:1784290242.727791:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1870961901004160:0@lo:400:kworker.0 00000100:00100000:3.0:1784290242.727826:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290242.727830:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901004416:0@lo:400:kworker.0 00000100:00100000:1.0:1784290242.727859:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290242.727874:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290242.727879:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901005056:0@lo:400:kworker.0 00000100:00100000:0.0:1784290242.727910:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901004288 00000100:00100000:0.0:1784290242.727920:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901004288 00000100:00100000:1.0:1784290242.727927:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901003904 00000100:00100000:2.0:1784290242.727933:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901004672:0@lo:400:kworker.0 00000100:00100000:1.0:1784290242.727936:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901003904 00000100:00100000:3.0:1784290242.727944:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290242.727987:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290242.728007:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1784290242.728023:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901004544 00000100:00100000:0.0:1784290242.728026:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:1.0:1784290242.728027:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901003904:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290242.728028:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961901005184:0@lo:400:kworker.0 00000100:00100000:0.0:1784290242.728045:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901004288:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784290242.728048:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901004544 00000100:00100000:2.0:1784290242.728072:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1784290242.728075:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1784290242.728079:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290242.728120:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901004160 00000100:00100000:3.0:1784290242.728126:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901004160 00000100:00100000:2.0:1784290242.728130:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901004672 00000100:00100000:2.0:1784290242.728138:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901004672 00000100:00100000:1.0:1784290242.728144:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901003904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290242.728156:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1784290242.728164:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901005184 00000100:00100000:0.0:1784290242.728172:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901004288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290242.728173:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901005184 00000100:00100000:2.0:1784290242.728191:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:1.0:1784290242.728196:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901004800 00000100:00100000:0.0:1784290242.728203:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:1.0:1784290242.728205:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901004800 00000100:00100000:2.0:1784290242.728210:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901004672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290242.728220:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:3.0:1784290242.728230:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3618:x1870961901004544:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784290242.728240:0:74876:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:0.0:1784290242.728245:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784290242.728256:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784290242.728264:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784290242.728266:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3721 00000100:00100000:1.0:1784290242.728279:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3620:x1870961901004800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290242.728287:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901004672:12345-0@lo:400:kworker.0 Request processed in 83us (301us total) trans 0 rc 0/0 00000020:00080000:1.0:1784290242.728292:0:8413:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784290242.728307:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3618:x1870961901004544:12345-0@lo:400:kworker.0 Request processed in 74us (481us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784290242.728314:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:2.0:1784290242.728336:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:1.0:1784290242.728343:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3620:x1870961901004800:12345-0@lo:400:kworker.0 Request processed in 63us (486us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784290242.728353:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3721 00000100:00100000:0.0:1784290242.728369:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1870961901004160:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1784290242.728382:0:65988:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784290242.728386:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00100000:2.0:1784290242.728414:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:2.0:1784290242.728425:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1870961901005184:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784290242.728434:0:65989:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784290242.728445:0:26261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901005056 00000100:00100000:1.0:1784290242.728448:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290242.728448:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1870961901004160:12345-0@lo:400:kworker.0 Request processed in 109us (569us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784290242.728452:0:26261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901005056 00000100:00100000:0.0:1784290242.728468:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00100000:2.0:1784290242.728498:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1870961901005184:12345-0@lo:400:kworker.0 Request processed in 72us (427us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784290242.728500:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901004928:0@lo:400:kworker.0 00000100:00100000:0.0:1784290242.728502:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901004416 00000100:00100000:0.0:1784290242.728512:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901004416 00000100:00100000:3.0:1784290242.728513:0:26261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00100000:2.0:1784290242.728520:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:3.0:1784290242.728534:0:26261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901005056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290242.728557:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290242.728569:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:2.0:1784290242.728587:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901004416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290242.728606:0:15642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901004928 00000100:00100000:3.0:1784290242.728610:0:26261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901005056:12345-0@lo:400:kworker.0 Request processed in 81us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290242.728612:0:15642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901004928 00000100:00100000:3.0:1784290242.728625:0:26261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475 00000100:00100000:1.0:1784290242.728641:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901003904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290242.728651:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901004416:12345-0@lo:400:kworker.0 Request processed in 67us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290242.728661:0:26261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00100000:2.0:1784290242.728668:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:3.0:1784290242.728685:0:26261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901004928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290242.728685:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901004416:0@lo:400:kworker.0 00000100:00080000:0.0:1784290242.728702:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784290242.728761:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784290242.728769:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00080000:0.0:1784290242.728777:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:02000400:2.0:1784290242.728778:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784290242.728788:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00080000:2.0:1784290242.728790:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1784290242.728798:0:26261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901004928:12345-0@lo:400:kworker.0 Request processed in 116us (237us total) trans 0 rc 0/0 00000100:02000400:0.0:1784290242.728801:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784290242.728802:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1787 00000100:00080000:0.0:1784290242.728812:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1784290242.728818:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901004928:0@lo:400:kworker.0 00000100:00080000:2.0:1784290242.728819:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290242.728825:0:26261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00080000:0.0:1784290242.728825:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1968 00000100:00080000:0.0:1784290242.728839:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290242.728853:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2445d13b80 x1870961901005312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290242.728867:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c24483ca680 x1870961901005440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784290242.728880:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1784290242.728885:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1870961901004160:0@lo:400:kworker.0 00000100:00080000:1.0:1784290242.728888:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:0.0:1784290242.728889:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901004800:0@lo:400:kworker.0 00000100:00100000:3.0:1784290242.728895:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901005312:0@lo:38:ptlrpcd_00_02.0 00000100:02000400:1.0:1784290242.728902:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784290242.728911:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1784290242.728917:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901004672:0@lo:400:kworker.0 00000100:00080000:1.0:1784290242.728918:0:3618:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1787 00000100:00080000:1.0:1784290242.728931:0:3618:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290242.728936:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901004288:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1784290242.728950:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1784290242.728953:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290242.728961:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a48ce00 x1870961901005568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784290242.728965:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784290242.728981:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784290242.728989:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1784290242.728990:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901005440:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1784290242.728994:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1870961901004544:0@lo:400:kworker.0 00000100:00080000:2.0:1784290242.729004:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1787 00000100:00080000:2.0:1784290242.729013:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290242.729029:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901005056:0@lo:400:kworker.0 00000100:00100000:2.0:1784290242.729042:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2445d10a80 x1870961901005696/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784290242.729058:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290242.729066:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961901005184:0@lo:400:kworker.0 00000100:00100000:1.0:1784290242.729075:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901005312 00000100:00100000:1.0:1784290242.729091:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901005312 00000100:00100000:1.0:1784290242.729128:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:3.0:1784290242.729135:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901005568:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1784290242.729140:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901005312:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1784290242.729144:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901005440 00000100:00100000:0.0:1784290242.729154:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901005440 00010000:00020000:1.0:1784290242.729168:0:65989:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290242.729201:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3722 00000100:00100000:3.0:1784290242.729208:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290242.729216:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901005440:12345-0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1784290242.729224:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901005312:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 82us (273us total) trans 0 rc -19/-19 00010000:00020000:0.0:1784290242.729240:0:8412:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784290242.729254:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901005568 00000100:00100000:3.0:1784290242.729255:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901005696:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1784290242.729261:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:2.0:1784290242.729262:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901005568 00000100:00100000:1.0:1784290242.729293:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:1.0:1784290242.729301:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901005568:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1784290242.729313:0:65989:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290242.729321:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901005440:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 103us (271us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784290242.729330:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290242.729337:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3722 00000100:00100000:1.0:1784290242.729392:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901005568:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 89us (193us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784290242.729404:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:2.0:1784290242.729407:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901005696 00000100:00100000:2.0:1784290242.729413:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901005696 00000100:00080000:3.0:1784290242.729427:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784290242.729435:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784290242.729441:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901005312:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1784290242.729457:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00080000:3.0:1784290242.729458:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784290242.729468:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784290242.729470:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901005696:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1784290242.729476:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901005440:0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1784290242.729490:0:66008:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1784290242.729509:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784290242.729517:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784290242.729524:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901005568:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1784290242.729533:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901005696:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 66us (209us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290242.729541:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00080000:3.0:1784290242.729544:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784290242.729554:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784290242.729560:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901005696:0@lo:38:ptlrpcd_00_02.0 00000400:00000100:0.0:1784290243.077881:0:3612:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.6@tcp portal 26 match 1870961896197632 offset 0 length 224: 4 00000100:00100000:0.0:1784290243.077959:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290243.078020:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290243.078089:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896197760 00000100:00100000:2.0:1784290243.078105:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896197760 00000100:00100000:3.0:1784290243.078108:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896197888 00000100:00100000:0.0:1784290243.078110:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290243.078122:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896197888 00000100:00100000:2.0:1784290243.078184:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 972 00000100:00100000:2.0:1784290243.078206:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1870961896197760:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290243.078215:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000020:00080000:2.0:1784290243.078228:0:65988:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.6@tcp 00000100:00100000:3.0:1784290243.078237:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 601 00000100:00100000:3.0:1784290243.078260:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2397:x1870961896197888:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290243.078262:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896198016 00000100:00080000:0.0:1784290243.078272:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784290243.078278:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896198016 00000100:00100000:2.0:1784290243.078326:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1870961896197760:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 125us (369us total) trans 0 rc -107/-107 00000100:00080000:0.0:1784290243.078338:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784290243.078408:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2397:x1870961896197888:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 89us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290243.078428:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 601 00000100:00100000:1.0:1784290243.078441:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896198144 00000100:00100000:2.0:1784290243.078446:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 972 00000100:00100000:1.0:1784290243.078453:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896198144 00000100:00100000:0.0:1784290243.078474:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1477 00000100:00100000:0.0:1784290243.078504:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2398:x1870961896198016:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290243.078548:0:26263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1478 00000100:00100000:3.0:1784290243.078579:0:26263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2397:x1870961896198144:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290243.078590:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2398:x1870961896198016:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 93us (494us total) trans 0 rc 0/0 00000100:00080000:1.0:1784290243.078599:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290243.078609:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1477 00000100:00100000:3.0:1784290243.078652:0:26263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2397:x1870961896198144:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 75us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290243.078665:0:26263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1478 00000100:00100000:2.0:1784290243.079943:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290243.080066:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896198272 00000100:00100000:0.0:1784290243.080079:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896198272 00000100:00100000:0.0:1784290243.080140:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 973 00000100:00100000:0.0:1784290243.080158:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2396:x1870961896198272:12345-192.168.202.6@tcp:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1784290243.080195:0:74876:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290243.080311:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2396:x1870961896198272:12345-192.168.202.6@tcp:38:ptlrpcd_00_01.0 Request processed in 154us (371us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290243.080330:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 973 00010000:00010000:2.0:1784290243.111565:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784290243.752939:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784290243.752952:0:9482:0:(genops.c:906:class_export_put()) final put ffff9c246dcff800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784290243.753017:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dcff800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1784290243.753081:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246dcfe000 for lustre-OST0001 00010000:00010000:0.0:1784290244.135599:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290245.159637:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290246.183532:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784290246.825037:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784290246.825047:0:8397:0:(genops.c:906:class_export_put()) final put ffff9c246dcfb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784290246.825129:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dcfb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000001:00100000:1.0:1784290246.825134:0:75386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1784290246.825153:0:75386:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378739 is committed 00000020:00000080:1.0:1784290246.825160:0:75386:0:(genops.c:906:class_export_put()) final put ffff9c2474ee2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784290246.825214:0:9947:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246dcf9000 for lustre-OST0000 00000020:00000080:0.0:1784290246.825223:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2474ee2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1784290246.825280:0:9947:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2474ee3000 for lustre-MDT0001 00010000:00010000:1.0:1784290247.207548:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290247.847582:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1784290247.847618:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901005824:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1784290247.847642:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784290247.847649:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784290247.847654:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784290247.847663:0:9947:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1983 00000100:00100000:1.0:1784290247.847665:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901006080:0@lo:400:kworker.0 00000100:00080000:0.0:1784290247.847686:0:9947:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784290247.847697:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290247.847756:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c24483cb800 x1870961901006208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290247.847773:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:1.0:1784290247.847776:0:3617:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870961901006080 offset 0 length 224: 4 00000100:00080000:0.0:1784290247.847814:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784290247.847820:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784290247.847823:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784290247.847830:0:9947:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1983 00000100:00080000:0.0:1784290247.847834:0:9947:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1784290247.847841:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784290247.847842:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901005952:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784290247.847842:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290247.847857:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901006336:0@lo:400:kworker.0 00000100:00100000:3.0:1784290247.847858:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901006208:0@lo:38:kworker.0 00000100:00100000:0.0:1784290247.847864:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c24483c9f80 x1870961901006464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290247.847911:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290247.847929:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784290247.847937:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784290247.847947:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784290247.847950:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784290247.847955:0:9947:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1983 00000100:00080000:0.0:1784290247.847959:0:9947:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1784290247.847968:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901006592:0@lo:400:kworker.0 00000100:00080000:0.0:1784290247.847968:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290247.847991:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901005824 00000100:00100000:0.0:1784290247.847994:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c24483c8a80 x1870961901006720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784290247.848005:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901005824 00000100:00080000:0.0:1784290247.848010:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784290247.848016:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784290247.848019:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784290247.848024:0:9947:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1983 00000100:00080000:0.0:1784290247.848031:0:9947:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:2.0:1784290247.848038:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784290247.848041:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290247.848059:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c24483c9180 x1870961901006848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784290247.848087:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901006336 00000100:00100000:1.0:1784290247.848095:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901006336 00000100:00100000:3.0:1784290247.848112:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901005952 00000100:00100000:3.0:1784290247.848121:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901005952 00000100:00100000:1.0:1784290247.848153:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901006592 00000100:00100000:1.0:1784290247.848159:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901006592 00000100:00100000:2.0:1784290247.848169:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:0.0:1784290247.848187:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1784290247.848192:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901006336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290247.848205:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:1.0:1784290247.848206:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00000100:00100000:0.0:1784290247.848208:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901005824:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290247.848230:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901006592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290247.848236:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901005952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784290247.848245:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1784290247.848274:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784290247.848283:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901006336:12345-0@lo:400:kworker.0 Request processed in 96us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290247.848297:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:1.0:1784290247.848321:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901006592:12345-0@lo:400:kworker.0 Request processed in 97us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290247.848331:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901005824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290247.848374:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00000100:00100000:0.0:1784290247.848376:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:3.0:1784290247.848413:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901005952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 184us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290247.848429:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901006336:0@lo:400:kworker.0 00000100:00100000:3.0:1784290247.848431:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00080000:0.0:1784290247.848457:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784290247.848467:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784290247.848481:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784290247.848489:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290247.848504:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901006592:0@lo:400:kworker.0 00000100:00100000:2.0:1784290247.848535:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901005824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784290247.848548:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901006464:0@lo:38:kworker.0 00000100:00100000:1.0:1784290247.848566:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901006208 00000100:00100000:2.0:1784290247.848571:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901005952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290247.848574:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901006208 00000100:00100000:3.0:1784290247.848591:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290247.848611:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901006464 00000100:00100000:1.0:1784290247.848616:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901006464 00000100:00100000:3.0:1784290247.848631:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901006720:0@lo:38:kworker.0 00000100:00100000:1.0:1784290247.848653:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 974 00000100:00100000:1.0:1784290247.848665:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901006208:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290247.848683:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000100:00100000:0.0:1784290247.848697:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901006464:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784290247.848705:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:1.0:1784290247.848716:0:66008:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:0.0:1784290247.848720:0:74876:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784290247.848739:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901006848:0@lo:38:kworker.0 00000100:00100000:1.0:1784290247.848795:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447716a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901006208:12345-0@lo:38:kworker.0 Request processed in 130us (311us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290247.848804:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901006464:12345-0@lo:38:kworker.0 Request processed in 103us (212us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784290247.848814:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 974 00000100:00100000:3.0:1784290247.848817:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290247.848827:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000100:00100000:1.0:1784290247.848857:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901006848 00000100:00100000:1.0:1784290247.848864:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901006848 00000100:00080000:3.0:1784290247.848896:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1784290247.848897:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00080000:3.0:1784290247.848909:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784290247.848912:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901006848:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784290247.848919:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901006208:0@lo:38:kworker.0 00010000:00020000:1.0:1784290247.848929:0:65989:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784290247.848945:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901006720 00000100:00080000:3.0:1784290247.848953:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1784290247.848955:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901006720 00000100:00080000:3.0:1784290247.848963:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784290247.848969:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901006464:0@lo:38:kworker.0 00000100:00100000:1.0:1784290247.848977:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901006848:12345-0@lo:38:kworker.0 Request processed in 61us (165us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784290247.848986:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00080000:3.0:1784290247.848988:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784290247.848994:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784290247.849000:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901006848:0@lo:38:kworker.0 00000100:00100000:2.0:1784290247.849014:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3723 00000100:00100000:2.0:1784290247.849027:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901006720:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784290247.849047:0:8413:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784290247.849111:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901006720:12345-0@lo:38:kworker.0 Request processed in 85us (443us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290247.849122:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3723 00000100:00080000:3.0:1784290247.849146:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784290247.849153:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784290247.849157:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901006720:0@lo:38:kworker.0 00000400:00000100:2.0:1784290248.198380:0:3611:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.6@tcp portal 26 match 1870961896198400 offset 0 length 224: 4 00000100:00100000:2.0:1784290248.198426:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290248.198456:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290248.198477:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290248.198500:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896198656 00000100:00100000:2.0:1784290248.198507:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290248.198512:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896198656 00000100:00100000:1.0:1784290248.198521:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896198528 00000100:00100000:2.0:1784290248.198534:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896198784 00000100:00100000:2.0:1784290248.198541:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896198784 00000100:00100000:1.0:1784290248.198542:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896198528 00000100:00100000:3.0:1784290248.198560:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896198912 00000100:00100000:3.0:1784290248.198567:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896198912 00000100:00100000:1.0:1784290248.198615:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 604 00000100:00100000:2.0:1784290248.198621:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1479 00000100:00100000:0.0:1784290248.198640:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 977 00000100:00100000:2.0:1784290248.198648:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2398:x1870961896198784:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290248.198651:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2397:x1870961896198656:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290248.198659:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1480 00000100:00100000:0.0:1784290248.198663:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1870961896198528:12345-192.168.202.6@tcp:38:kworker.0 00000100:00100000:3.0:1784290248.198711:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2397:x1870961896198912:12345-192.168.202.6@tcp:400:kworker.0 00010000:00020000:0.0:1784290248.198724:0:65988:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784290248.198770:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2398:x1870961896198784:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 136us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290248.198771:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2397:x1870961896198912:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 64us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290248.198771:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2397:x1870961896198656:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 138us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290248.198785:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1870961896198528:12345-192.168.202.6@tcp:38:kworker.0 Request processed in 125us (321us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290248.198793:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1479 00000100:00100000:1.0:1784290248.198795:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 604 00000100:00100000:3.0:1784290248.198805:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1480 00000100:00100000:0.0:1784290248.198806:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 977 00000100:00080000:1.0:1784290248.198848:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784290248.198855:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784290248.198859:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1784290248.231598:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290249.255622:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290250.279490:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290251.303512:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290252.327565:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290252.967471:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23443b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901006976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290252.967504:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901007104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784290252.967552:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290252.967594:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290252.967634:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901006976 00000100:00100000:1.0:1784290252.967661:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901006976 00000100:00100000:0.0:1784290252.967672:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901007104 00000100:00100000:0.0:1784290252.967678:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901007104 00000100:00080000:2.0:1784290252.967695:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784290252.967701:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290252.967729:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:2.0:1784290252.967738:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:1.0:1784290252.967742:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901006976:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290252.967760:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d55c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901007104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784290252.967773:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1784290252.967781:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784290252.967830:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d55c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901007104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290252.967835:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901006976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290252.967842:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00100000:1.0:1784290252.967849:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:0.0:1784290252.967886:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23443b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901006976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290252.967915:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901007104:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1784290252.968450:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290252.968454:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290252.968457:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290252.968462:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1989 00000100:00080000:2.0:1784290252.968467:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784290252.968472:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290252.968489:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c234434c380 x1870961901007360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784290252.968521:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290252.968524:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290252.968526:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290252.968531:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1989 00000100:00080000:2.0:1784290252.968534:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784290252.968537:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290252.968548:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c234434f480 x1870961901007616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290252.968561:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901007360:0@lo:38:kworker.0 00000100:00080000:2.0:1784290252.968565:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290252.968569:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290252.968577:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290252.968582:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1989 00000100:00080000:2.0:1784290252.968585:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784290252.968589:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290252.968598:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290252.968603:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2446e77800 x1870961901007872/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784290252.968614:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290252.968617:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290252.968619:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290252.968636:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1989 00000100:00080000:2.0:1784290252.968638:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784290252.968640:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290252.968646:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901007616:0@lo:38:kworker.0 00000100:00100000:2.0:1784290252.968671:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2446e74000 x1870961901008000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290252.968709:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1870961901007488:0@lo:400:kworker.0 00000100:00100000:0.0:1784290252.968716:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290252.968743:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2446e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901007872:0@lo:38:kworker.0 00000100:00100000:2.0:1784290252.968749:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290252.968779:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784290252.968779:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290252.968791:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2446e77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901007744:0@lo:400:kworker.0 00000100:00100000:3.0:1784290252.968799:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901007360 00000100:00100000:3.0:1784290252.968806:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901007360 00000100:00100000:0.0:1784290252.968813:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2446e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901008000:0@lo:38:kworker.0 00000100:00100000:2.0:1784290252.968820:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290252.968835:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901007616 00000100:00100000:3.0:1784290252.968840:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901007616 00000100:00100000:0.0:1784290252.968850:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290252.968885:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901007488 00000100:00100000:2.0:1784290252.968887:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901007744 00000100:00100000:3.0:1784290252.968890:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901007488 00000100:00100000:2.0:1784290252.968893:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901007744 00000100:00100000:0.0:1784290252.968916:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901008000 00000100:00100000:0.0:1784290252.968921:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901008000 00000100:00100000:3.0:1784290252.968937:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:2.0:1784290252.968945:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:3.0:1784290252.968952:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901007744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290252.968961:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:2.0:1784290252.968963:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1870961901007488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290252.968974:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901007360:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784290252.968991:0:66004:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784290252.969017:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901007744:12345-0@lo:400:kworker.0 Request processed in 72us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290252.969025:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1870961901007488:12345-0@lo:400:kworker.0 Request processed in 69us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290252.969027:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:2.0:1784290252.969048:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:0.0:1784290252.969050:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901007360:12345-0@lo:38:kworker.0 Request processed in 75us (449us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784290252.969057:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:0.0:1784290252.969068:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:3.0:1784290252.969069:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901007616:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784290252.969082:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00010000:00020000:3.0:1784290252.969086:0:66008:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784290252.969108:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901008000:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290252.969119:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901007872 00010000:00020000:2.0:1784290252.969120:0:65990:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290252.969125:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901007872 00000100:00100000:3.0:1784290252.969137:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901007616:12345-0@lo:38:kworker.0 Request processed in 71us (422us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784290252.969146:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:0.0:1784290252.969153:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3724 00000100:00100000:0.0:1784290252.969160:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901007872:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784290252.969164:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901008000:12345-0@lo:38:kworker.0 Request processed in 71us (316us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290252.969172:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00010000:00020000:0.0:1784290252.969174:0:8412:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1784290252.969186:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784290252.969213:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2446e77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901007744:0@lo:400:kworker.0 00000100:00100000:3.0:1784290252.969217:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901007232:0@lo:400:kworker.0 00000100:00100000:0.0:1784290252.969220:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901007872:12345-0@lo:38:kworker.0 Request processed in 56us (438us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290252.969228:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3724 00000100:00100000:2.0:1784290252.969232:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1870961901007488:0@lo:400:kworker.0 00000400:00000100:3.0:1784290252.969244:0:3618:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870961901007232 offset 0 length 224: 4 00000100:00080000:0.0:1784290252.969273:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290252.969280:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290252.969284:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2446e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901008000:0@lo:38:kworker.0 00000100:00080000:0.0:1784290252.969298:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290252.969308:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290252.969311:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901007616:0@lo:38:kworker.0 00000100:00080000:0.0:1784290252.969322:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290252.969325:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290252.969328:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2446e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901007872:0@lo:38:kworker.0 00000100:00080000:0.0:1784290252.969336:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290252.969338:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290252.969341:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901007360:0@lo:38:kworker.0 00000400:00000100:2.0:1784290253.317722:0:3612:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.6@tcp portal 26 match 1870961896199040 offset 0 length 224: 4 00000100:00100000:2.0:1784290253.317771:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290253.317818:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290253.317833:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896199168 00000100:00100000:3.0:1784290253.317844:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896199168 00000100:00100000:2.0:1784290253.317853:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290253.317888:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896199296 00000100:00100000:3.0:1784290253.317892:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896199296 00000100:00100000:2.0:1784290253.317898:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290253.317940:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 607 00000100:00100000:2.0:1784290253.317958:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 981 00000100:00100000:3.0:1784290253.317959:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2399:x1870961896199296:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290253.317974:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1870961896199168:12345-192.168.202.6@tcp:38:kworker.0 00010000:00020000:2.0:1784290253.318003:0:65989:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784290253.318035:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2399:x1870961896199296:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 85us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290253.318050:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 607 00000100:00100000:2.0:1784290253.318051:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1870961896199168:12345-192.168.202.6@tcp:38:kworker.0 Request processed in 74us (277us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290253.318067:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 981 00000100:00080000:3.0:1784290253.318083:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784290253.318108:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896199424 00000100:00100000:2.0:1784290253.318115:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896199424 00000100:00100000:3.0:1784290253.318120:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896199552 00000100:00100000:3.0:1784290253.318126:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896199552 00000100:00100000:2.0:1784290253.318177:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1481 00000100:00100000:3.0:1784290253.318187:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1482 00000100:00100000:2.0:1784290253.318195:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2400:x1870961896199424:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290253.318204:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2399:x1870961896199552:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290253.318256:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2400:x1870961896199424:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 66us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290253.318262:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2399:x1870961896199552:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 62us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290253.318277:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1481 00000100:00100000:3.0:1784290253.318285:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1482 00000100:00080000:3.0:1784290253.318325:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784290253.318328:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784290253.352490:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290254.376466:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290255.399425:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784290256.328953:0:84857:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784290256.328959:0:84857:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1784290256.328961:0:84857:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1784290256.329093:0:84857:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9c2469a70000 00000020:01000004:1.0:1784290256.329113:0:84857:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1784290256.329133:0:84857:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1784290256.329150:0:84857:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c246ff6cd40) 00000020:00000080:1.0:1784290256.329174:0:84857:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1784290256.396054:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1784290256.396846:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1784290256.400077:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1784290256.401690:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1784290256.401933:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1784290256.402224:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1784290256.402473:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1784290256.402756:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1784290256.402983:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1784290256.403193:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1784290256.403442:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1784290256.403670:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1784290256.403904:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1784290256.404111:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1784290256.404304:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1784290256.404528:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1784290256.404777:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1784290256.404971:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1784290256.405205:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1784290256.405407:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1784290256.405586:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1784290256.405823:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1784290256.406026:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1784290256.406245:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1784290256.406456:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1784290256.406722:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1784290256.406930:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1784290256.407172:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1784290256.407372:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1784290256.407564:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1784290256.407864:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1784290256.408075:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1784290256.408269:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1784290256.408503:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1784290256.408755:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1784290256.409609:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1784290256.409824:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1784290256.410201:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1784290256.410445:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1784290256.410651:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1784290256.410877:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1784290256.411086:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1784290256.411361:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784290256.411560:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1784290256.411801:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1784290256.412000:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1784290256.412206:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1784290256.412826:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1784290256.413224:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1784290256.413559:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1784290256.414001:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1784290256.414216:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1784290256.414408:0:84857:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:2.0:1784290256.414909:0:84857:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1784290256.415074:0:84857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1784290256.415081:0:84857:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784290256.415090:0:84857:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b30731fc 00000020:01000004:2.0:1784290256.415095:0:84857:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1784290256.415107:0:84857:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1784290256.415110:0:84857:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c2469a70000 from MGS 00000020:01000004:2.0:1784290256.415113:0:84857:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1784290256.415121:0:84857:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c245fdd3380) 00000020:00000080:2.0:1784290256.415129:0:84857:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:2.0:1784290256.415204:0:84857:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2469a70000 from MGS, refs=2 00080000:01000000:2.0:1784290256.415207:0:84857:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784290256.415213:0:84857:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b307320a 00010000:00010000:2.0:1784290256.415313:0:84857:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1784290256.418926:0:84857:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1784290256.419767:0:84861:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1784290256.419775:0:84857:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1784290256.419822:0:84857:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784290256.420427:0:84857:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1784290256.420848:0:84857:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784290256.421016:0:84857:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1784290256.421039:0:84857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1784290256.421581:0:84857:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1784290256.421638:0:84857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1784290256.422002:0:84857:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1784290256.422041:0:84857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1784290256.423135:0:84857:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1784290256.423182:0:84857:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1784290256.423185:0:84857:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.106@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1784290256.423192:0:84857:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.106@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:1.0:1784290256.423204:0:84857:0:(import.c:65:import_set_state_nolock()) ffff9c2447cad800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1784290256.423216:0:84857:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1784290256.424550:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784290256.435762:0:84857:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.106@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1784290256.435769:0:84857:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1784290256.435787:0:84857:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c246d5a3480 x1870961901004032/t0(0) o400->MGC192.168.202.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784290258 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290256.435837:0:84857:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c24483c9c00 x1870961901006080/t0(0) o400->MGC192.168.202.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784290263 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290256.435865:0:84857:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c234434d500 x1870961901007232/t0(0) o400->MGC192.168.202.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784290268 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1784290256.435888:0:84857:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1784290256.435892:0:84857:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1784290256.435899:0:84857:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1784290256.435901:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901004032:0@lo:400:kworker.0 00000100:00100000:1.0:1784290256.435905:0:84857:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:2.0:1784290256.435948:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901007232:0@lo:400:kworker.0 00000100:00100000:1.0:1784290256.435964:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901006080:0@lo:400:kworker.0 10000000:01000000:1.0:1784290256.436031:0:84857:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1784290256.436054:0:84857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247b309000/0x5953bbf6b3072ebb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3072ec2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290256.436070:0:84857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247b309000/0x5953bbf6b3072ebb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3072ec2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290256.436079:0:84857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784290256.436111:0:84857:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290256.436125:0:84857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247b309000/0x5953bbf6b3072ebb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3072ec2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.436175:0:84857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b3072e21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3072e28 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290256.436186:0:84857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b3072e21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3072e28 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290256.436194:0:84857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290256.436222:0:84857:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290256.436228:0:84857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b3072e21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3072e28 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.436240:0:84857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c248216c600/0x5953bbf6b3072e3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3072e44 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290256.436250:0:84857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c248216c600/0x5953bbf6b3072e3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3072e44 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290256.436258:0:84857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290256.436271:0:84857:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290256.436278:0:84857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c248216c600/0x5953bbf6b3072e3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3072e44 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.436292:0:84857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450ab200/0x5953bbf6b3072e67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3072e6e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290256.436301:0:84857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450ab200/0x5953bbf6b3072e67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3072e6e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290256.436308:0:84857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290256.436332:0:84857:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290256.436338:0:84857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450ab200/0x5953bbf6b3072e67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3072e6e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.436448:0:84857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3072e75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3072e7c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290256.436459:0:84857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3072e75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3072e7c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290256.436467:0:84857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290256.436481:0:84857:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290256.436486:0:84857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3072e75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3072e7c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.436507:0:84857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c248216dc00/0x5953bbf6b3072e91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3072e98 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290256.436527:0:84857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c248216dc00/0x5953bbf6b3072e91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3072e98 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290256.436534:0:84857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290256.436546:0:84857:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290256.436551:0:84857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c248216dc00/0x5953bbf6b3072e91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3072e98 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.436568:0:84857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247b308600/0x5953bbf6b3072e9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3072ea6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290256.436577:0:84857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247b308600/0x5953bbf6b3072e9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3072ea6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290256.436628:0:84857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290256.436659:0:84857:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290256.436670:0:84857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247b308600/0x5953bbf6b3072e9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3072ea6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.436691:0:84857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247b309200/0x5953bbf6b3072ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3072ed0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290256.436705:0:84857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247b309200/0x5953bbf6b3072ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3072ed0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290256.436716:0:84857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290256.436737:0:84857:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290256.436745:0:84857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247b309200/0x5953bbf6b3072ec9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3072ed0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.436772:0:84857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c248216cc00/0x5953bbf6b3072e2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3072e36 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290256.436782:0:84857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c248216cc00/0x5953bbf6b3072e2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3072e36 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290256.436789:0:84857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290256.436802:0:84857:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290256.436808:0:84857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c248216cc00/0x5953bbf6b3072e2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3072e36 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.436828:0:84857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450aaa00/0x5953bbf6b3072e4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3072e52 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290256.436853:0:84857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aaa00/0x5953bbf6b3072e4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3072e52 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290256.436860:0:84857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290256.436872:0:84857:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290256.436879:0:84857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450aaa00/0x5953bbf6b3072e4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3072e52 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.436895:0:84857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3072e59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3072e60 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290256.436903:0:84857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3072e59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3072e60 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290256.436910:0:84857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784290256.436920:0:84857:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290256.436927:0:84857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3072e59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3072e60 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.436939:0:84857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247b308c00/0x5953bbf6b3072e83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3072e8a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290256.436948:0:84857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247b308c00/0x5953bbf6b3072e83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3072e8a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290256.436954:0:84857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784290256.436965:0:84857:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290256.436982:0:84857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247b308c00/0x5953bbf6b3072e83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3072e8a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.437007:0:84857:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247b308400/0x5953bbf6b3072ead lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3072eb4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290256.437017:0:84857:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247b308400/0x5953bbf6b3072ead lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3072eb4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290256.437024:0:84857:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784290256.437034:0:84857:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290256.437044:0:84857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247b308400/0x5953bbf6b3072ead lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3072eb4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784290256.437066:0:84857:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c2447cad800 already not connected (conn 46, was 0): DISCONN 00000100:00080000:1.0:1784290256.437076:0:84857:0:(import.c:65:import_set_state_nolock()) ffff9c2447cad800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290256.437086:0:84857:0:(import.c:510:import_select_connection()) MGC192.168.202.106@tcp: connect to NID 0@lo last attempt 1781 00000100:00080000:1.0:1784290256.437100:0:84857:0:(import.c:624:import_select_connection()) MGC192.168.202.106@tcp: import ffff9c2447cad800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290256.437152:0:84857:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2347d66d80 x1870961901008128/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784290256.437197:0:84857:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1784290256.437229:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e54cd1c-9dbd-4e31-b60e-998135d46053:3616:1870961901008128:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1784290256.437292:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290256.437415:0:84863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901008128 00000100:00100000:2.0:1784290256.437435:0:84863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901008128 00000100:00100000:2.0:1784290256.437484:0:84863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784290256.437495:0:84863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3616:x1870961901008128:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1784290256.437529:0:84863:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo t0 exp 0000000000000000 cur 1997 last 0 00000020:00000080:2.0:1784290256.437558:0:84863:0:(genops.c:1406:class_connect()) connect: client 2e54cd1c-9dbd-4e31-b60e-998135d46053, cookie 0x5953bbf6b3073211 00000100:00080000:2.0:1784290256.437723:0:84863:0:(import.c:65:import_set_state_nolock()) ffff9c2458be9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784290256.437782:0:84863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:3616:x1870961901008128:12345-0@lo:250:mount.lustre.0 Request processed in 287us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290256.437789:0:84863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784290256.437813:0:3616:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.106@tcp: committing for last_committed 0 gen 23 00000100:00080000:0.0:1784290256.437821:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.106@tcp: connect to target with instance 0 00000100:00080000:0.0:1784290256.437828:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1784290256.437832:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1784290256.437834:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2447cad800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1784290256.437836:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1784290256.437856:0:3616:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1784290256.437866:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e54cd1c-9dbd-4e31-b60e-998135d46053:3616:1870961901008128:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1784290256.437906:0:84857:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000000:3.0:1784290256.437917:0:42926:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.202.106@tcp 00000020:01000004:2.0:1784290256.437919:0:84857:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 10000000:01000000:3.0:1784290256.437932:0:42926:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1784290256.437935:0:42926:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1784290256.437937:0:42926:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784290256.437938:0:42926:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784290256.437939:0:42926:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784290256.437940:0:42926:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784290256.437941:0:42926:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784290256.437942:0:42926:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784290256.437943:0:42926:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784290256.437944:0:42926:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000004:2.0:1784290256.437952:0:84857:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1784290256.437958:0:84857:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000020:01000000:3.0:1784290256.438006:0:42926:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1784290256.438015:0:42926:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1784290256.438017:0:42926:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1784290256.438019:0:42926:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784290256.438021:0:42926:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:1.0:1784290256.438027:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23443b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901008256:0@lo:253:kworker.0 00000020:01000004:3.0:1784290256.438028:0:42926:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784290256.438038:0:42926:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784290256.438050:0:42926:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784290256.438053:0:42926:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784290256.438055:0:42926:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784290256.438056:0:42926:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000040:01000000:2.0:1784290256.438062:0:84857:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000000:3.0:1784290256.438081:0:42926:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1784290256.438087:0:42926:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1784290256.438091:0:42926:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1784290256.438093:0:42926:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784290256.438098:0:84857:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.106@tcp, index=0000, flags=0x20005 00000100:00100000:0.0:1784290256.438105:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23443baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901008384:0@lo:253:kworker.0 00000020:01000004:2.0:1784290256.438106:0:84857:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784290256.438107:0:42926:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784290256.438114:0:84857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784290256.438115:0:42926:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784290256.438119:0:42926:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784290256.438120:0:84857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784290256.438121:0:42926:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784290256.438123:0:84857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784290256.438124:0:42926:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784290256.438129:0:42926:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784290256.438129:0:84857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784290256.438134:0:42926:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000004:2.0:1784290256.438135:0:84857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784290256.438140:0:84857:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784290256.438141:0:84857:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784290256.438144:0:84857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784290256.438146:0:84857:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784290256.438155:0:84857:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000100:00100000:1.0:1784290256.438166:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1784290256.438167:0:84857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784290256.438175:0:84857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784290256.438180:0:84857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784290256.438183:0:84857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:0.0:1784290256.438184:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1784290256.438185:0:84857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784290256.438189:0:84857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784290256.438192:0:84857:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784290256.438193:0:84857:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000000:3.0:1784290256.438216:0:42926:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000020:01000004:2.0:1784290256.438217:0:84857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784290256.438221:0:84857:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00100000:2.0:1784290256.438242:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23443b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901008512:0@lo:253:kworker.0 10000000:01000000:3.0:1784290256.438293:0:84857:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784290256.438293:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290256.438312:0:84857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901008640:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784290256.438350:0:84863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901008256 00000100:00100000:2.0:1784290256.438356:0:84863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901008256 00000100:00100000:0.0:1784290256.438372:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901008384 00000100:00100000:0.0:1784290256.438379:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901008384 00000100:00100000:3.0:1784290256.438391:0:84857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290256.438408:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901008512 00000100:00100000:2.0:1784290256.438412:0:84863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901008640 00000100:00100000:0.0:1784290256.438412:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901008512 00000100:00100000:2.0:1784290256.438418:0:84863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901008640 00000100:00100000:3.0:1784290256.438421:0:84857:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2480379c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784290256.438441:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784290256.438451:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:3618:x1870961901008384:12345-0@lo:253:kworker.0 00000100:00100000:2.0:1784290256.438453:0:84863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784290256.438462:0:84863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:3617:x1870961901008256:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1784290256.438482:0:84864:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1784290256.438484:0:84863:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:0.0:1784290256.438647:0:84866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1784290256.438698:0:84864:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 100 20000000:01000000:3.0:1784290256.440178:0:84867:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1784290256.440183:0:84867:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1784290256.440186:0:84867:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1784290256.440189:0:84867:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1784290256.440410:0:84867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1784290256.440587:0:84864:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784290256.440651:0:84864:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784290256.441919:0:84864:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784290256.441929:0:84864:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1784290256.441939:0:84866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784290256.441943:0:84866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1784290256.441958:0:84863:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:3.0:1784290256.441961:0:84866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3073218 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.441976:0:84866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3073218 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784290256.441984:0:84866:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000040925s 00010000:00010000:3.0:1784290256.441987:0:84866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3073218 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.441994:0:84866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3073218 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.441999:0:84866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3073218 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.442014:0:84866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3073218 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.442019:0:84866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebea00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290256.442023:0:84866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3073218 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.442030:0:84866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3073218 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.442039:0:84866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3073218 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.442044:0:84866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3073218 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.442048:0:84866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3073218 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290256.442185:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:3618:x1870961901008384:12345-0@lo:253:kworker.0 Request processed in 3732us (4004us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290256.442198:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:2.0:1784290256.442216:0:3618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1784290256.442220:0:3618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784290256.442221:0:3618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784290256.442222:0:3618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784290256.442224:0:3618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784290256.442226:0:3618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784290256.442227:0:3618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784290256.442229:0:3618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784290256.442230:0:3618:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1784290256.442235:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23443baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901008384:0@lo:253:kworker.0 00000100:00100000:0.0:1784290256.442243:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784290256.442255:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475cab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:3619:x1870961901008512:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1784290256.442279:0:84864:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1784290256.444077:0:84863:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784290256.444089:0:84863:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1784290256.444097:0:84866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784290256.444102:0:84866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784290256.444113:0:84866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b307321f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.444122:0:84866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b307321f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784290256.444130:0:84866:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000040925s 00010000:00010000:3.0:1784290256.444134:0:84866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b307321f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.444152:0:84866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b307321f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784290256.444157:0:84864:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:3.0:1784290256.444159:0:84866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b307321f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.444169:0:84866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b307321f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.444175:0:84866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebee00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290256.444179:0:84866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b307321f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.444185:0:84866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b307321f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.444194:0:84866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b307321f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.444200:0:84866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b307321f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.444206:0:84866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b307321f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290256.444399:0:84863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:3617:x1870961901008256:12345-0@lo:253:kworker.0 Request processed in 5937us (6250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290256.444409:0:84863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784290256.444451:0:84863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000020:01000004:1.0:1784290256.444457:0:3617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000100:00100000:2.0:1784290256.444466:0:84863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:84857:x1870961901008640:12345-0@lo:253:mount.lustre.0 00000020:01000004:1.0:1784290256.444467:0:3617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784290256.444475:0:3617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290256.444481:0:3617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290256.444485:0:3617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290256.444488:0:3617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290256.444490:0:3617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784290256.444492:0:3617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290256.444496:0:3617:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 20000000:01000000:2.0:1784290256.444504:0:84863:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784290256.444509:0:84863:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 00000100:00100000:1.0:1784290256.444521:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23443b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901008256:0@lo:253:kworker.0 20000000:01000000:2.0:1784290256.444522:0:84863:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1784290256.444542:0:84863:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1784290256.445980:0:84864:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784290256.445994:0:84864:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1784290256.446007:0:84866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784290256.446012:0:84866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784290256.446026:0:84866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b3073226 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.446036:0:84866:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b3073226 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784290256.446051:0:84866:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000040925s 00010000:00010000:3.0:1784290256.446054:0:84866:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b3073226 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.446062:0:84866:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b3073226 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.446068:0:84866:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b3073226 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.446074:0:84866:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b3073226 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290256.446083:0:84863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:84857:x1870961901008640:12345-0@lo:253:mount.lustre.0 Request processed in 1617us (7722us total) trans 0 rc 0/0 00010000:00010000:3.0:1784290256.446084:0:84866:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebe800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290256.446091:0:84866:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b3073226 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.446105:0:84866:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b3073226 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290256.446107:0:84863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1784290256.446120:0:84866:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b3073226 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.446128:0:84866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b3073226 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.446135:0:84866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b3073226 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290256.446216:0:84857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901008640:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784290256.446242:0:84857:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000100:00100000:0.0:1784290256.446245:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475cab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:3619:x1870961901008512:12345-0@lo:253:kworker.0 Request processed in 3989us (7947us total) trans 0 rc 0/0 00000020:01000004:1.0:1784290256.446248:0:84857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784290256.446256:0:84857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784290256.446262:0:84857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290256.446266:0:84857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290256.446270:0:84857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:0.0:1784290256.446274:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:1.0:1784290256.446276:0:84857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290256.446280:0:84857:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784290256.446284:0:84857:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784290256.446287:0:84857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290256.446291:0:84857:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784290256.446316:0:3619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1784290256.446323:0:3619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784290256.446325:0:3619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784290256.446328:0:3619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784290256.446331:0:3619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290256.446335:0:84857:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c2469a70000 from lustre-MDT0000 00000020:01000004:2.0:1784290256.446336:0:3619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784290256.446396:0:3619:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784290256.446399:0:3619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784290256.446402:0:3619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1784290256.446410:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23443b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901008512:0@lo:253:kworker.0 10000000:01000000:1.0:1784290256.446432:0:84857:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1784290256.446438:0:84857:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784290256.446450:0:84857:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c2469a70000 10000000:01000000:1.0:1784290256.446455:0:84857:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784290256.446462:0:84857:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c2469a70000 10000000:01000000:1.0:1784290256.446466:0:84857:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1784290256.446471:0:84857:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9c2469a70000 from 1 10000000:01000000:1.0:1784290256.446475:0:84857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784290256.446510:0:84857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440030c00/0x5953bbf6b307322d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.446525:0:84857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2440030c00/0x5953bbf6b307322d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.446540:0:84857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2440030c00/0x5953bbf6b307322d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290256.446560:0:84857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901008768:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784290256.446679:0:84857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290256.446730:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901008768 00000100:00100000:1.0:1784290256.446738:0:84857:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341e0fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290256.446742:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901008768 00000100:00100000:3.0:1784290256.446784:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784290256.446790:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475cab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:84857:x1870961901008768:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784290256.446798:0:84865:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290256.446808:0:84865:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebfa00/0x5953bbf6b3073234 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307322d expref: -99 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.446822:0:84865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebfa00/0x5953bbf6b3073234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307322d expref: 6 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.446829:0:84865:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebfa00/0x5953bbf6b3073234 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307322d expref: 6 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.446834:0:84865:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebfa00, rc 0) 00000100:00100000:3.0:1784290256.446873:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475cab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:84857:x1870961901008768:12345-0@lo:101:mount.lustre.0 Request processed in 83us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290256.446877:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784290256.446927:0:84857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901008768:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784290256.446951:0:84857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2440030c00/0x5953bbf6b307322d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073234 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.446975:0:84857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2440030c00/0x5953bbf6b307322d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073234 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290256.446996:0:84857:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784290256.447018:0:84857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440030c00/0x5953bbf6b307322d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073234 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.447028:0:84857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2440030c00/0x5953bbf6b307322d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073234 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290256.447037:0:84857:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784290256.447042:0:84857:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784290256.447048:0:84857:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c2469a70000 10000000:01000000:1.0:1784290256.447054:0:84857:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1784290256.447059:0:84857:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1784290256.447062:0:84857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784290256.447085:0:84857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440030200/0x5953bbf6b307323b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.447095:0:84857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2440030200/0x5953bbf6b307323b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.447104:0:84857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2440030200/0x5953bbf6b307323b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290256.447132:0:84857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901008896:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784290256.447174:0:84857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290256.447201:0:84857:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341e0fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290256.447222:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901008896 00000100:00100000:0.0:1784290256.447230:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901008896 00000100:00100000:0.0:1784290256.447266:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784290256.447273:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ca8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:84857:x1870961901008896:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784290256.447282:0:84864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290256.447295:0:84864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ef8800/0x5953bbf6b3073242 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307323b expref: -99 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290256.447314:0:84864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ef8800/0x5953bbf6b3073242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307323b expref: 7 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290256.447337:0:84864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ef8800/0x5953bbf6b3073242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307323b expref: 7 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290256.447368:0:84864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef8800, rc 0) 00000100:00100000:0.0:1784290256.447422:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ca8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:84857:x1870961901008896:12345-0@lo:101:mount.lustre.0 Request processed in 149us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290256.447434:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784290256.447473:0:84857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901008896:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784290256.447493:0:84857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2440030200/0x5953bbf6b307323b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073242 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.447504:0:84857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2440030200/0x5953bbf6b307323b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073242 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290256.447574:0:84857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901009024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784290256.447651:0:84857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290256.447701:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901009024 00000100:00100000:1.0:1784290256.447702:0:84857:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341e0fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290256.447711:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901009024 00000100:00100000:3.0:1784290256.447743:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784290256.447748:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475cab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:84857:x1870961901009024:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784290256.447826:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475cab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:84857:x1870961901009024:12345-0@lo:501:mount.lustre.0 Request processed in 78us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290256.447831:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784290256.447879:0:84857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901009024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784290256.447920:0:84857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901009152:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784290256.447994:0:84857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290256.448021:0:84857:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341e0fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290256.448057:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901009152 00000100:00100000:0.0:1784290256.448063:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901009152 00000100:00100000:0.0:1784290256.448093:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784290256.448100:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:84857:x1870961901009152:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784290256.448660:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:84857:x1870961901009152:12345-0@lo:503:mount.lustre.0 Request processed in 560us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290256.448667:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784290256.448710:0:84857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901009152:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784290256.449010:0:84868:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d01500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:84868:1870961901009280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290256.449053:0:84868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290256.449079:0:84868:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95180 going to sleep for 11 seconds 00000100:00100000:3.0:1784290256.449100:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901009280 00000100:00100000:3.0:1784290256.449104:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901009280 00000100:00100000:3.0:1784290256.449126:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784290256.449130:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:84868:x1870961901009280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290256.449615:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:84868:x1870961901009280:12345-0@lo:502:llog_process_th.0 Request processed in 484us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290256.449621:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784290256.449663:0:84868:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d01500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:84868:1870961901009280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784290256.449687:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784290256.449698:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290256.449701:0:84868:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784290256.449706:0:84868:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1784290256.449710:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784290256.449724:0:84868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c245fdd4d40) 00000020:00000080:2.0:1784290256.449745:0:84868:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:2.0:1784290256.449751:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1784290256.449821:0:84868:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784290256.449828:0:84868:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3073250 00000020:00000080:2.0:1784290256.450013:0:84868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1784290256.450017:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784290256.450021:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290256.450028:0:84868:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784290256.450031:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784290256.450035:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290256.450036:0:84868:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1784290256.450039:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784290256.450046:0:84868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c245fdd0000) 00000020:00000080:2.0:1784290256.450057:0:84868:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:2.0:1784290256.450060:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1784290256.450062:0:84868:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1784290256.450064:0:84868:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1784290256.450070:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784290256.450112:0:84868:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2469a70000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1784290256.450122:0:84868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c245fdd19c0) 00000020:00000080:2.0:1784290256.450131:0:84868:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:2.0:1784290256.450179:0:84868:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1784290256.450183:0:84868:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3073265 00000020:00000080:2.0:1784290256.450270:0:84868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1784290256.450276:0:84868:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1784290256.450279:0:84868:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5953bbf6b307326c 00080000:01000000:2.0:1784290256.450283:0:84868:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:2.0:1784290256.450286:0:84868:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3073273 00010000:00010000:2.0:1784290256.493272:0:84868:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1784290256.493399:0:84868:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: bd808cf4-dd54-45f0-9b2b-1434e8330e5d idx: 0 lr: 0 srv lr: 94489280512 lx: 0 gen 22 00000001:00080000:2.0:1784290256.493432:0:84868:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 94489280512 lx: 0 gen 21 00000001:00000004:2.0:1784290256.493447:0:84868:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 23, last_transno is 94489280512 00000001:00080000:2.0:1784290256.493522:0:84868:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1784290256.493570:0:84868:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2345d95e40: xid 1870961896193792, transno 94489280513, client gen 22, slot idx 0 00000020:00000080:2.0:1784290256.493920:0:84868:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c2445c14d40) 00000020:00000080:2.0:1784290256.493936:0:84868:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1784290256.493994:0:84868:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784290256.494001:0:84868:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b307328f 00000020:00000080:2.0:1784290256.494576:0:84868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784290256.496766:0:84868:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5953bbf6b3073296 00000020:00000080:0.0:1784290256.497062:0:84868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1784290256.497077:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784290256.497087:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290256.497090:0:84868:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1784290256.497093:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784290256.497096:0:84868:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1784290256.497099:0:84868:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784290256.497101:0:84868:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784290256.497103:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784290256.497106:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290256.497107:0:84868:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784290256.497109:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784290256.497114:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290256.497115:0:84868:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1784290256.497121:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1784290256.497180:0:84868:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1784290256.497213:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784290256.497216:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290256.497217:0:84868:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1784290256.497222:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784290256.497225:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290256.497227:0:84868:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1784290256.497232:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784290256.497238:0:84868:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:00000080:0.0:1784290256.497261:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784290256.497269:0:84868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c247d26b380) 00000020:00000080:0.0:1784290256.497287:0:84868:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1784290256.497291:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784290256.497331:0:84868:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1784290256.497335:0:84868:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:0.0:1784290256.497379:0:84868:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b30732a4 00010000:00080000:0.0:1784290256.497442:0:84868:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c23458df800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:0.0:1784290256.499336:0:84868:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1784290256.500104:0:84868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784290256.500112:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1784290256.500143:0:84868:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784290256.500164:0:84868:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b30732ab 00000100:00080000:0.0:1784290256.500173:0:84868:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784290256.500179:0:84868:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c23458df800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290256.500217:0:84868:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c24483c8000 x1870961901009408/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784290256.500253:0:84868:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1784290256.500303:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901009408:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1784290256.500333:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:3.0:1784290256.500337:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000080:0.0:1784290256.500338:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290256.500342:0:84868:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000100:00080000:3.0:1784290256.500344:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784290256.500347:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784290256.500380:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 1994 00000020:01000000:0.0:1784290256.500380:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00080000:3.0:1784290256.500384:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000020:01000000:0.0:1784290256.500384:0:84868:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1784290256.500386:0:84868:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784290256.500390:0:84868:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784290256.500392:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000100:00080000:3.0:1784290256.500395:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000020:00000080:0.0:1784290256.500397:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290256.500401:0:84868:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784290256.500404:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784290256.500407:0:84868:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1784290256.500411:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290256.500414:0:84868:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000100:00100000:2.0:1784290256.500419:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1784290256.500420:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000100:00100000:3.0:1784290256.500421:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a42c000 x1870961901009536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:0.0:1784290256.500431:0:84868:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:01000000:0.0:1784290256.500455:0:84868:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784290256.500459:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784290256.500468:0:84868:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c247d268000) 00000020:00000080:0.0:1784290256.500485:0:84868:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000100:00080000:3.0:1784290256.500486:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784290256.500492:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000020:00000080:0.0:1784290256.500493:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1784290256.500495:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901009536:0@lo:38:kworker.0 00000100:00080000:3.0:1784290256.500499:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784290256.500503:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 1994 00000100:00080000:3.0:1784290256.500504:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784290256.500510:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290256.500513:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901009408 00000100:00100000:3.0:1784290256.500525:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a42ce00 x1870961901009792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784290256.500527:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901009408 00000100:00100000:2.0:1784290256.500539:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784290256.500567:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1784290256.500567:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901009792:0@lo:38:kworker.0 00000100:00080000:3.0:1784290256.500576:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000004:00080000:0.0:1784290256.500576:0:84868:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00000100:00080000:3.0:1784290256.500581:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00080000:01000000:0.0:1784290256.500584:0:84868:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000100:00080000:3.0:1784290256.500585:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 1994 00000100:00080000:3.0:1784290256.500603:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000020:00000080:0.0:1784290256.500606:0:84868:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b30732b9 00000100:00080000:3.0:1784290256.500617:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290256.500631:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3725 00000100:00100000:2.0:1784290256.500632:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290256.500638:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c247f98b480 x1870961901010048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:0.0:1784290256.500642:0:84868:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c23458de000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.106@tcp at head 00000100:00100000:1.0:1784290256.500652:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901009408:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784290256.500686:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784290256.500702:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1870961901009664:0@lo:400:kworker.0 00000100:00080000:3.0:1784290256.500708:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00080000:1.0:1784290256.500708:0:8413:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1997 last 0 00000100:00080000:3.0:1784290256.500727:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784290256.500730:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784290256.500736:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 1994 00000100:00080000:3.0:1784290256.500739:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1784290256.500742:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290256.500758:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c247f989c00 x1870961901010432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290256.500768:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290256.500785:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784290256.500795:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f98bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901010304:0@lo:400:kworker.0 00000020:00000080:1.0:1784290256.500805:0:8413:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b30732c0 00000100:00100000:2.0:1784290256.500829:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901009536 00000100:00100000:2.0:1784290256.500837:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901009536 00000100:00100000:3.0:1784290256.500841:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00100000:1.0:1784290256.500845:0:8413:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1784290256.500870:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901010304 00000100:00100000:2.0:1784290256.500873:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901009792 00000100:00100000:0.0:1784290256.500877:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901010304 00000100:00100000:2.0:1784290256.500879:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901009792 00000100:00100000:2.0:1784290256.500918:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901009664 00000100:00100000:2.0:1784290256.500923:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901009664 00000100:00100000:3.0:1784290256.500925:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:0.0:1784290256.500937:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:3.0:1784290256.500938:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901009536:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290256.500957:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901010304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290256.500973:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00080000:1.0:1784290256.500981:0:8413:0:(import.c:65:import_set_state_nolock()) ffff9c247f8f0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784290256.500993:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1870961901009664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290256.500995:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901009536:12345-0@lo:38:kworker.0 Request processed in 60us (461us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784290256.501004:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:3.0:1784290256.501028:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:0.0:1784290256.501032:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f988380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901010304:12345-0@lo:400:kworker.0 Request processed in 81us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290256.501039:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901009792:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290256.501043:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00080000:0.0:1784290256.501083:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784290256.501092:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784290256.501094:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1870961901009664:12345-0@lo:400:kworker.0 Request processed in 107us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290256.501108:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:1.0:1784290256.501126:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3616:x1870961901009408:12345-0@lo:38:llog_process_th.0 Request processed in 477us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290256.501140:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901009792:12345-0@lo:38:kworker.0 Request processed in 92us (509us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784290256.501150:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f98bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901010304:0@lo:400:kworker.0 00000100:00100000:1.0:1784290256.501161:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3725 00000100:00100000:3.0:1784290256.501163:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00100000:2.0:1784290256.501172:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1870961901009664:0@lo:400:kworker.0 00000100:00100000:3.0:1784290256.501223:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901010176:0@lo:400:kworker.0 00000100:00100000:1.0:1784290256.501250:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1870961901009920:0@lo:400:kworker.0 00000100:00100000:3.0:1784290256.501306:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784290256.501324:0:84868:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:1.0:1784290256.501365:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290256.501437:0:26251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901010176 00000100:00100000:2.0:1784290256.501442:0:26251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901010176 00000100:00080000:0.0:1784290256.501484:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784290256.501489:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901010048:0@lo:38:kworker.0 00000100:00100000:0.0:1784290256.501530:0:15642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00100000:3.0:1784290256.501545:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290256.501553:0:15642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901010176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290256.501609:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901010432:0@lo:38:kworker.0 00000100:00100000:0.0:1784290256.501647:0:15642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901010176:12345-0@lo:400:kworker.0 Request processed in 105us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290256.501655:0:15642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00100000:2.0:1784290256.501670:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901010176:0@lo:400:kworker.0 00000100:00100000:3.0:1784290256.501690:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901010048 00000100:00100000:3.0:1784290256.501695:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901010048 00000100:00100000:3.0:1784290256.501726:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3726 00000100:00100000:3.0:1784290256.501733:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f98a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901010048:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784290256.501758:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901009920 00000100:00100000:1.0:1784290256.501769:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901009920 00000100:00100000:3.0:1784290256.501771:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f98a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901010048:12345-0@lo:38:kworker.0 Request processed in 39us (234us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784290256.501782:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3726 00000100:00100000:3.0:1784290256.501809:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784290256.501823:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784290256.501858:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1784290256.501862:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901010432 00000100:00080000:3.0:1784290256.501863:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784290256.501868:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901009792:0@lo:38:kworker.0 00000100:00100000:2.0:1784290256.501877:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901010432 00000100:00100000:1.0:1784290256.501877:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00080000:3.0:1784290256.501882:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784290256.501892:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784290256.501895:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901009536:0@lo:38:kworker.0 00000100:00100000:1.0:1784290256.501906:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1870961901009920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290256.501911:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:2.0:1784290256.501921:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00080000:3.0:1784290256.501922:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00100000:2.0:1784290256.501929:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f98b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901010432:12345-0@lo:38:kworker.0 00000100:00080000:3.0:1784290256.501933:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1784290256.501939:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1784290256.501942:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c23458df800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784290256.501957:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901009408:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1784290256.502002:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1784290256.502008:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f98b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901010432:12345-0@lo:38:kworker.0 Request processed in 77us (195us total) trans 0 rc -11/-11 00000100:00080000:3.0:1784290256.502017:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784290256.502028:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:3.0:1784290256.502029:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f98b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901010048:0@lo:38:kworker.0 00000100:00100000:1.0:1784290256.502030:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1870961901009920:12345-0@lo:400:kworker.0 Request processed in 125us (664us total) trans 0 rc 0/0 00000100:00080000:3.0:1784290256.502076:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1784290256.502085:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00080000:3.0:1784290256.502091:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784290256.502097:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901010432:0@lo:38:kworker.0 00000100:00100000:1.0:1784290256.502176:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1870961901009920:0@lo:400:kworker.0 00000100:00100000:2.0:1784290256.502197:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784290256.502212:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901010560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784290256.502250:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:0.0:1784290256.502272:0:84868:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784290256.502294:0:84868:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1784290256.502303:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901010560 00000100:00100000:1.0:1784290256.502310:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901010560 00000100:00100000:2.0:1784290256.502397:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3727 00000100:00100000:2.0:1784290256.502416:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901010560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784290256.502438:0:23867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:2.0:1784290256.502471:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901010560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290256.502477:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3727 00000100:00100000:0.0:1784290256.502524:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901010560:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1784290256.502558:0:84868:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 21, last_idx 22 00000040:00080000:2.0:1784290256.503021:0:84868:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784290256.503041:0:84868:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].23, 64 off9664 00000040:00080000:2.0:1784290256.505387:0:84868:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5c:0x0].1, 64 off8256 00000040:00080000:1.0:1784290256.505840:0:84874:0:(llog.c:805:llog_process_thread()) index: 22, lh_last_idx: 23 synced_idx: 0 lgh_last_idx: 23 00000040:00080000:1.0:1784290256.505847:0:84874:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x58:0x0] at index 22 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1784290256.506042:0:84874:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000040:00080000:1.0:1784290256.506095:0:84874:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x58:0x0] at index 22 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1784290256.506371:0:84874:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 23 synced_idx: 23 lgh_last_idx: 23 00000020:00000080:0.0:1784290256.506399:0:84868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784290256.506411:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000040:00080000:1.0:1784290256.506421:0:84874:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000004:01000000:0.0:1784290256.506443:0:84868:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784290256.506456:0:84868:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b30732c7 00000100:00080000:0.0:1784290256.506462:0:84868:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784290256.506465:0:84868:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c23458de000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290256.506480:0:84868:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c24483ca680 x1870961901010688/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784290256.506499:0:84868:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1784290256.506552:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784290256.506557:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290256.506559:0:84868:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784290256.506573:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784290256.506576:0:84868:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1784290256.506578:0:84868:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784290256.506581:0:84868:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784290256.506605:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000100:00100000:3.0:1784290256.506606:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901010688:0@lo:8:llog_process_th.0 00000020:00000080:0.0:1784290256.506610:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290256.506614:0:84868:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784290256.506617:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784290256.506620:0:84868:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1784290256.506625:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290256.506626:0:84868:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1784290256.506641:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784290256.506644:0:84868:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000100:00100000:3.0:1784290256.506659:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1784290256.506659:0:84868:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784290256.506665:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784290256.506674:0:84868:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c247d2699c0) 00000020:00000080:0.0:1784290256.506686:0:84868:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1784290256.506691:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1784290256.506724:0:26254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901010688 00000100:00100000:1.0:1784290256.506732:0:26254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901010688 00000004:00080000:0.0:1784290256.506762:0:84868:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1784290256.506767:0:84868:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:0.0:1784290256.506773:0:84868:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b30732d5 00000100:00100000:1.0:1784290256.506789:0:26254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4899 00000100:00100000:1.0:1784290256.506802:0:26254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f98b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3616:x1870961901010688:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1784290256.506807:0:84868:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c23454bd000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00080000:1.0:1784290256.506840:0:26254:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1997 last 0 00000020:00000080:1.0:1784290256.506874:0:26254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b30732dc 00002000:00100000:1.0:1784290256.506885:0:26254:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c247f8f6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ad ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1784290256.506889:0:26254:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1784290256.506894:0:26254:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1784290256.506965:0:26254:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784290256.506991:0:26254:0:(import.c:65:import_set_state_nolock()) ffff9c247f8f4000 : changing import state from RECOVER to FULL 00010000:00010000:0.0:1784290256.507019:0:84868:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:0.0:1784290256.507078:0:84868:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784290256.507089:0:84868:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1784290256.507091:0:26254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f98b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3616:x1870961901010688:12345-0@lo:8:llog_process_th.0 Request processed in 288us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290256.507107:0:26254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4899 00000100:00100000:3.0:1784290256.507149:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784290256.507157:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784290256.507162:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784290256.507166:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1784290256.507169:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c23458de000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784290256.507186:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784290256.507192:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901010688:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1784290256.507212:0:84874:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1784290256.507268:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784290256.507284:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901010816:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1784290256.507291:0:84874:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1997746948614ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784290256.507304:0:84874:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1784290256.507329:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290256.507389:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901010816 00000100:00100000:0.0:1784290256.507395:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901010816 00000100:00080000:1.0:1784290256.507450:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784290256.507471:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:0.0:1784290256.507480:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901010816:12345-0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1784290256.507493:0:84868:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 21, last_idx 22 00002000:00000024:0.0:1784290256.507501:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290256.507544:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901010816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290256.507551:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00100000:2.0:1784290256.507575:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901010816:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1784290256.508407:0:84868:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1784290256.508416:0:84858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:2.0:1784290256.508428:0:84868:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].23, 64 off9664 00000040:00080000:2.0:1784290256.508514:0:84868:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5e:0x0].1, 64 off8256 00000040:00080000:1.0:1784290256.508792:0:84876:0:(llog.c:805:llog_process_thread()) index: 22, lh_last_idx: 23 synced_idx: 0 lgh_last_idx: 23 00000040:00080000:1.0:1784290256.508799:0:84876:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5a:0x0] at index 22 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1784290256.509196:0:84868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784290256.509209:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784290256.509234:0:84868:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784290256.509247:0:84868:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b30732e3 00000100:00080000:0.0:1784290256.509252:0:84868:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784290256.509255:0:84868:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c23454bd000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290256.509270:0:84868:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c24483cad80 x1870961901010944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784290256.509301:0:84868:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1784290256.509329:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901010944:0@lo:8:llog_process_th.0 00000020:01000000:0.0:1784290256.509396:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784290256.509403:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290256.509406:0:84868:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784290256.509412:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784290256.509416:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290256.509418:0:84868:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000100:00100000:3.0:1784290256.509424:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1784290256.509425:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784290256.509429:0:84868:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784290256.509432:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784290256.509434:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290256.509435:0:84868:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784290256.509437:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784290256.509439:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290256.509440:0:84868:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784290256.509444:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784290256.509469:0:26261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901010944 00000100:00100000:1.0:1784290256.509480:0:26261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901010944 00000100:00100000:0.0:1784290256.509480:0:84868:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:84868:1870961901011072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290256.509531:0:26261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4900 00000100:00100000:1.0:1784290256.509542:0:26261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3616:x1870961901010944:12345-0@lo:8:llog_process_th.0 00000100:00100000:0.0:1784290256.509561:0:84868:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784290256.509567:0:26261:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 1997 last 0 00000020:00000080:1.0:1784290256.509613:0:26261:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b30732ea 00002000:00100000:1.0:1784290256.509634:0:26261:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c246ff98000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ad ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:0.0:1784290256.509636:0:84868:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24582e9780 going to sleep for 11 seconds 00000100:00100000:3.0:1784290256.509638:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901011072 00002000:00080000:1.0:1784290256.509641:0:26261:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000100:00100000:3.0:1784290256.509647:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901011072 00002000:00100000:1.0:1784290256.509648:0:26261:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1784290256.509694:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784290256.509702:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:84868:x1870961901011072:12345-0@lo:502:llog_process_th.0 00002000:00080000:1.0:1784290256.509734:0:26261:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784290256.509778:0:26261:0:(import.c:65:import_set_state_nolock()) ffff9c2344981000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784290256.509836:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:84868:x1870961901011072:12345-0@lo:502:llog_process_th.0 Request processed in 128us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290256.509853:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784290256.509875:0:84868:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:84868:1870961901011072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290256.509895:0:26261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f988a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3616:x1870961901010944:12345-0@lo:8:llog_process_th.0 Request processed in 338us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290256.509910:0:26261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4900 00000020:01000000:0.0:1784290256.509938:0:84868:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:2.0:1784290256.509939:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000020:00000080:0.0:1784290256.509944:0:84868:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290256.509947:0:84868:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000100:00080000:2.0:1784290256.509952:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784290256.509961:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000040:00080000:0.0:1784290256.509961:0:84868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00080000:2.0:1784290256.509968:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784290256.509972:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c23454bd000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784290256.509987:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784290256.509995:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901010944:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1784290256.510035:0:84857:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 00000100:00100000:3.0:1784290256.510059:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 10000000:01000000:2.0:1784290256.510066:0:84857:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:1.0:1784290256.510074:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784290256.510085:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901011200:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784290256.510086:0:84857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440030200/0x5953bbf6b307323b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073242 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290256.510095:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901011328:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1784290256.510118:0:84857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2440030200/0x5953bbf6b307323b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073242 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290256.510127:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1784290256.510129:0:84857:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9c2469a70000 from 1 10000000:01000000:2.0:1784290256.510133:0:84857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000040:00080000:0.0:1784290256.510135:0:84876:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5a:0x0] index 3 count 2 00000040:00080000:0.0:1784290256.510172:0:84876:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 23 synced_idx: 23 lgh_last_idx: 23 00010000:00010000:2.0:1784290256.510175:0:84857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b30732f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784290256.510176:0:84876:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1784290256.510203:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1784290256.510205:0:84876:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:2.0:1784290256.510215:0:84857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b30732f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290256.510226:0:84857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b30732f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290256.510247:0:84857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901011456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784290256.510263:0:26259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901011328 00000004:00080000:0.0:1784290256.510264:0:84876:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1997749921819ns, next at 0ns, rc = 0 00000100:00100000:3.0:1784290256.510271:0:26259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901011328 00080000:00080000:0.0:1784290256.510273:0:84876:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1784290256.510297:0:84857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784290256.510331:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784290256.510336:0:26259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4901 00000100:00100000:2.0:1784290256.510337:0:84857:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c3a300 going to sleep for 11 seconds 00000100:00100000:0.0:1784290256.510383:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901011200 00000100:00100000:3.0:1784290256.510384:0:26259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901011328:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784290256.510391:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901011200 00002000:00080000:3.0:1784290256.510409:0:26259:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:1666 count 1 00000100:00100000:0.0:1784290256.510438:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1784290256.510447:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f98b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1870961901011200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784290256.510472:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290256.510499:0:26259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+7:3620:x1870961901011328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 117us (315us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784290256.510508:0:26259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4901 00000004:00080000:2.0:1784290256.510529:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c2347d67800, transno 0 00000100:00100000:3.0:1784290256.510541:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901011456 00000004:00080000:2.0:1784290256.510541:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c2347d67800/1, rc -2, transno 0 00000100:00100000:0.0:1784290256.510542:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f98b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901011200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290256.510547:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901011456 00000100:00100000:0.0:1784290256.510555:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:2.0:1784290256.510568:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901011328:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784290256.510606:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784290256.510615:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:84857:x1870961901011456:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784290256.510633:0:84865:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1784290256.510642:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901011200:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784290256.510653:0:84865:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b30732f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30732f1 expref: -99 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.510674:0:84865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b30732f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30732f1 expref: 9 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.510685:0:84865:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b30732f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30732f1 expref: 9 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.510694:0:84865:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebe800, rc 0) 00000100:00100000:3.0:1784290256.510734:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:84857:x1870961901011456:12345-0@lo:101:mount.lustre.0 Request processed in 119us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290256.510745:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000040:00080000:0.0:1784290256.510754:0:84876:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000100:00100000:2.0:1784290256.510760:0:84857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901011456:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784290256.510777:0:84857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b30732f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30732f8 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290256.510785:0:84857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b30732f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30732f8 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784290256.511133:0:84876:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x5a:0x0] at index 22 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1784290256.511385:0:84857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901011584:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1784290256.511438:0:84857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290256.511468:0:84857:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c3a300 going to sleep for 11 seconds 00000100:00100000:3.0:1784290256.511522:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901011584 00000100:00100000:3.0:1784290256.511528:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901011584 00000100:00100000:3.0:1784290256.511569:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784290256.511579:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:84857:x1870961901011584:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1784290256.511609:0:84864:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1784290256.511627:0:84864:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784290256.511631:0:84864:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784290256.511634:0:84864:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784290256.511637:0:84864:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 103 00000100:00100000:3.0:1784290256.511725:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:84857:x1870961901011584:12345-0@lo:256:mount.lustre.0 Request processed in 149us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290256.511734:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784290256.511742:0:84857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901011584:0@lo:256:mount.lustre.0 00000004:00080000:1.0:1784290256.512023:0:84858:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 10000000:01000000:2.0:1784290256.512407:0:84857:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784290256.512421:0:84857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b30732f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30732f8 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290256.512428:0:84857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b30732f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30732f8 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290256.512434:0:84857:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c2469a70000 from 1 10000000:01000000:2.0:1784290256.512436:0:84857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784290256.512450:0:84857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30732ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290256.512455:0:84857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30732ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290256.512469:0:84857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30732ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290256.512479:0:84857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901011712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784290256.512501:0:84857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290256.512521:0:84857:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c3a300 going to sleep for 11 seconds 00000100:00100000:3.0:1784290256.512576:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901011712 00000100:00100000:3.0:1784290256.512582:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901011712 00000100:00100000:3.0:1784290256.512642:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784290256.512648:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:84857:x1870961901011712:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784290256.512656:0:84865:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290256.512663:0:84865:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b3073306 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30732ff expref: -99 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.512676:0:84865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b3073306 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30732ff expref: 10 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.512683:0:84865:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b3073306 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30732ff expref: 10 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.512688:0:84865:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebee00, rc 0) 00000100:00100000:3.0:1784290256.512719:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474482c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:84857:x1870961901011712:12345-0@lo:101:mount.lustre.0 Request processed in 71us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290256.512733:0:84857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901011712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784290256.512737:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1784290256.512748:0:84857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30732ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073306 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290256.512756:0:84857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30732ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073306 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290256.512793:0:84857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901011840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784290256.512812:0:84857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290256.512826:0:84857:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c3a300 going to sleep for 11 seconds 00000100:00100000:3.0:1784290256.512846:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901011840 00000100:00100000:3.0:1784290256.512850:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901011840 00000100:00100000:3.0:1784290256.512873:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784290256.512878:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:84857:x1870961901011840:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784290256.512953:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474481050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:84857:x1870961901011840:12345-0@lo:501:mount.lustre.0 Request processed in 74us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290256.512960:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784290256.512966:0:84857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901011840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784290256.512991:0:84857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901011968:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784290256.513022:0:84857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290256.513037:0:84857:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c3a300 going to sleep for 11 seconds 00000100:00100000:3.0:1784290256.513046:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901011968 00000100:00100000:3.0:1784290256.513049:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901011968 00000100:00100000:3.0:1784290256.513070:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784290256.513076:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:84857:x1870961901011968:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784290256.513143:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474482050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:84857:x1870961901011968:12345-0@lo:503:mount.lustre.0 Request processed in 67us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290256.513150:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784290256.513157:0:84857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901011968:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784290256.513391:0:84878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:84878:1870961901012096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290256.513427:0:84878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290256.513452:0:84878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24582e99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290256.513487:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901012096 00000100:00100000:3.0:1784290256.513494:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901012096 00000100:00100000:3.0:1784290256.513528:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784290256.513552:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:84878:x1870961901012096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290256.513835:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474482850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:84878:x1870961901012096:12345-0@lo:502:llog_process_th.0 Request processed in 299us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290256.513840:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784290256.513875:0:84878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:84878:1870961901012096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784290256.513894:0:84878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784290256.513899:0:84878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290256.513901:0:84878:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784290256.513905:0:84878:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c2469a70000 00000020:00000080:0.0:1784290256.513907:0:84878:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784290256.513917:0:84878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784290256.513918:0:84878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290256.513919:0:84878:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1784290256.513921:0:84878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784290256.513923:0:84878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290256.513924:0:84878:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784290256.513926:0:84878:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c2469a70000 00000020:00000080:0.0:1784290256.513928:0:84878:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784290256.513977:0:84878:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:84878:1870961901012224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290256.514007:0:84878:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290256.514024:0:84878:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244133a000 going to sleep for 11 seconds 00000100:00100000:3.0:1784290256.514033:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901012224 00000100:00100000:3.0:1784290256.514038:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901012224 00000100:00100000:3.0:1784290256.514066:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784290256.514071:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:84878:x1870961901012224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290256.514132:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474483450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:84878:x1870961901012224:12345-0@lo:502:llog_process_th.0 Request processed in 60us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290256.514140:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784290256.514155:0:84878:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:84878:1870961901012224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784290256.514179:0:84878:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784290256.514183:0:84878:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290256.514185:0:84878:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1784290256.514188:0:84878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784290256.514425:0:84857:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1784290256.514485:0:84857:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784290256.514522:0:84857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30732ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073306 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.514544:0:84857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30732ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073306 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290256.514692:0:84857:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784290256.514699:0:84857:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c2469a70000 10000000:01000000:1.0:1784290256.514706:0:84857:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c2469a70000 10000000:01000000:1.0:1784290256.514716:0:84857:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784290256.514726:0:84857:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c2469a70000 from 1 10000000:01000000:1.0:1784290256.514731:0:84857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784290256.514781:0:84857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440031800/0x5953bbf6b307330d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.514800:0:84857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2440031800/0x5953bbf6b307330d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.514818:0:84857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2440031800/0x5953bbf6b307330d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290256.514871:0:84857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d64700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901012352:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784290256.514933:0:84857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290256.514998:0:84857:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341e0f840 going to sleep for 11 seconds 00000100:00100000:3.0:1784290256.515007:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901012352 00000100:00100000:3.0:1784290256.515013:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901012352 00000100:00100000:3.0:1784290256.515046:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784290256.515052:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:84857:x1870961901012352:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784290256.515058:0:84864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290256.515067:0:84864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3073314 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307330d expref: -99 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.515080:0:84864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3073314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307330d expref: 11 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.515087:0:84864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3073314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307330d expref: 11 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.515092:0:84864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebea00, rc 0) 00000100:00100000:3.0:1784290256.515155:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474480850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:84857:x1870961901012352:12345-0@lo:101:mount.lustre.0 Request processed in 104us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290256.515161:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784290256.515205:0:84857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d64700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901012352:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784290256.515237:0:84857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2440031800/0x5953bbf6b307330d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073314 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290256.515259:0:84857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2440031800/0x5953bbf6b307330d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073314 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290256.515435:0:84857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d64700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901012480:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784290256.515498:0:84857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290256.515573:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901012480 00000100:00100000:3.0:1784290256.515582:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901012480 00000100:00100000:1.0:1784290256.515613:0:84857:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341e0f840 going to sleep for 11 seconds 00000100:00100000:3.0:1784290256.515651:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784290256.515661:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:84857:x1870961901012480:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784290256.515736:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474480450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:84857:x1870961901012480:12345-0@lo:501:mount.lustre.0 Request processed in 76us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290256.515750:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784290256.515771:0:84857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d64700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901012480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784290256.515805:0:84857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901012608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784290256.515848:0:84857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290256.515867:0:84857:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343b943c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290256.515872:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901012608 00000100:00100000:3.0:1784290256.515877:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901012608 00000100:00100000:3.0:1784290256.515899:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784290256.515905:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:84857:x1870961901012608:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784290256.515993:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474483c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:84857:x1870961901012608:12345-0@lo:503:mount.lustre.0 Request processed in 87us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290256.516003:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784290256.516047:0:84857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901012608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784290256.516249:0:84880:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:84880:1870961901012736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290256.516282:0:84880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290256.516298:0:84880:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343b94240 going to sleep for 11 seconds 00000100:00100000:3.0:1784290256.516305:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901012736 00000100:00100000:3.0:1784290256.516310:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901012736 00000100:00100000:3.0:1784290256.516333:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784290256.516363:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:84880:x1870961901012736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290256.516435:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474483850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:84880:x1870961901012736:12345-0@lo:502:llog_process_th.0 Request processed in 96us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290256.516442:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784290256.516453:0:84880:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:84880:1870961901012736:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1784290256.516496:0:84880:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1784290256.516505:0:84880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c2445c13380) 00000020:00000080:2.0:1784290256.516519:0:84880:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1784290256.516641:0:84880:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c2469a70000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784290256.516645:0:84880:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2469a70000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784290256.516647:0:84880:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c2469a70000 4 00010000:00080000:2.0:1784290256.516672:0:84880:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c246d58b000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:2.0:1784290256.518400:0:84880:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1784290256.518461:0:84880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1784290256.518484:0:84880:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784290256.518491:0:84880:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5953bbf6b3073322 00000100:00080000:2.0:1784290256.518496:0:84880:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784290256.518500:0:84880:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c246d58b000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290256.518516:0:84880:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a42c000 x1870961901012864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784290256.518533:0:84880:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784290256.518550:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901012864:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784290256.518612:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290256.518684:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901012864 00000100:00100000:2.0:1784290256.518688:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901012864 00000100:00100000:2.0:1784290256.518725:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:2.0:1784290256.518731:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f98aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901012864:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784290256.518793:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f98aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901012864:12345-0@lo:38:llog_process_th.0 Request processed in 59us (179us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784290256.518801:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00100000:3.0:1784290256.518810:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784290256.518816:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246d58b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784290256.518823:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784290256.518829:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901012864:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784290256.518907:0:84880:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:84880:1870961901012992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290256.518948:0:84880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290256.518971:0:84880:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343b94240 going to sleep for 11 seconds 00000100:00100000:3.0:1784290256.518973:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901012992 00000100:00100000:3.0:1784290256.518978:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901012992 00000100:00100000:3.0:1784290256.519020:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784290256.519034:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:84880:x1870961901012992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290256.519116:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474481850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:84880:x1870961901012992:12345-0@lo:502:llog_process_th.0 Request processed in 88us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290256.519123:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784290256.519133:0:84880:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:84880:1870961901012992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290256.519199:0:84880:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:84880:1870961901013120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290256.519246:0:84880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290256.519264:0:84880:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343b94240 going to sleep for 11 seconds 00000100:00100000:3.0:1784290256.519271:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901013120 00000100:00100000:3.0:1784290256.519276:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901013120 00000100:00100000:3.0:1784290256.519301:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784290256.519311:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:84880:x1870961901013120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290256.519412:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474481450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:84880:x1870961901013120:12345-0@lo:502:llog_process_th.0 Request processed in 100us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290256.519419:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784290256.519444:0:84880:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:84880:1870961901013120:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784290256.519480:0:84880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1784290256.519561:0:84857:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1784290256.519612:0:84857:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290256.519626:0:84857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440031800/0x5953bbf6b307330d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073314 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.519634:0:84857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2440031800/0x5953bbf6b307330d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073314 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784290256.519673:0:84857:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784290256.519675:0:84857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784290256.519676:0:84857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784290256.519678:0:84857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784290256.519679:0:84857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784290256.519679:0:84857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784290256.519681:0:84857:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784290256.519682:0:84857:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784290256.519683:0:84857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784290256.519684:0:84857:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784290256.519687:0:84857:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1784290256.519689:0:84857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784290256.519690:0:84857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784290256.519697:0:84857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784290256.519699:0:84857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784290256.519700:0:84857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784290256.519702:0:84857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784290256.519703:0:84857:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784290256.519705:0:84857:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784290256.519707:0:84857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784290256.519709:0:84857:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784290256.519723:0:84857:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784290256.519731:0:84857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f988e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901013248:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784290256.519758:0:84857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290256.519803:0:84857:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a016780 going to sleep for 11 seconds 00000100:00100000:2.0:1784290256.519821:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901013248 00000100:00100000:2.0:1784290256.519828:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901013248 00000100:00100000:2.0:1784290256.519880:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784290256.519890:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:84857:x1870961901013248:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784290256.519906:0:84864:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784290256.519914:0:84864:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784290256.521179:0:84864:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784290256.521189:0:84864:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1784290256.521202:0:84866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784290256.521206:0:84866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784290256.521218:0:84866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073329 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.521228:0:84866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b30732f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30732f1 expref: 11 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.521234:0:84866:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073329 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.521255:0:84866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b30732f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b30732f1 expref: 11 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.521265:0:84866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b30732f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b30732f1 expref: 11 pid: 84865 timeout: 2097 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290256.521272:0:84866:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:84866:1870961901013376:0@lo:104: 00000100:00100000:3.0:1784290256.521313:0:84866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290256.521372:0:84866:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a0163c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290256.521396:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474481c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:84857:x1870961901013248:12345-0@lo:253:mount.lustre.0 Request processed in 1506us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290256.521406:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784290256.521407:0:6472:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784290256.521426:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901013376 00000100:00100000:0.0:1784290256.521429:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901013376 00000100:00100000:2.0:1784290256.521462:0:84857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f988e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:84857:1870961901013248:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784290256.521473:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 10000000:01000000:2.0:1784290256.521475:0:84857:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000100:00100000:0.0:1784290256.521484:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a473450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:84866:x1870961901013376:12345-0@lo:104: 00000020:01000004:2.0:1784290256.521486:0:84857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784290256.521491:0:84857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784290256.521493:0:84857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784290256.521495:0:84857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784290256.521497:0:84857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:0.0:1784290256.521497:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b30732f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b30732f8 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784290256.521498:0:84857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784290256.521501:0:84857:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784290256.521503:0:84857:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784290256.521506:0:84857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784290256.521508:0:84857:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784290256.521522:0:84857:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1784290256.521566:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784290256.521567:0:84866:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:84866:1870961901013376:0@lo:104: 00000100:00100000:0.0:1784290256.521572:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a473450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:84866:x1870961901013376:12345-0@lo:104: Request processed in 93us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290256.521582:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00010000:00010000:3.0:1784290256.521611:0:84866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073329 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290256.521646:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290256.521652:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b30732f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b30732f8 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290256.521667:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa600 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:0.0:1784290256.521670:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b30732f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b30732f8 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290256.521678:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b30732f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b30732f8 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290256.521684:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b30732f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b30732f8 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290256.521689:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784290256.521717:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b30732f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30732f8 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290256.521723:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784290256.521742:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b30732f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30732f8 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290256.521748:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b30732f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30732f8 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290256.521751:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901013504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290256.521769:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290256.521776:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290256.521778:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290256.521797:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290256.521843:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901013504 00000100:00100000:0.0:1784290256.521848:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901013504 00010000:00010000:0.0:1784290256.521875:0:19592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b30732f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b30732f1 expref: 11 pid: 84865 timeout: 2097 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290256.521905:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:0.0:1784290256.521927:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f989880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:3620:x1870961901013504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290256.521937:0:19592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290256.521942:0:19592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b30732f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b30732f1 expref: 11 pid: 84865 timeout: 2097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290256.521953:0:19592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b30732f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b30732f1 expref: 11 pid: 84865 timeout: 2097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290256.521964:0:19592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b30732f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b30732f1 expref: 11 pid: 84865 timeout: 2097 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290256.521977:0:19592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073329 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290256.521983:0:19592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073329 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784290256.521992:0:19592:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000786810s 00010000:00010000:0.0:1784290256.521995:0:19592:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073329 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290256.522000:0:19592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073329 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290256.522006:0:19592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073329 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290256.522011:0:19592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073329 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290256.522015:0:19592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290256.522030:0:19592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073329 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290256.522036:0:19592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073329 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290256.522050:0:19592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073329 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290256.522063:0:19592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290256.522066:0:84866:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073329 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.522074:0:84866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073329 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290256.522079:0:84866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073329 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 84866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290256.522102:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f989880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:3620:x1870961901013504:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290256.522110:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00000100:00100000:0.0:1784290256.522142:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901013504:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1784290256.525992:0:84857:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444064 00000040:01000000:3.0:1784290256.526283:0:84857:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1784290256.526304:0:84886:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444064 00000020:00080000:1.0:1784290256.526312:0:84886:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444064 00000040:01000000:1.0:1784290256.526532:0:84887:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784290256.526533:0:84857:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1784290256.526658:0:84887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784290256.526816:0:84888:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:84888:1870961901013632:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784290256.526851:0:84888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290256.526875:0:84888:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234310b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290256.526883:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901013632 00000100:00100000:2.0:1784290256.526889:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901013632 00000100:00100000:2.0:1784290256.526928:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3728 00000100:00100000:2.0:1784290256.526938:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:84888:x1870961901013632:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784290256.527012:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:84888:x1870961901013632:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 77us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290256.527020:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3728 00000100:00100000:3.0:1784290256.527036:0:84888:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:84888:1870961901013632:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1784290256.527039:0:84857:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:01000000:3.0:1784290256.527058:0:84888:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1784290256.527077:0:84857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784290256.527082:0:84888:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:84888:1870961901013760:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784290256.527109:0:84888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290256.527128:0:84888:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234310bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1784290256.528318:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901013760 00000100:00100000:2.0:1784290256.528322:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901013760 00000100:00100000:2.0:1784290256.528384:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3729 00000100:00100000:2.0:1784290256.528394:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f98bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:84888:x1870961901013760:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784290256.528476:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f98bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:84888:x1870961901013760:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 85us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290256.528481:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3729 00000100:00100000:2.0:1784290256.529424:0:84888:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:84888:1870961901013760:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784290256.529477:0:84888:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42d180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:84888:1870961901013888:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784290256.529501:0:84888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290256.529517:0:84888:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474cf8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784290256.529533:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901013888 00000100:00100000:3.0:1784290256.529537:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901013888 00000100:00100000:3.0:1784290256.529568:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3730 00000100:00100000:3.0:1784290256.529581:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:84888:x1870961901013888:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784290256.529643:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:84888:x1870961901013888:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 63us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290256.529648:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3730 00000100:00100000:2.0:1784290256.530398:0:84888:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42d180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:84888:1870961901013888:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1784290256.530441:0:84888:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1784290256.535851:0:84857:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1784290256.535875:0:84857:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1784290256.535922:0:84857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784290256.570981:0:84887:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784290256.571075:0:84887:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1784290256.572423:0:84857:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1784290256.577170:0:84888:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400090a3:0x1:0x0] index 261376 count 1 00000040:00080000:0.0:1784290256.577216:0:84857:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000004:00080000:2.0:1784290256.577222:0:84888:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1784290256.577228:0:84888:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1784290256.577263:0:84857:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1784290256.577393:0:84857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1784290256.577833:0:84857:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4a:0x0] (8/32) registered 00010000:00080000:0.0:1784290256.579049:0:84857:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 94489280513 00010000:00080000:0.0:1784290256.579623:0:84889:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 84889 00010000:02000000:0.0:1784290256.579633:0:84889:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:3.0:1784290256.579699:0:84857:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784290256.579714:0:84857:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784290256.579740:0:84857:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1784290256.579755:0:84857:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1784290256.580969:0:84857:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784290256.581207:0:84857:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:0.0:1784290256.583563:0:84889:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1784290256.583570:0:84889:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:2.0:1784290257.448547:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784290257.575468:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784290257.575476:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9c2469a70000 from 104 10000000:01000000:1.0:1784290257.575482:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784290257.575541:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440030000/0x5953bbf6b3073330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290257.575554:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2440030000/0x5953bbf6b3073330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290257.575599:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2440030000/0x5953bbf6b3073330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290257.575637:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901014016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290257.575730:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290257.575794:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901014016 00000100:00100000:1.0:1784290257.575800:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341e0f600 going to sleep for 11 seconds 00000100:00100000:3.0:1784290257.575807:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901014016 00000100:00100000:3.0:1784290257.575862:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784290257.575870:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2458bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:6485:x1870961901014016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290257.575884:0:84865:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290257.575901:0:84865:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073337 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073330 expref: -99 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.575925:0:84865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073330 expref: 11 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.575933:0:84865:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073330 expref: 11 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.575941:0:84865:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebf800, rc 0) 00000100:00100000:3.0:1784290257.576004:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2458bf3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901014016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290257.576009:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784290257.576068:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901014016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290257.576091:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2440030000/0x5953bbf6b3073330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073337 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290257.576103:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2440030000/0x5953bbf6b3073330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073337 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290257.576158:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901014144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784290257.576205:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290257.576230:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341e0f600 going to sleep for 11 seconds 00000100:00100000:3.0:1784290257.576266:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901014144 00000100:00100000:3.0:1784290257.576281:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901014144 00000100:00100000:3.0:1784290257.576315:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784290257.576323:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244535dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901014144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784290257.576362:0:84864:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784290257.576379:0:84864:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784290257.576382:0:84864:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 104 00000100:00100000:3.0:1784290257.576466:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244535dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901014144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290257.576472:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784290257.576487:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901014144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784290257.576545:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784290257.576551:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440030000/0x5953bbf6b3073330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073337 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290257.576558:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2440030000/0x5953bbf6b3073330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073337 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290257.576565:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784290257.576567:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c23452c5000 from 52 10000000:01000000:1.0:1784290257.576573:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784290257.576600:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440030400/0x5953bbf6b307333e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290257.576605:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2440030400/0x5953bbf6b307333e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290257.576611:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2440030400/0x5953bbf6b307333e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290257.576620:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901014272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290257.576646:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290257.576666:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341e0f600 going to sleep for 11 seconds 00000100:00100000:3.0:1784290257.576697:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901014272 00000100:00100000:3.0:1784290257.576704:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901014272 00000100:00100000:3.0:1784290257.576735:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784290257.576742:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901014272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290257.576750:0:84865:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290257.576759:0:84865:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebf400/0x5953bbf6b3073345 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307333e expref: -99 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.576773:0:84865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebf400/0x5953bbf6b3073345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307333e expref: 12 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.576783:0:84865:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebf400/0x5953bbf6b3073345 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307333e expref: 12 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.576791:0:84865:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebf400, rc 0) 00000100:00100000:3.0:1784290257.576831:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445779850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901014272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290257.576838:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784290257.576879:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901014272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290257.576894:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2440030400/0x5953bbf6b307333e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073345 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290257.576903:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2440030400/0x5953bbf6b307333e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073345 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290257.576962:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901014400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290257.576985:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290257.577000:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341e0f600 going to sleep for 11 seconds 00000100:00100000:3.0:1784290257.577036:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901014400 00000100:00100000:3.0:1784290257.577042:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901014400 00000100:00100000:3.0:1784290257.577083:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784290257.577090:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901014400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.577215:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445778850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901014400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290257.577224:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784290257.577247:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901014400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290257.577274:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901014528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290257.577315:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290257.577330:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341e0f600 going to sleep for 11 seconds 00000100:00100000:3.0:1784290257.577368:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901014528 00000100:00100000:3.0:1784290257.577374:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901014528 00000100:00100000:3.0:1784290257.577405:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784290257.577412:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901014528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.577508:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901014528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290257.577518:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784290257.577526:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901014528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784290257.578332:0:84992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1784290257.578452:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1784290257.578493:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290257.578501:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440030400/0x5953bbf6b307333e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073345 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.578509:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2440030400/0x5953bbf6b307333e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073345 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290257.578517:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784290257.578519:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9c23452c5000 from 101 10000000:01000000:3.0:1784290257.578521:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784290257.578549:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe400/0x5953bbf6b307334c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.578557:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe400/0x5953bbf6b307334c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.578596:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe400/0x5953bbf6b307334c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.578619:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901014656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.578657:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290257.578698:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.578716:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901014656 00000100:00100000:0.0:1784290257.578728:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901014656 00000100:00100000:0.0:1784290257.578759:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784290257.578766:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901014656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290257.578773:0:84864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290257.578781:0:84864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ef9600/0x5953bbf6b3073353 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307334c expref: -99 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.578793:0:84864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ef9600/0x5953bbf6b3073353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307334c expref: 13 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.578800:0:84864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ef9600/0x5953bbf6b3073353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307334c expref: 13 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.578804:0:84864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef9600, rc 0) 00000100:00100000:0.0:1784290257.578839:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901014656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.578844:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784290257.578864:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901014656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290257.578883:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe400/0x5953bbf6b307334c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073353 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.578894:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe400/0x5953bbf6b307334c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073353 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.578946:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901014784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.578981:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290257.579004:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.579020:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901014784 00000100:00100000:0.0:1784290257.579025:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901014784 00000100:00100000:0.0:1784290257.579045:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784290257.579050:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901014784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784290257.579060:0:84865:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784290257.579073:0:84865:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784290257.579077:0:84865:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1784290257.579081:0:84865:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1784290257.579084:0:84865:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1784290257.579086:0:84865:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 104 00000100:00100000:0.0:1784290257.579168:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901014784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.579180:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784290257.579187:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901014784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784290257.579261:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784290257.579266:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe400/0x5953bbf6b307334c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073353 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.579275:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe400/0x5953bbf6b307334c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073353 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290257.579282:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1784290257.579284:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1784290257.579293:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1784290257.579308:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b307335a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.579316:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b307335a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.579324:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b307335a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.579366:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901014912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.579403:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290257.579436:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.579445:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901014912 00000100:00100000:0.0:1784290257.579449:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901014912 00000100:00100000:0.0:1784290257.579470:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784290257.579476:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901014912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290257.579482:0:84864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290257.579488:0:84864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ef9800/0x5953bbf6b3073361 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307335a expref: -99 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.579498:0:84864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ef9800/0x5953bbf6b3073361 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307335a expref: 14 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.579503:0:84864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ef9800/0x5953bbf6b3073361 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307335a expref: 14 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.579508:0:84864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef9800, rc 0) 00000100:00100000:0.0:1784290257.579534:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901014912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 59us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.579538:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784290257.579560:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901014912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290257.579573:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b307335a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073361 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.579595:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b307335a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073361 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.579645:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901015040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.579673:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290257.579692:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.579710:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901015040 00000100:00100000:0.0:1784290257.579714:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901015040 00000100:00100000:0.0:1784290257.579733:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784290257.579739:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901015040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290257.579813:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901015040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.579819:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784290257.579841:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901015040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.579872:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901015168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.579916:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290257.579937:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.579949:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901015168 00000100:00100000:0.0:1784290257.579959:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901015168 00000100:00100000:0.0:1784290257.579982:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784290257.579987:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901015168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290257.580549:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901015168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 561us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.580554:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784290257.580605:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901015168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784290257.581243:0:84993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1784290257.581322:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1784290257.581376:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1784290257.581384:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b307335a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073361 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.581395:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b307335a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073361 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290257.581403:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1784290257.581406:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9c23452c5000 from 1 10000000:01000000:3.0:1784290257.581409:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784290257.581427:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfc00/0x5953bbf6b3073368 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.581436:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfc00/0x5953bbf6b3073368 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.581444:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfc00/0x5953bbf6b3073368 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.581459:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901015296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.581488:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290257.581520:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.581526:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901015296 00000100:00100000:0.0:1784290257.581531:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901015296 00000100:00100000:0.0:1784290257.581560:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784290257.581567:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901015296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290257.581574:0:84865:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290257.581596:0:84865:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ef9e00/0x5953bbf6b307336f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073368 expref: -99 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.581610:0:84865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ef9e00/0x5953bbf6b307336f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073368 expref: 15 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.581616:0:84865:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ef9e00/0x5953bbf6b307336f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073368 expref: 15 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.581621:0:84865:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef9e00, rc 0) 00000100:00100000:0.0:1784290257.581653:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:6485:x1870961901015296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.581660:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784290257.581680:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901015296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290257.581695:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfc00/0x5953bbf6b3073368 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307336f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.581705:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfc00/0x5953bbf6b3073368 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307336f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290257.581724:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784290257.581728:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfc00/0x5953bbf6b3073368 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307336f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.581735:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfc00/0x5953bbf6b3073368 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307336f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290257.581741:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784290257.581743:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c23452c5000 from 7 10000000:01000000:3.0:1784290257.581745:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784290257.581759:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf200/0x5953bbf6b3073376 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.581767:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf200/0x5953bbf6b3073376 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.581776:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf200/0x5953bbf6b3073376 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.581790:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901015424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.581819:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290257.581840:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.581855:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901015424 00000100:00100000:0.0:1784290257.581859:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901015424 00000100:00100000:0.0:1784290257.581879:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784290257.581886:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:6485:x1870961901015424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290257.581900:0:84864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290257.581906:0:84864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ef9a00/0x5953bbf6b307337d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073376 expref: -99 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.581916:0:84864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ef9a00/0x5953bbf6b307337d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073376 expref: 16 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.581921:0:84864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ef9a00/0x5953bbf6b307337d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073376 expref: 16 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.581926:0:84864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef9a00, rc 0) 00000100:00100000:0.0:1784290257.581954:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901015424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.581961:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784290257.581978:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901015424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290257.581992:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf200/0x5953bbf6b3073376 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307337d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.582001:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf200/0x5953bbf6b3073376 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307337d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.582056:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901015552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.582084:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290257.582103:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.582115:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901015552 00000100:00100000:0.0:1784290257.582120:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901015552 00000100:00100000:0.0:1784290257.582141:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784290257.582146:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901015552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290257.582205:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901015552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 58us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.582211:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784290257.582222:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901015552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.582243:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901015680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.582272:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290257.582285:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.582294:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901015680 00000100:00100000:0.0:1784290257.582298:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901015680 00000100:00100000:0.0:1784290257.582319:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784290257.582325:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901015680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290257.582419:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901015680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290257.582432:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901015680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290257.582438:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000040:00080000:0.0:1784290257.583045:0:84994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784290257.583142:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784290257.583155:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784290257.583160:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf200/0x5953bbf6b3073376 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307337d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.583167:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf200/0x5953bbf6b3073376 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307337d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290257.583173:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784290257.583174:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c246ff27800 from 52 10000000:01000000:3.0:1784290257.583176:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784290257.583188:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073384 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.583193:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073384 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.583199:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073384 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.583216:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901015808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.583238:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290257.583263:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901015808 00000100:00100000:3.0:1784290257.583266:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.583268:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901015808 00000100:00100000:0.0:1784290257.583294:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784290257.583301:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901015808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290257.583306:0:84865:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290257.583313:0:84865:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ef8e00/0x5953bbf6b307338b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073384 expref: -99 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.583323:0:84865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ef8e00/0x5953bbf6b307338b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073384 expref: 17 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.583328:0:84865:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ef8e00/0x5953bbf6b307338b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073384 expref: 17 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.583333:0:84865:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef8e00, rc 0) 00000100:00100000:0.0:1784290257.583386:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901015808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.583392:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784290257.583426:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901015808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290257.583436:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073384 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307338b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.583442:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073384 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307338b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.583469:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901015936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.583488:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290257.583512:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901015936 00000100:00100000:3.0:1784290257.583514:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.583516:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901015936 00000100:00100000:0.0:1784290257.583541:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784290257.583547:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901015936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290257.583614:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901015936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 68us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.583621:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784290257.583629:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901015936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.583657:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901016064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.583696:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290257.583716:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.583716:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901016064 00000100:00100000:0.0:1784290257.583722:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901016064 00000100:00100000:0.0:1784290257.583739:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784290257.583745:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901016064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290257.583801:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901016064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 56us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.583807:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784290257.583816:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901016064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784290257.584394:0:84995:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1784290257.584437:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1784290257.584456:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290257.584461:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073384 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307338b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.584469:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073384 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307338b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290257.584482:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1784290257.584484:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1784290257.584485:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784290257.584497:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf600/0x5953bbf6b3073392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.584503:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf600/0x5953bbf6b3073392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.584508:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf600/0x5953bbf6b3073392 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.584518:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901016192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.584540:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290257.584562:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901016192 00000100:00100000:3.0:1784290257.584566:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.584567:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901016192 00000100:00100000:0.0:1784290257.584605:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784290257.584612:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901016192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290257.584617:0:84864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290257.584624:0:84864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ef8a00/0x5953bbf6b3073399 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073392 expref: -99 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.584634:0:84864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ef8a00/0x5953bbf6b3073399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073392 expref: 18 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.584640:0:84864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ef8a00/0x5953bbf6b3073399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073392 expref: 18 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.584645:0:84864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef8a00, rc 0) 00000100:00100000:0.0:1784290257.584673:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ddd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901016192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 63us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.584676:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784290257.584708:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901016192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290257.584720:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf600/0x5953bbf6b3073392 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073399 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.584729:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf600/0x5953bbf6b3073392 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073399 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.584759:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901016320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.584779:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290257.584793:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.584798:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901016320 00000100:00100000:0.0:1784290257.584802:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901016320 00000100:00100000:0.0:1784290257.584825:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784290257.584838:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901016320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290257.584904:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901016320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 66us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.584909:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784290257.584914:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901016320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.584936:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901016448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.584969:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290257.584982:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.584989:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901016448 00000100:00100000:0.0:1784290257.584993:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901016448 00000100:00100000:0.0:1784290257.585013:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784290257.585019:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901016448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290257.585321:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901016448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 302us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.585326:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784290257.585397:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901016448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784290257.586021:0:84996:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1784290257.586082:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1784290257.586098:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1784290257.586104:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf600/0x5953bbf6b3073392 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073399 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.586113:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf600/0x5953bbf6b3073392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073399 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290257.586120:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784290257.586122:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c246ff27800 from 7 10000000:01000000:3.0:1784290257.586124:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784290257.586140:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe800/0x5953bbf6b30733a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.586147:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe800/0x5953bbf6b30733a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.586155:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe800/0x5953bbf6b30733a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.586170:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901016576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.586200:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290257.586222:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901016576 00000100:00100000:0.0:1784290257.586226:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901016576 00000100:00100000:3.0:1784290257.586231:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.586256:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784290257.586262:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901016576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290257.586268:0:84865:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290257.586275:0:84865:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b30733a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30733a0 expref: -99 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.586285:0:84865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b30733a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30733a0 expref: 19 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.586291:0:84865:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b30733a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30733a0 expref: 19 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.586296:0:84865:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef9400, rc 0) 00000100:00100000:0.0:1784290257.586322:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901016576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 61us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.586333:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784290257.586406:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901016576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290257.586420:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe800/0x5953bbf6b30733a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30733a7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.586437:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe800/0x5953bbf6b30733a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30733a7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.586476:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901016704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.586504:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290257.586526:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901016704 00000100:00100000:0.0:1784290257.586530:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901016704 00000100:00100000:3.0:1784290257.586536:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.586556:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784290257.586562:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901016704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290257.586627:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901016704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.586633:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784290257.586658:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901016704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.586686:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901016832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.586724:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290257.586744:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901016832 00000100:00100000:3.0:1784290257.586746:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.586748:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901016832 00000100:00100000:0.0:1784290257.586773:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784290257.586778:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901016832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290257.586829:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901016832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 51us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.586836:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784290257.586861:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901016832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784290257.587426:0:84997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784290257.587464:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784290257.587484:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784290257.587489:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe800/0x5953bbf6b30733a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30733a7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.587497:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe800/0x5953bbf6b30733a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30733a7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290257.587503:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784290257.587504:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c247d3d2000 from 52 10000000:01000000:3.0:1784290257.587506:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784290257.587518:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe000/0x5953bbf6b30733ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.587524:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe000/0x5953bbf6b30733ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.587536:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe000/0x5953bbf6b30733ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.587546:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901016960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.587569:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290257.587598:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901016960 00000100:00100000:0.0:1784290257.587603:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901016960 00000100:00100000:3.0:1784290257.587619:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.587634:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784290257.587641:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901016960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290257.587647:0:84864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290257.587654:0:84864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ef9c00/0x5953bbf6b30733b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30733ae expref: -99 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.587664:0:84864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ef9c00/0x5953bbf6b30733b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30733ae expref: 20 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.587681:0:84864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ef9c00/0x5953bbf6b30733b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30733ae expref: 20 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.587686:0:84864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef9c00, rc 0) 00000100:00100000:0.0:1784290257.587713:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901016960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.587717:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784290257.587757:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901016960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290257.587771:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe000/0x5953bbf6b30733ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30733b5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.587780:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe000/0x5953bbf6b30733ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30733b5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.587821:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901017088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.587848:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290257.587867:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.587868:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901017088 00000100:00100000:0.0:1784290257.587873:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901017088 00000100:00100000:0.0:1784290257.587897:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784290257.587901:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901017088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290257.587952:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901017088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 50us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.587958:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784290257.587979:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901017088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.588004:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901017216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.588044:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290257.588064:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901017216 00000100:00100000:3.0:1784290257.588065:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.588069:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901017216 00000100:00100000:0.0:1784290257.588092:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784290257.588096:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c248207f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901017216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290257.588149:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c248207f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901017216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 52us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.588155:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784290257.588178:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901017216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784290257.588787:0:84998:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1784290257.588850:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1784290257.588866:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290257.588872:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe000/0x5953bbf6b30733ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30733b5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.588888:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe000/0x5953bbf6b30733ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30733b5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290257.588896:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1784290257.588898:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1784290257.588901:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784290257.588915:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf000/0x5953bbf6b30733bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.588922:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf000/0x5953bbf6b30733bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.588930:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf000/0x5953bbf6b30733bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.588942:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901017344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.588969:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290257.588990:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901017344 00000100:00100000:0.0:1784290257.588995:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901017344 00000100:00100000:3.0:1784290257.588997:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.589022:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784290257.589026:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e412450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901017344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290257.589037:0:84865:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290257.589044:0:84865:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ef8200/0x5953bbf6b30733c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30733bc expref: -99 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.589055:0:84865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ef8200/0x5953bbf6b30733c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30733bc expref: 21 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.589061:0:84865:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ef8200/0x5953bbf6b30733c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30733bc expref: 21 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.589066:0:84865:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef8200, rc 0) 00000100:00100000:0.0:1784290257.589092:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e412450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901017344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 66us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.589099:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784290257.589145:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901017344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290257.589158:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf000/0x5953bbf6b30733bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30733c3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.589167:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf000/0x5953bbf6b30733bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30733c3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.589208:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901017472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.589238:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290257.589266:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901017472 00000100:00100000:3.0:1784290257.589270:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.589270:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901017472 00000100:00100000:0.0:1784290257.589306:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784290257.589312:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e411450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901017472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290257.589417:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e411450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901017472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.589423:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784290257.589446:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901017472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.589474:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901017600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.589514:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290257.589534:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901017600 00000100:00100000:0.0:1784290257.589538:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901017600 00000100:00100000:3.0:1784290257.589547:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.589563:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784290257.589568:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e410050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901017600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290257.589945:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e410050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901017600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 376us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.589958:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784290257.589993:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901017600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784290257.590616:0:84999:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1784290257.590674:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1784290257.590691:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784290257.590697:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf000/0x5953bbf6b30733bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30733c3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.590706:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf000/0x5953bbf6b30733bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30733c3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290257.590715:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784290257.590717:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c247d3d2000 from 7 10000000:01000000:3.0:1784290257.590719:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784290257.590735:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe200/0x5953bbf6b30733ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.590743:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe200/0x5953bbf6b30733ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.590752:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe200/0x5953bbf6b30733ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.590763:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901017728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.590784:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290257.590812:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901017728 00000100:00100000:3.0:1784290257.590816:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.590817:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901017728 00000100:00100000:0.0:1784290257.590846:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784290257.590850:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e413850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901017728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290257.590855:0:84864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290257.590861:0:84864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ef8c00/0x5953bbf6b30733d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30733ca expref: -99 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.590872:0:84864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ef8c00/0x5953bbf6b30733d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30733ca expref: 22 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.590878:0:84864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ef8c00/0x5953bbf6b30733d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30733ca expref: 22 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.590883:0:84864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef8c00, rc 0) 00000100:00100000:0.0:1784290257.590910:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e413850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901017728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 60us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.590917:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784290257.590930:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901017728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290257.590940:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe200/0x5953bbf6b30733ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30733d1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.590946:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe200/0x5953bbf6b30733ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30733d1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.590973:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901017856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.590991:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290257.591004:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.591009:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901017856 00000100:00100000:0.0:1784290257.591013:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901017856 00000100:00100000:0.0:1784290257.591035:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784290257.591039:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901017856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290257.591090:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901017856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 50us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.591096:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784290257.591117:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901017856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.591143:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901017984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.591179:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290257.591199:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901017984 00000100:00100000:3.0:1784290257.591200:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.591204:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901017984 00000100:00100000:0.0:1784290257.591228:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784290257.591233:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901017984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290257.591286:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901017984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 51us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.591291:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784290257.591315:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901017984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784290257.591904:0:85000:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784290257.591963:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784290257.591980:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784290257.591986:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe200/0x5953bbf6b30733ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30733d1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.591995:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe200/0x5953bbf6b30733ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30733d1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290257.592003:0:6485:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1784290257.592005:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9c2480260000 from 1 10000000:01000000:3.0:1784290257.592008:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1784290257.592031:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b30733d8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.592040:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b30733d8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.592048:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b30733d8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.592062:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901018112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.592091:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290257.592112:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901018112 00000100:00100000:0.0:1784290257.592116:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901018112 00000100:00100000:3.0:1784290257.592123:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.592141:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784290257.592147:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901018112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290257.592152:0:84865:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290257.592159:0:84865:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ef8600/0x5953bbf6b30733df lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30733d8 expref: -99 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.592169:0:84865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ef8600/0x5953bbf6b30733df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30733d8 expref: 23 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.592175:0:84865:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ef8600/0x5953bbf6b30733df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30733d8 expref: 23 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.592180:0:84865:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef8600, rc 0) 00000100:00100000:0.0:1784290257.592206:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901018112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 59us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.592210:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784290257.592244:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901018112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290257.592256:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b30733d8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30733df expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.592266:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b30733d8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30733df expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290257.592279:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1784290257.592284:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b30733d8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30733df expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.592292:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b30733d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30733df expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290257.592299:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784290257.592301:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9c2480260000 from 1 10000000:01000000:3.0:1784290257.592304:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784290257.592318:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24488dc600/0x5953bbf6b30733e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.592335:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24488dc600/0x5953bbf6b30733e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.592383:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24488dc600/0x5953bbf6b30733e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.592403:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901018240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.592433:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290257.592455:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901018240 00000100:00100000:0.0:1784290257.592459:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901018240 00000100:00100000:3.0:1784290257.592463:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.592487:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784290257.592501:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a473850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901018240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290257.592507:0:84864:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290257.592513:0:84864:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ef9000/0x5953bbf6b30733ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30733e6 expref: -99 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.592523:0:84864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ef9000/0x5953bbf6b30733ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30733e6 expref: 24 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.592528:0:84864:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ef9000/0x5953bbf6b30733ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30733e6 expref: 24 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290257.592533:0:84864:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef9000, rc 0) 00000100:00100000:0.0:1784290257.592559:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a473850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901018240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 60us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290257.592565:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784290257.592603:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901018240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290257.592615:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24488dc600/0x5953bbf6b30733e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30733ed expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.592625:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24488dc600/0x5953bbf6b30733e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30733ed expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290257.592663:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901018368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290257.592690:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290257.592708:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901018368 00000100:00100000:3.0:1784290257.592710:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fd6fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290257.592713:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901018368 00000100:00100000:0.0:1784290257.592737:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784290257.592741:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901018368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290257.592780:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901018368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 38us (90us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784290257.592786:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784290257.592808:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901018368:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1784290257.592829:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784290257.592834:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24488dc600/0x5953bbf6b30733e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30733ed expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290257.592844:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24488dc600/0x5953bbf6b30733e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30733ed expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290258.088625:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901018496:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784290258.088627:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901018624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290258.088740:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290258.088809:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290258.088863:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901018496 00000100:00100000:1.0:1784290258.088865:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901018624 00000100:00100000:1.0:1784290258.088877:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901018624 00000100:00100000:0.0:1784290258.088878:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901018496 00000100:00100000:1.0:1784290258.088968:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:1.0:1784290258.088996:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901018624:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784290258.089006:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:0.0:1784290258.089023:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901018496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784290258.089049:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1784290258.089061:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290258.089140:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901018624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 161us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290258.089152:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:0.0:1784290258.089164:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901018496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 141us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290258.089183:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00080000:1.0:1784290258.089191:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784290258.089201:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901018624:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784290258.089201:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290258.089262:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901018496:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1784290258.227609:0:85140:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1784290258.437650:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290258.437701:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290258.437736:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896199680 00000100:00100000:0.0:1784290258.437748:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896199680 00000100:00100000:2.0:1784290258.437753:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290258.437775:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896199808 00000100:00100000:3.0:1784290258.437782:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896199808 00000100:00100000:0.0:1784290258.437804:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:2.0:1784290258.437810:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290258.437814:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896199936 00000100:00100000:3.0:1784290258.437826:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896199936 00000100:00100000:0.0:1784290258.437831:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2400:x1870961896199680:12345-192.168.202.6@tcp:400:kworker.0 00000020:00080000:0.0:1784290258.437842:0:84864:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.6@tcp 00000100:00100000:3.0:1784290258.437876:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 610 00000100:00100000:3.0:1784290258.437885:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2399:x1870961896199936:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290258.437906:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2400:x1870961896199680:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 86us (262us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784290258.437912:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:3.0:1784290258.437933:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2399:x1870961896199936:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 48us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290258.437947:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 610 00000100:00100000:2.0:1784290258.437949:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290258.437980:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 986 00000100:00100000:1.0:1784290258.438003:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1870961896199808:12345-192.168.202.6@tcp:38:kworker.0 00000100:00100000:2.0:1784290258.438010:0:26263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896200064 00000100:00080000:3.0:1784290258.438014:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784290258.438020:0:26263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896200064 00010000:00080000:1.0:1784290258.438054:0:66004:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'bd808cf4-dd54-45f0-9b2b-1434e8330e5d' at ffff9c2474cc5800, cookie 0x5953bbf6b307327a 00010000:00080000:1.0:1784290258.438064:0:66004:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp recovering/t94489280514 exp ffff9c2474cc5800 cur 1999 last 1784290256 00000100:00100000:3.0:1784290258.438067:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896200192 00000100:00080000:0.0:1784290258.438069:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:02000400:1.0:1784290258.438083:0:66004:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00000100:00100000:2.0:1784290258.438107:0:26263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4902 00010000:00080000:1.0:1784290258.438125:0:66004:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000100:00100000:2.0:1784290258.438136:0:26263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2396:x1870961896200064:12345-192.168.202.6@tcp:9:kworker.0 00000020:00000080:2.0:1784290258.438169:0:26263:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30730e4 00000004:00100000:1.0:1784290258.438170:0:66004:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1784290258.438184:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896200192 00000100:00080000:2.0:1784290258.438185:0:26263:0:(import.c:65:import_set_state_nolock()) ffff9c24481c0800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1784290258.438231:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784290258.438255:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784290258.438269:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4903 00000001:00000004:2.0:1784290258.438281:0:26263:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968624 00000100:00100000:3.0:1784290258.438284:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2396:x1870961896200192:12345-192.168.202.6@tcp:9:kworker.0 00000020:00000080:3.0:1784290258.438305:0:26250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3070976 00000100:00080000:3.0:1784290258.438310:0:26250:0:(import.c:65:import_set_state_nolock()) ffff9c24444af000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1784290258.438376:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1784290258.438393:0:26250:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968624 00000100:00100000:2.0:1784290258.438697:0:26263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+2:2396:x1870961896200064:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 558us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290258.438698:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+2:2396:x1870961896200192:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 408us (748us total) trans 0 rc 0/0 00000100:00080000:1.0:1784290258.438701:0:66004:0:(import.c:65:import_set_state_nolock()) ffff9c24444ad800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784290258.438727:0:26263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4902 00000100:00100000:3.0:1784290258.438737:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4903 00000100:00100000:1.0:1784290258.438840:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896199808:12345-192.168.202.6@tcp:38:kworker.0 Request processed in 841us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290258.438870:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 986 00000100:00100000:3.0:1784290258.446427:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290258.446518:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896195584 00000100:00100000:2.0:1784290258.446525:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896195584 00000100:00100000:2.0:1784290258.446586:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 987 00000100:00100000:2.0:1784290258.446598:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896195584:12345-192.168.202.6@tcp:36:mcreate.0 00010000:00080000:2.0:1784290258.446623:0:65990:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 94489280514, current: 94489280514, replaying 00000100:00100000:2.0:1784290258.446656:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f989c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896195584:12345-192.168.202.6@tcp:36:mcreate.0 Request processed in 61us (229us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784290258.446665:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 987 00010000:00080000:1.0:1784290258.446721:0:84889:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:2.0:1784290258.449685:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290258.449855:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896200320 00000100:00100000:3.0:1784290258.449884:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896200320 00000100:00100000:3.0:1784290258.449949:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:3.0:1784290258.449957:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2396:x1870961896200320:12345-192.168.202.6@tcp:250:ptlrpcd_01_01.0 00010000:00080000:3.0:1784290258.449984:0:84865:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from bdffa268-fb6a-4248-991c-0ad16fac303f@192.168.202.6@tcp t0 exp 0000000000000000 cur 1999 last 0 00000020:00000080:3.0:1784290258.450023:0:84865:0:(genops.c:1406:class_connect()) connect: client bdffa268-fb6a-4248-991c-0ad16fac303f, cookie 0x5953bbf6b30733f4 00000100:00080000:3.0:1784290258.450187:0:84865:0:(import.c:65:import_set_state_nolock()) ffff9c2474ee5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784290258.450252:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+5:2396:x1870961896200320:12345-192.168.202.6@tcp:250:ptlrpcd_01_01.0 Request processed in 293us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290258.450263:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 61 00010000:00010000:3.0:1784290258.471526:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784290258.674738:0:85192:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784290258.675041:0:85192:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1784290259.038440:0:85242:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784290259.038864:0:85242:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784290259.495644:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290260.358329:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290260.358386:0:84863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896200448 00000100:00100000:0.0:1784290260.358397:0:84863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896200448 00000100:00100000:0.0:1784290260.358445:0:84863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:0.0:1784290260.358453:0:84863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdffa268-fb6a-4248-991c-0ad16fac303f+5:42227:x1870961896200448:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290260.358467:0:84863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290260.358482:0:84863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ef8400/0x5953bbf6b30733fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b21d1 expref: -99 pid: 84863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290260.358508:0:84863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ef8400/0x5953bbf6b30733fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21d1 expref: 6 pid: 84863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290260.358517:0:84863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ef8400/0x5953bbf6b30733fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21d1 expref: 6 pid: 84863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290260.358537:0:84863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef8400, rc 0) 00000100:00100000:0.0:1784290260.358603:0:84863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdffa268-fb6a-4248-991c-0ad16fac303f+6:42227:x1870961896200448:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 150us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290260.358608:0:84863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:2.0:1784290260.359618:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290260.359661:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896200576 00000100:00100000:3.0:1784290260.359666:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896200576 00000100:00100000:3.0:1784290260.359695:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:3.0:1784290260.359701:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+6:42227:x1870961896200576:12345-192.168.202.6@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784290260.359714:0:84865:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1784290260.359730:0:84865:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784290260.359734:0:84865:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1784290260.359736:0:84865:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1784290260.359739:0:84865:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1784290260.359741:0:84865:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 104 00000100:00100000:3.0:1784290260.360432:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+6:42227:x1870961896200576:12345-192.168.202.6@tcp:256:ll_cfg_requeue.0 Request processed in 728us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290260.360439:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:0.0:1784290260.361370:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290260.361437:0:84863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896200704 00000100:00100000:1.0:1784290260.361444:0:84863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896200704 00000100:00100000:1.0:1784290260.361484:0:84863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:1.0:1784290260.361496:0:84863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdffa268-fb6a-4248-991c-0ad16fac303f+6:42227:x1870961896200704:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290260.361505:0:84863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290260.361519:0:84863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2440031400/0x5953bbf6b3073402 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b21d8 expref: -99 pid: 84863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290260.361538:0:84863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2440031400/0x5953bbf6b3073402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21d8 expref: 7 pid: 84863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290260.361548:0:84863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2440031400/0x5953bbf6b3073402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21d8 expref: 7 pid: 84863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290260.361571:0:84863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2440031400, rc 0) 00000100:00100000:1.0:1784290260.361609:0:84863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdffa268-fb6a-4248-991c-0ad16fac303f+7:42227:x1870961896200704:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 116us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290260.361618:0:84863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:2.0:1784290260.362380:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290260.362418:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896200832 00000100:00100000:3.0:1784290260.362423:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896200832 00000100:00100000:3.0:1784290260.362453:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:3.0:1784290260.362458:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+7:42227:x1870961896200832:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290260.362551:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+8:42227:x1870961896200832:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 92us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290260.362571:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:2.0:1784290260.363298:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290260.363366:0:84863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896200960 00000100:00100000:1.0:1784290260.363372:0:84863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896200960 00000100:00100000:1.0:1784290260.363401:0:84863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:1.0:1784290260.363408:0:84863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdffa268-fb6a-4248-991c-0ad16fac303f+8:42227:x1870961896200960:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290260.363498:0:84863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdffa268-fb6a-4248-991c-0ad16fac303f+8:42227:x1870961896200960:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 88us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290260.363518:0:84863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:0.0:1784290260.365146:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290260.365231:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896201088 00000100:00100000:3.0:1784290260.365237:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896201088 00000100:00100000:3.0:1784290260.365270:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:3.0:1784290260.365280:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+8:42227:x1870961896201088:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290260.365289:0:84865:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290260.365301:0:84865:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c24488dd000/0x5953bbf6b3073409 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b21df expref: -99 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290260.365319:0:84865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c24488dd000/0x5953bbf6b3073409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21df expref: 9 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290260.365331:0:84865:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c24488dd000/0x5953bbf6b3073409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21df expref: 9 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290260.365359:0:84865:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24488dd000, rc 0) 00000100:00100000:3.0:1784290260.365396:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896201088:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 117us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290260.365404:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:2.0:1784290260.366312:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290260.366365:0:84863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896201216 00000100:00100000:1.0:1784290260.366371:0:84863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896201216 00000100:00100000:1.0:1784290260.366401:0:84863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:1.0:1784290260.366409:0:84863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475cab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896201216:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290260.366483:0:84863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475cab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896201216:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 73us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290260.366492:0:84863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:2.0:1784290260.367287:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290260.367356:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896201344 00000100:00100000:3.0:1784290260.367364:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896201344 00000100:00100000:3.0:1784290260.367399:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:3.0:1784290260.367408:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475cab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896201344:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290260.367501:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475cab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896201344:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 92us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290260.367510:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:0.0:1784290260.369361:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290260.369417:0:84863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896201472 00000100:00100000:1.0:1784290260.369423:0:84863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896201472 00000100:00100000:1.0:1784290260.369458:0:84863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:1.0:1784290260.369468:0:84863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ca8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896201472:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290260.369477:0:84863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290260.369487:0:84863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2440030a00/0x5953bbf6b3073410 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b21e6 expref: -99 pid: 84863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290260.369504:0:84863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2440030a00/0x5953bbf6b3073410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21e6 expref: 10 pid: 84863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290260.369515:0:84863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2440030a00/0x5953bbf6b3073410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21e6 expref: 10 pid: 84863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290260.369524:0:84863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2440030a00, rc 0) 00000100:00100000:1.0:1784290260.369573:0:84863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ca8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdffa268-fb6a-4248-991c-0ad16fac303f+10:42227:x1870961896201472:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 106us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290260.369582:0:84863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:2.0:1784290260.370223:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290260.370269:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896201600 00000100:00100000:3.0:1784290260.370275:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896201600 00000100:00100000:3.0:1784290260.370302:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:3.0:1784290260.370308:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475cab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+10:42227:x1870961896201600:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290260.370370:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475cab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+10:42227:x1870961896201600:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 61us (147us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784290260.370376:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 71 00010000:00010000:2.0:1784290260.519532:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.543694:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784290261.671585:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290261.671592:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290261.671597:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290261.671612:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290261.671619:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901018752:0@lo:400:kworker.0 00000100:00100000:0.0:1784290261.671621:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901018880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784290261.671643:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c234434d500 x1870961901019008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784290261.671692:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290261.671697:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290261.671700:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290261.671707:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290261.671731:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901019008:0@lo:38:kworker.0 00000100:00100000:2.0:1784290261.671732:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c234434f480 x1870961901019264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784290261.671735:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290261.671736:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784290261.671786:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290261.671793:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290261.671814:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1784290261.671823:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784290261.671827:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290261.671831:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901019136:0@lo:400:kworker.0 00000100:00100000:2.0:1784290261.671854:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2446e77800 x1870961901019520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290261.671865:0:84863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901018752 00000100:00100000:3.0:1784290261.671875:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901019264:0@lo:38:kworker.0 00000100:00100000:0.0:1784290261.671877:0:84863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901018752 00000100:00100000:1.0:1784290261.671879:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784290261.671917:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290261.671922:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290261.671925:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1784290261.671927:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1784290261.671933:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290261.671943:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1870961901019392:0@lo:400:kworker.0 00000100:00100000:3.0:1784290261.671944:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290261.671953:0:84863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784290261.671955:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c245fe38000 x1870961901019904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290261.671976:0:84863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3620:x1870961901018752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290261.672000:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2446e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901019520:0@lo:38:kworker.0 00000100:00080000:2.0:1784290261.672004:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:1.0:1784290261.672004:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784290261.672015:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290261.672018:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c246d58b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290261.672024:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c246d58b000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290261.672046:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c245fe3b100 x1870961901020288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784290261.672068:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290261.672068:0:84863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3620:x1870961901018752:12345-0@lo:400:kworker.0 Request processed in 99us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290261.672072:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901020032:0@lo:400:kworker.0 00000100:00100000:2.0:1784290261.672083:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901020160:0@lo:400:kworker.0 00000100:00100000:0.0:1784290261.672092:0:84863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784290261.672108:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901019904:0@lo:38:kworker.0 00000100:00100000:1.0:1784290261.672143:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290261.672160:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901018880 00000100:00100000:0.0:1784290261.672170:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2446e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901019648:0@lo:400:kworker.0 00000100:00100000:3.0:1784290261.672171:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290261.672171:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901018880 00000100:00100000:3.0:1784290261.672225:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901020288:0@lo:38:kworker.0 00000100:00100000:1.0:1784290261.672225:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901019008 00000100:00100000:0.0:1784290261.672225:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290261.672230:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901019520 00000100:00100000:1.0:1784290261.672238:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901019008 00000100:00100000:2.0:1784290261.672239:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901019520 00000100:00100000:0.0:1784290261.672266:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784290261.672278:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290261.672280:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2446e77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901019776:0@lo:400:kworker.0 00000100:00100000:2.0:1784290261.672289:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3731 00000100:00100000:1.0:1784290261.672291:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901019136 00000100:00100000:1.0:1784290261.672299:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901019136 00000100:00100000:2.0:1784290261.672311:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901018880:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784290261.672327:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290261.672331:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901019264 00000100:00100000:1.0:1784290261.672363:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901019392 00000100:00100000:1.0:1784290261.672370:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901019392 00000100:00100000:3.0:1784290261.672380:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901019264 00000004:00000024:2.0:1784290261.672389:0:8413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:1.0:1784290261.672398:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901019904 00000100:00100000:1.0:1784290261.672403:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901019904 00000100:00100000:3.0:1784290261.672417:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901020288 00000100:00100000:3.0:1784290261.672426:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901020288 00000100:00100000:0.0:1784290261.672435:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901020032 00000100:00100000:1.0:1784290261.672438:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:0.0:1784290261.672442:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901020032 00000100:00100000:1.0:1784290261.672453:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901019136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290261.672468:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901018880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 164us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290261.672470:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:2.0:1784290261.672489:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3731 00000100:00100000:0.0:1784290261.672499:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901019648 00000100:00100000:3.0:1784290261.672503:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1870961901019392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290261.672512:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901019648 00000100:00100000:2.0:1784290261.672528:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3732 00000100:00100000:1.0:1784290261.672530:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901019136:12345-0@lo:400:kworker.0 Request processed in 75us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290261.672564:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901019520:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784290261.672565:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:0.0:1784290261.672584:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901019776 00000100:00100000:0.0:1784290261.672592:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901019776 00010000:00080000:2.0:1784290261.672598:0:8413:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9c2474cc1800, cookie 0x5953bbf6b3073281 00000100:00100000:3.0:1784290261.672599:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1870961901019392:12345-0@lo:400:kworker.0 Request processed in 102us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290261.672605:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00010000:00080000:2.0:1784290261.672613:0:8413:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9c2474cc1800 cur 2002 last 1784290256 00000100:00100000:1.0:1784290261.672622:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901019008:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784290261.672628:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00100000:0.0:1784290261.672634:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000004:00100000:2.0:1784290261.672641:0:8413:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1784290261.672649:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901020032:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1784290261.672652:0:66004:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2002 last 0 00000100:00100000:3.0:1784290261.672662:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:3.0:1784290261.672673:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901019264:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784290261.672701:0:65989:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2002 last 0 00000020:00000080:1.0:1784290261.672718:0:66004:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5953bbf6b3073417 00000100:00100000:0.0:1784290261.672731:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901020032:12345-0@lo:400:kworker.0 Request processed in 85us (587us total) trans 0 rc 0/0 00000004:00100000:1.0:1784290261.672735:0:66004:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1784290261.672744:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000020:00000080:3.0:1784290261.672761:0:65989:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5953bbf6b307341e 00000100:00100000:0.0:1784290261.672777:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486 00000004:00100000:3.0:1784290261.672779:0:65989:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1784290261.672790:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901019648:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784290261.672794:0:66004:0:(import.c:65:import_set_state_nolock()) ffff9c24444ab800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1784290261.672831:0:65989:0:(import.c:65:import_set_state_nolock()) ffff9c2474ee5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290261.672857:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901019648:12345-0@lo:400:kworker.0 Request processed in 69us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290261.672870:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00000100:00100000:1.0:1784290261.672880:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1870961901019008:12345-0@lo:38:kworker.0 Request processed in 257us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290261.672893:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:0.0:1784290261.672901:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:3.0:1784290261.672911:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1870961901019264:12345-0@lo:38:kworker.0 Request processed in 237us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290261.672917:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901019776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290261.672924:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:1.0:1784290261.672933:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00080000:2.0:1784290261.672939:0:8413:0:(import.c:65:import_set_state_nolock()) ffff9c2344b52800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784290261.672946:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901019904:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784290261.672958:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00010000:00080000:1.0:1784290261.672971:0:66004:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2002 last 0 00000100:00100000:3.0:1784290261.672975:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901020288:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290261.672975:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901019776:12345-0@lo:400:kworker.0 Request processed in 58us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290261.672988:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00010000:00080000:3.0:1784290261.673003:0:65989:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2002 last 0 00000020:00000080:1.0:1784290261.673017:0:66004:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5953bbf6b3073425 00000100:00100000:2.0:1784290261.673024:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1870961901019520:12345-0@lo:38:kworker.0 Request processed in 479us (955us total) trans 0 rc 0/0 00000004:00100000:1.0:1784290261.673032:0:66004:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1784290261.673039:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3732 00000100:00080000:0.0:1784290261.673041:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1784290261.673051:0:65989:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5953bbf6b307342c 00000100:00080000:0.0:1784290261.673051:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784290261.673058:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00100000:3.0:1784290261.673067:0:65989:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784290261.673074:0:66004:0:(import.c:65:import_set_state_nolock()) ffff9c24444ab000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1784290261.673103:0:65989:0:(import.c:65:import_set_state_nolock()) ffff9c2474ee7800 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1784290261.673110:0:84889:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1784290261.673118:0:84889:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 94489280514 00000020:00080000:2.0:1784290261.673124:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290261.673128:0:84889:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 94489280514, next_transno: 94489280514 00000100:00100000:0.0:1784290261.673132:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901020032:0@lo:400:kworker.0 00010000:00080000:2.0:1784290261.673136:0:84889:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (94489280514) 00000100:00100000:1.0:1784290261.673137:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1870961901019904:12345-0@lo:38:kworker.0 Request processed in 192us (972us total) trans 0 rc 0/0 00000020:00080000:2.0:1784290261.673144:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00000100:00100000:1.0:1784290261.673159:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00010000:00080000:2.0:1784290261.673164:0:84889:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896195584 t94489280514 from 192.168.202.6@tcp req@ffff9c247f989c00 x1870961896195584/t0(94489280514) o36->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:279/0 lens 528/0 e 0 to 0 dl 1784290269 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290261.673171:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1870961901019392:0@lo:400:kworker.0 00000100:00100000:3.0:1784290261.673174:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1870961901020288:12345-0@lo:38:kworker.0 Request processed in 201us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290261.673201:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:0.0:1784290261.673201:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901019136:0@lo:400:kworker.0 00010000:00080000:3.0:1784290261.673275:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c245fe3b100 x1870961901020288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290261.673288:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784290261.673306:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 23 00000100:00100000:0.0:1784290261.673325:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901018752:0@lo:400:kworker.0 00000100:00080000:3.0:1784290261.673328:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1784290261.673335:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784290261.673371:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246d58b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784290261.673382:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901020288:0@lo:38:kworker.0 00000100:00100000:2.0:1784290261.673398:0:26255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901020160 00000100:00100000:2.0:1784290261.673405:0:26255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901020160 00000100:00080000:3.0:1784290261.673413:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 23 00000100:00080000:3.0:1784290261.673425:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00100000:0.0:1784290261.673430:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2446e77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901019776:0@lo:400:kworker.0 00000100:00080000:3.0:1784290261.673431:0:3616:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1784290261.673437:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 77309411339 gen 3 00000100:00080000:3.0:1784290261.673443:0:3616:0:(recover.c:53:ptlrpc_replay_next()) import ffff9c246dd98000 from lustre-MDT0000_UUID committed 77309411339 last 0 00000100:00080000:3.0:1784290261.673449:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1784290261.673457:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2446e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901019648:0@lo:400:kworker.0 00000100:00100000:2.0:1784290261.673469:0:26255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1488 00000100:00100000:2.0:1784290261.673489:0:26255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901020160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290261.673489:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901018880:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1784290261.673578:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784290261.673604:0:26255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901020160:12345-0@lo:400:kworker.0 Request processed in 123us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290261.673626:0:26255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1488 00000100:00100000:3.0:1784290261.673632:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2446e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901019520:0@lo:38:kworker.0 00010000:00080000:3.0:1784290261.673661:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c245fe38000 x1870961901019904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784290261.673677:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 23 00000100:00100000:2.0:1784290261.673875:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901020160:0@lo:400:kworker.0 00010000:00080000:2.0:1784290261.673909:0:85255:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1784290261.673913:0:85255:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1784290261.673919:0:85255:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000004:00080000:0.0:1784290261.673961:0:84889:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 723us 00010000:00010000:0.0:1784290261.682522:0:84889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8000/0x5953bbf6b3073433 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.682592:0:84889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8000/0x5953bbf6b3073433 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.682614:0:84889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8000/0x5953bbf6b3073433 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.682636:0:84889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9200/0x5953bbf6b307343a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.682647:0:84889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9200/0x5953bbf6b307343a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.682658:0:84889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9200/0x5953bbf6b307343a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.683190:0:84889:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8000/0x5953bbf6b3073433 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.683205:0:84889:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8000/0x5953bbf6b3073433 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.683215:0:84889:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8000/0x5953bbf6b3073433 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.683238:0:84889:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290261.683245:0:84889:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8000/0x5953bbf6b3073433 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.683257:0:84889:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8000/0x5953bbf6b3073433 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.683278:0:84889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2461de5400) 00010000:00010000:0.0:1784290261.683284:0:84889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290261.683291:0:84889:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8000/0x5953bbf6b3073433 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.683301:0:84889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8000/0x5953bbf6b3073433 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290261.683333:0:84889:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eaa87580 reply state 000000008a88b2ca transno 94489280514 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9200/0x5953bbf6b307343a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.683349:0:84889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9200/0x5953bbf6b307343a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.683359:0:84889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2461de5100) 00010000:00010000:0.0:1784290261.683364:0:84889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290261.683369:0:84889:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1784290261.683531:0:84889:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000100:00080000:2.0:1784290261.683565:0:85255:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00080000:0.0:1784290261.683603:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290261.683610:0:84889:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 94489280515 00000020:00080000:0.0:1784290261.683619:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290261.683623:0:84889:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 94489280515 00000100:00080000:3.0:1784290261.683915:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9c245fe38000 x1870961901019904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290286 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784290261.683931:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1784290261.683937:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784290261.683944:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1784290261.683952:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901019904:0@lo:38:kworker.0 00010000:00080000:3.0:1784290261.684168:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c234434f480 x1870961901019264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784290261.684184:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 23 00000001:00080000:0.0:1784290261.685140:0:84858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280514 is committed 00010000:00010000:1.0:1784290261.685201:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9200/0x5953bbf6b307343a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.685222:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9200/0x5953bbf6b307343a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.685237:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9200/0x5953bbf6b307343a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.685248:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290261.685255:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9200/0x5953bbf6b307343a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.685266:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9200/0x5953bbf6b307343a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.685295:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2461de5100) 00010000:00010000:1.0:1784290261.685299:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290261.685304:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9200/0x5953bbf6b307343a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.685311:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9200/0x5953bbf6b307343a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290261.685448:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290261.685494:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896196096 00000100:00100000:0.0:1784290261.685504:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896196096 00000100:00100000:0.0:1784290261.685605:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 992 00000100:00100000:0.0:1784290261.685626:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896196096:12345-192.168.202.6@tcp:36:rm.0 00010000:00080000:0.0:1784290261.685648:0:65990:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 94489280515, current: 94489280515, replaying 00000100:00100000:0.0:1784290261.685675:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896196096:12345-192.168.202.6@tcp:36:rm.0 Request processed in 57us (231us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784290261.685690:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 992 00000020:00080000:1.0:1784290261.685696:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784290261.685703:0:84889:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 94489280515, next_transno: 94489280515 00010000:00080000:1.0:1784290261.685708:0:84889:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (94489280515) 00000020:00080000:1.0:1784290261.685712:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784290261.685722:0:84889:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896196096 t94489280515 from 192.168.202.6@tcp req@ffff9c245fe38380 x1870961896196096/t0(94489280515) o36->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:282/0 lens 512/0 e 0 to 0 dl 1784290272 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1784290261.685787:0:84889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031000/0x5953bbf6b3073441 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.685799:0:84889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031000/0x5953bbf6b3073441 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.685808:0:84889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031000/0x5953bbf6b3073441 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.685821:0:84889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031e00/0x5953bbf6b3073448 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.685828:0:84889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031e00/0x5953bbf6b3073448 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.685836:0:84889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031e00/0x5953bbf6b3073448 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.685909:0:84889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b307344f lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.685919:0:84889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b307344f lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.685928:0:84889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b307344f lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784290261.685967:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9c234434f480 x1870961901019264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290286 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784290261.685991:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1784290261.685995:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784290261.686000:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1784290261.686007:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901019264:0@lo:38:kworker.0 00010000:00080000:3.0:1784290261.686032:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c234434d500 x1870961901019008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784290261.686045:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 23 00010000:00010000:1.0:1784290261.686108:0:84889:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b307344f lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.686119:0:84889:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b307344f lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.686125:0:84889:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b307344f lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.686131:0:84889:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236ce00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290261.686135:0:84889:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b307344f lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.686142:0:84889:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b307344f lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.686153:0:84889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9c2458ba5a00) 00010000:00010000:1.0:1784290261.686156:0:84889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784290261.686159:0:84889:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b307344f lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.686167:0:84889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b307344f lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.686209:0:84889:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031000/0x5953bbf6b3073441 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.686222:0:84889:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031000/0x5953bbf6b3073441 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.686235:0:84889:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031000/0x5953bbf6b3073441 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.686246:0:84889:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2440031000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290261.686252:0:84889:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031000/0x5953bbf6b3073441 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.686265:0:84889:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031000/0x5953bbf6b3073441 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.686280:0:84889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2458ba5200) 00010000:00010000:1.0:1784290261.686283:0:84889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290261.686287:0:84889:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031000/0x5953bbf6b3073441 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.686294:0:84889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031000/0x5953bbf6b3073441 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784290261.686310:0:84889:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d311ae0b reply state 000000007c125718 transno 94489280515 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031e00/0x5953bbf6b3073448 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.686320:0:84889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031e00/0x5953bbf6b3073448 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.686328:0:84889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2458ba5100) 00010000:00010000:1.0:1784290261.686367:0:84889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784290261.686371:0:84889:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1784290261.686427:0:84889:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1784290261.686444:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784290261.686448:0:84889:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 94489280516 00000020:00080000:1.0:1784290261.686453:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784290261.686456:0:84889:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 94489280516 00000100:00080000:3.0:1784290261.687432:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9c234434d500 x1870961901019008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290286 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784290261.687449:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1784290261.687455:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784290261.687461:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1784290261.687469:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901019008:0@lo:38:kworker.0 00000100:00100000:3.0:1784290261.687692:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901020416:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1784290261.687742:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290261.687747:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290261.687824:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896196608 00000100:00100000:0.0:1784290261.687832:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896196608 00000100:00100000:0.0:1784290261.687882:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 993 00000100:00100000:0.0:1784290261.687891:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2396:x1870961896196608:12345-192.168.202.6@tcp:101:lfs.0 00010000:00080000:0.0:1784290261.687902:0:65989:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 94489280516, current: 94489280516, replaying 00000100:00100000:0.0:1784290261.687921:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2396:x1870961896196608:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 32us (186us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784290261.687928:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 993 00000100:00100000:1.0:1784290261.687940:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901020416 00000100:00100000:1.0:1784290261.687948:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901020416 00000020:00080000:2.0:1784290261.687953:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290261.687960:0:84889:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 94489280516, next_transno: 94489280516 00010000:00080000:2.0:1784290261.687966:0:84889:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (94489280516) 00000020:00080000:2.0:1784290261.687971:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290261.687981:0:84889:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896196608 t94489280516 from 192.168.202.6@tcp req@ffff9c245fe3b800 x1870961896196608/t0(94489280516) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:282/0 lens 536/0 e 0 to 0 dl 1784290272 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290261.688005:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3733 00010000:00010000:2.0:1784290261.688009:0:84889:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1784290261.688018:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1870961901020416:12345-0@lo:400:ldlm_lock_repla.0 00010000:00010000:2.0:1784290261.688032:0:84889:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b3073456 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b21c3 expref: -99 pid: 84889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1784290261.688037:0:8413:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9c2445d6df80 x1870961901020416/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:282/0 lens 224/0 e 0 to 0 dl 1784290272 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290261.688066:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1870961901020416:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 54us (324us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784290261.688073:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3733 00010000:00010000:2.0:1784290261.688155:0:84889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b307345d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.688169:0:84889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b307345d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.688180:0:84889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b307345d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.688207:0:84889:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3073464 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.688215:0:84889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3073464 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.688222:0:84889:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3073464 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784290261.688500:0:84889:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00000004:00080000:2.0:1784290261.688518:0:84889:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000a811:0x2:0x0], cookie = 0x5953bbf6b30731d9 00000004:00080000:2.0:1784290261.688521:0:84889:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x5953bbf6b30731d9 in new mfd 00010000:00010000:2.0:1784290261.688530:0:84889:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b307345d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.688537:0:84889:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b307345d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.688569:0:84889:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b307345d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.688576:0:84889:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aaa00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290261.688579:0:84889:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b307345d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.688586:0:84889:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b307345d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.688597:0:84889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c24688e7300) 00010000:00010000:2.0:1784290261.688600:0:84889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290261.688612:0:84889:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b307345d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.688619:0:84889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b307345d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784290261.688631:0:84889:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a99912d8 reply state 0000000053ee63c2 transno 94489280516 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3073464 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.688641:0:84889:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3073464 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.688648:0:84889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9c24688e7700) 00010000:00010000:2.0:1784290261.688650:0:84889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290261.688652:0:84889:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784290261.688676:0:84889:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b3073456 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21c3 expref: 10 pid: 84889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.688687:0:84889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c24688e7300) 00010000:00010000:2.0:1784290261.688690:0:84889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290261.688694:0:84889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b3073456 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21c3 expref: 10 pid: 84889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.688707:0:84889:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aae00, rc 0) 00010000:00080000:2.0:1784290261.688762:0:84889:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1784290261.688786:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290261.688792:0:84889:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280517 00000020:00080000:2.0:1784290261.688799:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290261.688803:0:84889:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280517 00000100:00100000:0.0:1784290261.713189:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290261.713266:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896196864 00000100:00100000:3.0:1784290261.713277:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896196864 00000100:00100000:3.0:1784290261.713332:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 994 00000100:00100000:3.0:1784290261.713370:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:2396:x1870961896196864:12345-192.168.202.6@tcp:101:lfs.0 00010000:00080000:3.0:1784290261.713387:0:65988:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 94489280517, current: 94489280517, replaying 00000100:00100000:3.0:1784290261.713405:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:2396:x1870961896196864:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 65us (223us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784290261.713415:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 994 00000020:00080000:2.0:1784290261.713494:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290261.713510:0:84889:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280517, next_transno: 94489280517 00010000:00080000:2.0:1784290261.713515:0:84889:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (94489280517) 00000020:00080000:2.0:1784290261.713519:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290261.713530:0:84889:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896196864 t94489280517 from 192.168.202.6@tcp req@ffff9c24483caa00 x1870961896196864/t0(94489280517) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:282/0 lens 736/0 e 0 to 0 dl 1784290272 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1784290261.713581:0:84889:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290261.713600:0:84889:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b3073472 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b21ca expref: -99 pid: 84889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784290261.713672:0:84889:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00000004:00080000:2.0:1784290261.713837:0:84889:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000a811:0x2:0x0], cookie = 0x5953bbf6b30731ee 00000004:00080000:2.0:1784290261.713841:0:84889:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x5953bbf6b30731ee in new mfd 00010000:00010000:2.0:1784290261.713871:0:84889:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b3073472 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21ca expref: 12 pid: 84889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.713885:0:84889:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c24688e7300) 00010000:00010000:2.0:1784290261.713888:0:84889:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784290261.713893:0:84889:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b3073472 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21ca expref: 12 pid: 84889 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.713907:0:84889:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aae00, rc 0) 00010000:00080000:2.0:1784290261.713961:0:84889:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1784290261.713975:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290261.713978:0:84889:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280518 00000020:00080000:2.0:1784290261.713982:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290261.713984:0:84889:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280518 00000100:00100000:0.0:1784290261.715492:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290261.715608:0:68995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896197248 00000100:00100000:3.0:1784290261.715615:0:68995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896197248 00000100:00100000:3.0:1784290261.715654:0:68995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 211 00000100:00100000:3.0:1784290261.715662:0:68995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:2396:x1870961896197248:12345-192.168.202.6@tcp:35:lfs.0 00010000:00080000:3.0:1784290261.715676:0:68995:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 94489280518, current: 94489280518, replaying 00000100:00100000:3.0:1784290261.715695:0:68995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:2396:x1870961896197248:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 35us (208us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784290261.715702:0:68995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 211 00000020:00080000:2.0:1784290261.715719:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290261.715737:0:84889:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280518, next_transno: 94489280518 00010000:00080000:2.0:1784290261.715743:0:84889:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (94489280518) 00000020:00080000:2.0:1784290261.715747:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290261.715760:0:84889:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896197248 t94489280518 from 192.168.202.6@tcp req@ffff9c24483c9880 x1870961896197248/t0(94489280518) o35->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:282/0 lens 392/0 e 0 to 0 dl 1784290272 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784290261.715921:0:84889:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1784290261.715936:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290261.715940:0:84889:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280519 00000020:00080000:2.0:1784290261.715944:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290261.715947:0:84889:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280519 00000100:00100000:0.0:1784290261.717409:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290261.717525:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896197504 00000100:00100000:1.0:1784290261.717533:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896197504 00000100:00100000:1.0:1784290261.717591:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 212 00000100:00100000:1.0:1784290261.717600:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:2396:x1870961896197504:12345-192.168.202.6@tcp:35:lfs.0 00010000:00080000:1.0:1784290261.717613:0:65991:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 94489280519, current: 94489280519, replaying 00000100:00100000:1.0:1784290261.717625:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:2396:x1870961896197504:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 27us (222us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784290261.717635:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 212 00000020:00080000:2.0:1784290261.717636:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290261.717643:0:84889:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280519, next_transno: 94489280519 00010000:00080000:2.0:1784290261.717647:0:84889:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (94489280519) 00000020:00080000:2.0:1784290261.717651:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290261.717662:0:84889:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896197504 t94489280519 from 192.168.202.6@tcp req@ffff9c24483c8700 x1870961896197504/t0(94489280519) o35->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:282/0 lens 392/0 e 0 to 0 dl 1784290272 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784290261.717821:0:84889:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1784290261.717834:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290261.717837:0:84889:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280520 00000020:00080000:2.0:1784290261.717841:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290261.717843:0:84889:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280520 00000100:00100000:0.0:1784290261.720666:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290261.720762:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896201856 00000100:00100000:1.0:1784290261.720770:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896201856 00000100:00100000:1.0:1784290261.720812:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 613 00000100:00100000:1.0:1784290261.720832:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:2396:x1870961896201856:12345-192.168.202.6@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1784290261.720848:0:66004:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9c24483c8380 x1870961896201856/t0(0) o400->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:282/0 lens 224/0 e 0 to 0 dl 1784290272 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290261.720867:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:2396:x1870961896201856:12345-192.168.202.6@tcp:400:ldlm_lock_repla.0 Request processed in 40us (205us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784290261.720874:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 613 00000020:00080000:2.0:1784290261.720910:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290261.720932:0:84889:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 94489280520 00010000:00080000:2.0:1784290261.720937:0:84889:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1784290261.720941:0:84889:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290261.720948:0:84889:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1784290261.720964:0:84889:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1784290261.721062:0:84889:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 23, last_transno is 98784247808 00000001:00100000:0.0:1784290261.722441:0:84858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000001:00100000:0.0:1784290261.722447:0:84858:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1784290261.722464:0:84858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280519 is committed 00010000:00010000:1.0:1784290261.722570:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031e00/0x5953bbf6b3073448 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.722583:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031e00/0x5953bbf6b3073448 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.722591:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031e00/0x5953bbf6b3073448 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784290261.722597:0:84889:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:1.0:1784290261.722598:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2440031e00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290261.722605:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031e00/0x5953bbf6b3073448 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.722614:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031e00/0x5953bbf6b3073448 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.722628:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031e00/0x5953bbf6b3073448 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.722634:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2440031e00/0x5953bbf6b3073448 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1784290261.722635:0:84889:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1784290261.722650:0:84889:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9c2445d6df80 x1870961901020416/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:282/0 lens 224/0 e 0 to 0 dl 1784290272 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1784290261.722660:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3073464 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.722677:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3073464 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.722684:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3073464 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.722689:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290261.722693:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3073464 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.722700:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3073464 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.722709:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9c24688e7700) 00010000:00010000:1.0:1784290261.722712:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290261.722716:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3073464 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.722722:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3073464 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 84889 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1784290261.722747:0:84889:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.202.6@tcp: req@ffff9c24483c8380 x1870961896201856/t0(0) o400->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:282/0 lens 224/0 e 0 to 0 dl 1784290272 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784290261.722783:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1784290261.722795:0:3616:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9c245fe3bb80 x1870961901020416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290277 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784290261.722810:0:3616:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9c245fe3bb80 x1870961901020416/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290277 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1784290261.722817:0:84889:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:3.0:1784290261.722823:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784290261.722851:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1784290261.722859:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901020416:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1784290261.722958:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784290261.722975:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901020544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784290261.723023:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290261.723149:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901020544 00000100:00100000:3.0:1784290261.723157:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901020544 00000100:00100000:3.0:1784290261.723210:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3734 00000100:00100000:3.0:1784290261.723224:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1870961901020544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1784290261.723275:0:22091:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444655104 avail 1298415616 00000100:00100000:3.0:1784290261.723371:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1870961901020544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290261.723383:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3734 00000100:00100000:1.0:1784290261.723414:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901020544:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784290261.724878:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290261.724995:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896201728 00000100:00100000:1.0:1784290261.725005:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896201728 00000100:00100000:1.0:1784290261.725063:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 995 00000100:00100000:1.0:1784290261.725077:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:65047:x1870961896201728:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1784290261.725119:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290261.725137:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b3073480 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b21ed expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.725189:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3073487 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.725205:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3073487 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.725216:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3073487 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290261.725250:0:74876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784290261.725255:0:74876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784290261.725292:0:74876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3073487 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.725312:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b3073480 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21ed expref: 8 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.725326:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3073487 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21ed expref: 7 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.725333:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2458ba5200) 00010000:00010000:1.0:1784290261.725336:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784290261.725339:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236ca00, rc 0) 00000100:00100000:1.0:1784290261.725400:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:65047:x1870961896201728:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 327us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290261.725408:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 995 00000100:00100000:0.0:1784290261.728621:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290261.728671:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896201984 00000100:00100000:1.0:1784290261.728679:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896201984 00000100:00100000:1.0:1784290261.728718:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 996 00000100:00100000:1.0:1784290261.728727:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:65047:x1870961896201984:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:1.0:1784290261.728745:0:66008:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444655104 avail 1298415616 00000100:00100000:1.0:1784290261.728787:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:65047:x1870961896201984:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 61us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290261.728794:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 996 00000100:00100000:0.0:1784290261.730227:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290261.730336:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896202112 00000100:00100000:1.0:1784290261.730364:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896202112 00000100:00100000:1.0:1784290261.730423:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 997 00000100:00080000:0.0:1784290261.730430:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784290261.730434:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:65047:x1870961896202112:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:1.0:1784290261.730454:0:65990:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:1.0:1784290261.730499:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:65047:x1870961896202112:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 67us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290261.730506:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 997 00000100:00100000:0.0:1784290261.732718:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290261.732767:0:15642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896202240 00000100:00100000:1.0:1784290261.732775:0:15642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896202240 00000100:00100000:1.0:1784290261.732812:0:15642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4904 00000100:00100000:1.0:1784290261.732820:0:15642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2396:x1870961896202240:12345-192.168.202.6@tcp:8:lfs.0 00010000:00080000:1.0:1784290261.732848:0:15642:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp t0 exp 0000000000000000 cur 2002 last 0 00000020:00000080:1.0:1784290261.732877:0:15642:0:(genops.c:1406:class_connect()) connect: client bd808cf4-dd54-45f0-9b2b-1434e8330e5d, cookie 0x5953bbf6b307348e 00002000:00100000:1.0:1784290261.732889:0:15642:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bd808cf4-dd54-45f0-9b2b-1434e8330e5d/ffff9c247e4b1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ad ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784290261.732905:0:15642:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784290261.733003:0:15642:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784290261.733048:0:15642:0:(import.c:65:import_set_state_nolock()) ffff9c247e4b2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784290261.733109:0:15642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896202240:12345-192.168.202.6@tcp:8:lfs.0 Request processed in 287us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290261.733119:0:15642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4904 00000001:00100000:3.0:1784290261.734055:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000001:00100000:3.0:1784290261.734072:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000020:00000080:3.0:1784290261.734076:0:8397:0:(genops.c:906:class_export_put()) final put ffff9c24481c4800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000001:00100000:3.0:1784290261.734098:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784290261.734174:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c24481c4800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d for lustre-OST0000 00000020:00000080:1.0:1784290261.734244:0:9947:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c24481c0800 for lustre-OST0000 00000100:00100000:0.0:1784290261.734610:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290261.734656:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896202368 00000100:00100000:3.0:1784290261.734664:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896202368 00000100:00080000:0.0:1784290261.734711:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784290261.734728:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1108 00000100:00100000:3.0:1784290261.734742:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:65047:x1870961896202368:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:3.0:1784290261.734762:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290261.734815:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:65047:x1870961896202368:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 75us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290261.734826:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1108 00000100:00100000:0.0:1784290261.736456:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290261.736501:0:26254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896202496 00000100:00100000:1.0:1784290261.736509:0:26254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896202496 00000100:00100000:1.0:1784290261.736562:0:26254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4905 00000100:00100000:1.0:1784290261.736570:0:26254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2396:x1870961896202496:12345-192.168.202.6@tcp:8:lfs.0 00010000:00080000:1.0:1784290261.736593:0:26254:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp t0 exp 0000000000000000 cur 2002 last 0 00000020:00000080:1.0:1784290261.736611:0:26254:0:(genops.c:1406:class_connect()) connect: client bd808cf4-dd54-45f0-9b2b-1434e8330e5d, cookie 0x5953bbf6b3073495 00002000:00100000:1.0:1784290261.736618:0:26254:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bd808cf4-dd54-45f0-9b2b-1434e8330e5d/ffff9c247e4b0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ad ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784290261.736631:0:26254:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784290261.736683:0:26254:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784290261.736705:0:26254:0:(import.c:65:import_set_state_nolock()) ffff9c247e4b6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784290261.736749:0:26254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896202496:12345-192.168.202.6@tcp:8:lfs.0 Request processed in 178us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290261.736758:0:26254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4905 00000001:00100000:3.0:1784290261.737881:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000001:00100000:3.0:1784290261.737888:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000020:00000080:3.0:1784290261.737891:0:9482:0:(genops.c:906:class_export_put()) final put ffff9c24444af800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000001:00100000:3.0:1784290261.737906:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784290261.737994:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c24444af800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d for lustre-OST0001 00000020:00000080:1.0:1784290261.738039:0:9947:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c24444af000 for lustre-OST0001 00000100:00100000:0.0:1784290261.738182:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290261.738237:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896202624 00000100:00100000:1.0:1784290261.738246:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896202624 00000100:00080000:0.0:1784290261.738320:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784290261.738325:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1109 00000100:00100000:1.0:1784290261.738366:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:65047:x1870961896202624:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:1.0:1784290261.738388:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290261.738451:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:65047:x1870961896202624:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 114us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290261.738463:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1109 00000004:00000080:2.0:1784290261.739919:0:84889:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae54417d7e10 00100000:10000000:2.0:1784290261.739929:0:84889:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1784290261.740323:0:84875:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x45c:0x0] 00000004:00080000:1.0:1784290261.740382:0:84877:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x682:0x0] 00000100:00100000:3.0:1784290261.740388:0:84875:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:84875:1870961901020672:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1784290261.740429:0:84877:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d66300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:84877:1870961901020800:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784290261.740444:0:84875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290261.740481:0:84875:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dac6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784290261.740499:0:26261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901020672 00000100:00100000:1.0:1784290261.740500:0:84877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290261.740507:0:26261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901020672 00000100:00100000:1.0:1784290261.740538:0:84877:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2461c15b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784290261.740580:0:26259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901020800 00000100:00100000:3.0:1784290261.740587:0:26259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901020800 00000100:00100000:0.0:1784290261.740594:0:26261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4906 00000100:00100000:3.0:1784290261.740639:0:26259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4907 00000100:00100000:3.0:1784290261.740654:0:26259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:84877:x1870961901020800:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1784290261.740665:0:26261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:84875:x1870961901020672:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1784290261.740681:0:26259:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1729 -> diff = -63 00002000:02000040:3.0:1784290261.740688:0:26259:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1667 to 0x2c0000401:1729) 00002000:00080000:0.0:1784290261.740696:0:26261:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1729 -> diff = -613 00002000:02000040:0.0:1784290261.740705:0:26261:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1117 to 0x280000401:1729) 00002000:00010000:3.0:1784290261.745627:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290261.745643:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f35661bf/0x5953bbf6b307349c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.745661:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c1:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.745666:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.745672:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f35661bf/0x5953bbf6b307349c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.745688:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f35661bf/0x5953bbf6b307349c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.745698:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f35661bf/0x5953bbf6b307349c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.745707:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f35661bf/0x5953bbf6b307349c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.745729:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.745763:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.745777:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f35661bf/0x5953bbf6b307349c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.745796:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24488dda00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.745803:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f35661bf/0x5953bbf6b307349c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.745813:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290261.745823:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e35e4a45/0x5953bbf6b30734a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.745823:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f35661bf/0x5953bbf6b307349c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.745857:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c0:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.745862:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.745867:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e35e4a45/0x5953bbf6b30734a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.745871:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f35661bf/0x5953bbf6b307349c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.745879:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e35e4a45/0x5953bbf6b30734a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.745884:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f35661bf/0x5953bbf6b307349c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.745915:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e35e4a45/0x5953bbf6b30734a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.745939:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e35e4a45/0x5953bbf6b30734a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.745960:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290261.745965:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784290261.745967:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e35e4a45/0x5953bbf6b30734a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.745976:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24488dce00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.745980:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e35e4a45/0x5953bbf6b30734a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.745988:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e35e4a45/0x5953bbf6b30734a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.746002:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.746004:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e35e4a45/0x5953bbf6b30734a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.746015:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.746015:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e35e4a45/0x5953bbf6b30734a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746029:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f94ce707/0x5953bbf6b30734aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.746036:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.746039:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bf:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:2.0:1784290261.746041:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.746047:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.746048:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.746054:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f94ce707/0x5953bbf6b30734aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746064:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f94ce707/0x5953bbf6b30734aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746071:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f94ce707/0x5953bbf6b30734aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746078:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f94ce707/0x5953bbf6b30734aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746109:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290261.746142:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290261.746153:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f94ce707/0x5953bbf6b30734aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.746157:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290261.746169:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8703e20/0x5953bbf6b30734b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.746186:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24488dca00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290261.746188:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6be:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.746195:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290261.746197:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f94ce707/0x5953bbf6b30734aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746200:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8703e20/0x5953bbf6b30734b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746228:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8703e20/0x5953bbf6b30734b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.746234:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f94ce707/0x5953bbf6b30734aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746239:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8703e20/0x5953bbf6b30734b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746269:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8703e20/0x5953bbf6b30734b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.746281:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f94ce707/0x5953bbf6b30734aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746288:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290261.746302:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f94ce707/0x5953bbf6b30734aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.746311:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.746322:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8703e20/0x5953bbf6b30734b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.746328:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.746331:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24488dd200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290261.746337:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edace156/0x5953bbf6b30734b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.746337:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.746369:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8703e20/0x5953bbf6b30734b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.746375:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.746381:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8703e20/0x5953bbf6b30734b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.746392:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.746397:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bd:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:2.0:1784290261.746409:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8703e20/0x5953bbf6b30734b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746412:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.746426:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edace156/0x5953bbf6b30734b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.746428:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8703e20/0x5953bbf6b30734b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746455:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edace156/0x5953bbf6b30734b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.746462:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.746467:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edace156/0x5953bbf6b30734b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.746467:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.746472:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.746481:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edace156/0x5953bbf6b30734b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746506:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.746525:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.746532:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edace156/0x5953bbf6b30734b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.746557:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24488ddc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.746561:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edace156/0x5953bbf6b30734b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.746570:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.746571:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edace156/0x5953bbf6b30734b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746582:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bbbd396/0x5953bbf6b30734bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.746590:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edace156/0x5953bbf6b30734b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746592:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bc:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.746596:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.746600:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bbbd396/0x5953bbf6b30734bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.746630:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edace156/0x5953bbf6b30734b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746633:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bbbd396/0x5953bbf6b30734bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746659:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bbbd396/0x5953bbf6b30734bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.746665:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.746669:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.746673:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.746682:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bbbd396/0x5953bbf6b30734bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746699:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.746711:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.746721:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bbbd396/0x5953bbf6b30734bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.746734:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24488dd600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.746741:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bbbd396/0x5953bbf6b30734bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.746744:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290261.746756:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b434dad/0x5953bbf6b30734c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.746769:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bbbd396/0x5953bbf6b30734bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746770:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bb:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.746777:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.746787:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b434dad/0x5953bbf6b30734c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746803:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b434dad/0x5953bbf6b30734c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.746803:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bbbd396/0x5953bbf6b30734bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746838:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b434dad/0x5953bbf6b30734c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.746840:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bbbd396/0x5953bbf6b30734bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746863:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b434dad/0x5953bbf6b30734c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.746875:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.746881:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b434dad/0x5953bbf6b30734c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746885:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784290261.746900:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24488dc800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.746906:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b434dad/0x5953bbf6b30734c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.746916:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b434dad/0x5953bbf6b30734c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.746920:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784290261.746922:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.746929:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b434dad/0x5953bbf6b30734c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746931:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000139db908/0x5953bbf6b30734cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.746939:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b434dad/0x5953bbf6b30734c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.746970:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ba:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.746975:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290261.746976:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.746981:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.746984:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000139db908/0x5953bbf6b30734cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.746986:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.746998:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000139db908/0x5953bbf6b30734cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747006:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000139db908/0x5953bbf6b30734cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747013:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000139db908/0x5953bbf6b30734cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747030:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290261.747062:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1784290261.747071:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290261.747073:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000139db908/0x5953bbf6b30734cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747081:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd7f9c38/0x5953bbf6b30734d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747107:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b9:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:1.0:1784290261.747108:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24488dde00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290261.747111:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.747121:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd7f9c38/0x5953bbf6b30734d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.747123:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000139db908/0x5953bbf6b30734cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747140:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd7f9c38/0x5953bbf6b30734d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.747157:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000139db908/0x5953bbf6b30734cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747188:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd7f9c38/0x5953bbf6b30734d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747201:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd7f9c38/0x5953bbf6b30734d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.747202:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000139db908/0x5953bbf6b30734cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.747228:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000139db908/0x5953bbf6b30734cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747230:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.747252:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.747259:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd7f9c38/0x5953bbf6b30734d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.747264:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.747272:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24488dc400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290261.747274:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.747278:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd7f9c38/0x5953bbf6b30734d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.747281:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290261.747281:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.747296:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072e2ae2a/0x5953bbf6b30734db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.747297:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd7f9c38/0x5953bbf6b30734d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747306:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b8:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.747317:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.747345:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072e2ae2a/0x5953bbf6b30734db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.747374:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd7f9c38/0x5953bbf6b30734d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747382:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072e2ae2a/0x5953bbf6b30734db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.747385:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd7f9c38/0x5953bbf6b30734d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747407:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072e2ae2a/0x5953bbf6b30734db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.747416:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.747417:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072e2ae2a/0x5953bbf6b30734db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.747421:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.747425:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.747452:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.747470:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.747477:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072e2ae2a/0x5953bbf6b30734db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.747485:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24488dc000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.747489:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072e2ae2a/0x5953bbf6b30734db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.747494:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.747497:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072e2ae2a/0x5953bbf6b30734db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747502:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b432a0/0x5953bbf6b30734e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747518:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b7:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:2.0:1784290261.747519:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072e2ae2a/0x5953bbf6b30734db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747525:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.747536:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b432a0/0x5953bbf6b30734e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.747538:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072e2ae2a/0x5953bbf6b30734db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747574:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9b432a0/0x5953bbf6b30734e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747628:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b432a0/0x5953bbf6b30734e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747639:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b432a0/0x5953bbf6b30734e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.747642:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.747648:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.747652:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.747665:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290261.747708:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1784290261.747715:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290261.747721:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9b432a0/0x5953bbf6b30734e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747725:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a167d113/0x5953bbf6b30734e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747758:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b6:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:1.0:1784290261.747787:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24488dd400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290261.747796:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290261.747796:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b432a0/0x5953bbf6b30734e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747802:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a167d113/0x5953bbf6b30734e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747813:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a167d113/0x5953bbf6b30734e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747838:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a167d113/0x5953bbf6b30734e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.747841:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b432a0/0x5953bbf6b30734e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747849:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a167d113/0x5953bbf6b30734e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.747878:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9b432a0/0x5953bbf6b30734e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747880:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290261.747897:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9b432a0/0x5953bbf6b30734e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.747901:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.747910:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a167d113/0x5953bbf6b30734e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.747921:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24488dc200 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:3.0:1784290261.747923:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.747926:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a167d113/0x5953bbf6b30734e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747932:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e94c787f/0x5953bbf6b30734f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.747934:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.747937:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a167d113/0x5953bbf6b30734e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.747941:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290261.747948:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.747952:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b5:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.747964:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.747969:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e94c787f/0x5953bbf6b30734f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.747972:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a167d113/0x5953bbf6b30734e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.747986:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e94c787f/0x5953bbf6b30734f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.747988:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a167d113/0x5953bbf6b30734e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748009:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e94c787f/0x5953bbf6b30734f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.748017:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.748022:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.748027:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.748028:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e94c787f/0x5953bbf6b30734f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748046:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290261.748080:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1784290261.748085:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290261.748089:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e94c787f/0x5953bbf6b30734f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748092:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050ee5f62/0x5953bbf6b30734f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748117:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b4:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:1.0:1784290261.748121:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24488dd800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290261.748122:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.748131:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050ee5f62/0x5953bbf6b30734f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.748133:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e94c787f/0x5953bbf6b30734f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748144:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050ee5f62/0x5953bbf6b30734f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.748159:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e94c787f/0x5953bbf6b30734f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748160:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050ee5f62/0x5953bbf6b30734f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748185:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050ee5f62/0x5953bbf6b30734f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.748201:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e94c787f/0x5953bbf6b30734f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748205:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.748222:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.748229:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050ee5f62/0x5953bbf6b30734f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.748242:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290261.748255:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5c9e0a4/0x5953bbf6b30734fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.748260:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e94c787f/0x5953bbf6b30734f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.748281:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24488dcc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.748288:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050ee5f62/0x5953bbf6b30734f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748299:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b3:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.748311:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290261.748314:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.748315:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050ee5f62/0x5953bbf6b30734f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748317:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5c9e0a4/0x5953bbf6b30734fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.748322:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290261.748329:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.748369:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050ee5f62/0x5953bbf6b30734f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748371:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5c9e0a4/0x5953bbf6b30734fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.748398:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050ee5f62/0x5953bbf6b30734f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748401:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5c9e0a4/0x5953bbf6b30734fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748428:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5c9e0a4/0x5953bbf6b30734fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.748436:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.748440:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.748444:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5c9e0a4/0x5953bbf6b30734fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748447:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784290261.748457:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450dac00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.748460:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5c9e0a4/0x5953bbf6b30734fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.748468:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5c9e0a4/0x5953bbf6b30734fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.748474:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784290261.748493:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.748493:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5c9e0a4/0x5953bbf6b30734fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748506:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000017eb776/0x5953bbf6b3073505 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.748509:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5c9e0a4/0x5953bbf6b30734fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748518:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b2:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.748523:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.748528:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000017eb776/0x5953bbf6b3073505 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.748530:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.748534:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.748538:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.748558:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000017eb776/0x5953bbf6b3073505 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748600:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000017eb776/0x5953bbf6b3073505 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748609:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000017eb776/0x5953bbf6b3073505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748628:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290261.748677:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290261.748687:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000017eb776/0x5953bbf6b3073505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.748689:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290261.748701:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0223ab8/0x5953bbf6b307350c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.748719:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450dba00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290261.748720:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b1:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.748729:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290261.748733:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000017eb776/0x5953bbf6b3073505 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748734:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0223ab8/0x5953bbf6b307350c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748761:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0223ab8/0x5953bbf6b307350c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.748767:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000017eb776/0x5953bbf6b3073505 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748771:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0223ab8/0x5953bbf6b307350c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748799:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0223ab8/0x5953bbf6b307350c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.748809:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000017eb776/0x5953bbf6b3073505 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.748837:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000017eb776/0x5953bbf6b3073505 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748842:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.748865:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290261.748869:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.748872:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0223ab8/0x5953bbf6b307350c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.748885:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450da800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290261.748886:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784290261.748888:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.748890:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0223ab8/0x5953bbf6b307350c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.748893:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.748899:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020cbea49/0x5953bbf6b3073513 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.748913:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0223ab8/0x5953bbf6b307350c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748916:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b0:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.748927:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.748938:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020cbea49/0x5953bbf6b3073513 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.748945:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0223ab8/0x5953bbf6b307350c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748950:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020cbea49/0x5953bbf6b3073513 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.748958:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0223ab8/0x5953bbf6b307350c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748965:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020cbea49/0x5953bbf6b3073513 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.748974:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020cbea49/0x5953bbf6b3073513 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749010:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.749015:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.749020:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020cbea49/0x5953bbf6b3073513 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.749026:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.749029:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450dbc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.749034:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020cbea49/0x5953bbf6b3073513 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.749042:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020cbea49/0x5953bbf6b3073513 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.749044:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290261.749059:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c151d97/0x5953bbf6b307351a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.749062:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020cbea49/0x5953bbf6b3073513 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749069:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6af:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:2.0:1784290261.749074:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020cbea49/0x5953bbf6b3073513 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749086:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.749093:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c151d97/0x5953bbf6b307351a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.749095:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.749100:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.749104:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.749107:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c151d97/0x5953bbf6b307351a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749116:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c151d97/0x5953bbf6b307351a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749123:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c151d97/0x5953bbf6b307351a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749139:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290261.749171:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290261.749181:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c151d97/0x5953bbf6b307351a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.749183:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290261.749194:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bc5238f/0x5953bbf6b3073521 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.749213:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450da200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290261.749214:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ae:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.749221:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290261.749226:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c151d97/0x5953bbf6b307351a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749227:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bc5238f/0x5953bbf6b3073521 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749255:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bc5238f/0x5953bbf6b3073521 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.749261:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c151d97/0x5953bbf6b307351a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749266:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bc5238f/0x5953bbf6b3073521 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749283:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bc5238f/0x5953bbf6b3073521 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.749285:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c151d97/0x5953bbf6b307351a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.749307:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c151d97/0x5953bbf6b307351a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749310:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.749327:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.749335:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bc5238f/0x5953bbf6b3073521 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.749360:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450da400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290261.749370:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.749373:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bc5238f/0x5953bbf6b3073521 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.749377:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784290261.749380:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290261.749384:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.749387:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bc5238f/0x5953bbf6b3073521 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749389:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000066b2f2/0x5953bbf6b3073528 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749415:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ad:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.749419:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290261.749419:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bc5238f/0x5953bbf6b3073521 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749430:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000066b2f2/0x5953bbf6b3073528 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.749439:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bc5238f/0x5953bbf6b3073521 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749446:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000066b2f2/0x5953bbf6b3073528 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749456:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000066b2f2/0x5953bbf6b3073528 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.749458:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.749462:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.749467:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.749468:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000066b2f2/0x5953bbf6b3073528 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749484:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290261.749500:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290261.749508:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000066b2f2/0x5953bbf6b3073528 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.749516:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290261.749524:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450da600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290261.749526:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e66d597/0x5953bbf6b307352f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.749558:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000066b2f2/0x5953bbf6b3073528 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749562:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ac:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.749571:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.749601:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e66d597/0x5953bbf6b307352f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.749607:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000066b2f2/0x5953bbf6b3073528 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749619:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e66d597/0x5953bbf6b307352f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749642:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e66d597/0x5953bbf6b307352f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.749651:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000066b2f2/0x5953bbf6b3073528 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749652:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e66d597/0x5953bbf6b307352f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.749695:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000066b2f2/0x5953bbf6b3073528 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749703:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290261.749737:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.749738:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290261.749749:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e66d597/0x5953bbf6b307352f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.749759:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290261.749774:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450db600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290261.749776:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f1c30e8/0x5953bbf6b3073536 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.749801:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e66d597/0x5953bbf6b307352f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749804:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ab:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.749814:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.749825:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f1c30e8/0x5953bbf6b3073536 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.749830:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e66d597/0x5953bbf6b307352f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749837:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f1c30e8/0x5953bbf6b3073536 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.749859:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e66d597/0x5953bbf6b307352f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749868:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f1c30e8/0x5953bbf6b3073536 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.749884:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e66d597/0x5953bbf6b307352f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749886:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f1c30e8/0x5953bbf6b3073536 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749902:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.749923:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290261.749927:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.749930:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f1c30e8/0x5953bbf6b3073536 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.749934:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290261.749942:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.749943:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450daa00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.749949:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f1c30e8/0x5953bbf6b3073536 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.749950:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290261.749963:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fca7382/0x5953bbf6b307353d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.749967:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f1c30e8/0x5953bbf6b3073536 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749974:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6aa:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.749982:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.749987:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fca7382/0x5953bbf6b307353d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.749989:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f1c30e8/0x5953bbf6b3073536 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.749997:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fca7382/0x5953bbf6b307353d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.750026:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f1c30e8/0x5953bbf6b3073536 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.750027:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fca7382/0x5953bbf6b307353d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.750057:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fca7382/0x5953bbf6b307353d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.750065:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.750069:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.750074:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.750111:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290261.750135:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290261.750147:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fca7382/0x5953bbf6b307353d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.750161:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290261.750163:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450db200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290261.750173:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5f3281d/0x5953bbf6b3073544 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.750177:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fca7382/0x5953bbf6b307353d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.750189:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a9:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.750201:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.750211:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5f3281d/0x5953bbf6b3073544 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.750214:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fca7382/0x5953bbf6b307353d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.750228:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5f3281d/0x5953bbf6b3073544 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.750247:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5f3281d/0x5953bbf6b3073544 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.750253:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fca7382/0x5953bbf6b307353d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.750257:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5f3281d/0x5953bbf6b3073544 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.750299:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fca7382/0x5953bbf6b307353d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.750305:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.750330:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.750364:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5f3281d/0x5953bbf6b3073544 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.750375:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450dae00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290261.750380:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.750382:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5f3281d/0x5953bbf6b3073544 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.750385:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290261.750388:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290261.750397:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.750403:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b70e83b/0x5953bbf6b307354b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.750409:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5f3281d/0x5953bbf6b3073544 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.750437:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a8:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:2.0:1784290261.750451:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5f3281d/0x5953bbf6b3073544 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.750454:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.750471:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b70e83b/0x5953bbf6b307354b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.750476:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5f3281d/0x5953bbf6b3073544 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.750502:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b70e83b/0x5953bbf6b307354b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.750513:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.750518:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b70e83b/0x5953bbf6b307354b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.750520:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.750531:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b70e83b/0x5953bbf6b307354b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.750558:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.750596:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.750606:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.750613:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b70e83b/0x5953bbf6b307354b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.750622:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450da000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.750626:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b70e83b/0x5953bbf6b307354b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.750635:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b70e83b/0x5953bbf6b307354b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.750637:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290261.750672:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e56a0def/0x5953bbf6b3073552 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.750678:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b70e83b/0x5953bbf6b307354b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.750683:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a7:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.750696:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290261.750700:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b70e83b/0x5953bbf6b307354b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.750705:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e56a0def/0x5953bbf6b3073552 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.750733:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e56a0def/0x5953bbf6b3073552 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.750743:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.750744:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e56a0def/0x5953bbf6b3073552 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.750751:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.750758:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.750769:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e56a0def/0x5953bbf6b3073552 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.750803:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290261.750837:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1784290261.750845:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290261.750846:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e56a0def/0x5953bbf6b3073552 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.750855:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b01f7cac/0x5953bbf6b3073559 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.750871:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a6:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.750874:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.750883:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b01f7cac/0x5953bbf6b3073559 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.750907:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450dbe00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290261.750908:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b01f7cac/0x5953bbf6b3073559 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.750918:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e56a0def/0x5953bbf6b3073552 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.750921:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b01f7cac/0x5953bbf6b3073559 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.750945:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b01f7cac/0x5953bbf6b3073559 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.750953:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e56a0def/0x5953bbf6b3073552 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.750963:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290261.750977:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e56a0def/0x5953bbf6b3073552 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.750986:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290261.750993:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e56a0def/0x5953bbf6b3073552 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.750994:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b01f7cac/0x5953bbf6b3073559 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.750998:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290261.751012:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac202783/0x5953bbf6b3073560 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751029:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450db800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290261.751036:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a5:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:2.0:1784290261.751037:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b01f7cac/0x5953bbf6b3073559 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.751043:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.751044:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290261.751050:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.751058:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac202783/0x5953bbf6b3073560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.751058:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.751090:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac202783/0x5953bbf6b3073560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751092:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b01f7cac/0x5953bbf6b3073559 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.751114:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac202783/0x5953bbf6b3073560 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751122:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b01f7cac/0x5953bbf6b3073559 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.751124:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac202783/0x5953bbf6b3073560 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751152:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b01f7cac/0x5953bbf6b3073559 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751169:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290261.751170:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784290261.751173:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac202783/0x5953bbf6b3073560 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751181:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450db400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.751184:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac202783/0x5953bbf6b3073560 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751194:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac202783/0x5953bbf6b3073560 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.751199:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.751205:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac202783/0x5953bbf6b3073560 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751230:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac202783/0x5953bbf6b3073560 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.751231:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290261.751248:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dc1d41c/0x5953bbf6b3073567 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.751282:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a4:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.751288:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.751293:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dc1d41c/0x5953bbf6b3073567 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751296:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.751301:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.751309:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.751312:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dc1d41c/0x5953bbf6b3073567 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.751340:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dc1d41c/0x5953bbf6b3073567 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.751350:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002dc1d41c/0x5953bbf6b3073567 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.751395:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.751408:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.751416:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002dc1d41c/0x5953bbf6b3073567 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751427:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450db000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.751433:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002dc1d41c/0x5953bbf6b3073567 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751444:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002dc1d41c/0x5953bbf6b3073567 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.751449:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290261.751461:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c438605/0x5953bbf6b307356e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751462:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002dc1d41c/0x5953bbf6b3073567 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.751520:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a3:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:2.0:1784290261.751523:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dc1d41c/0x5953bbf6b3073567 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.751529:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.751567:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c438605/0x5953bbf6b307356e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751581:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.751603:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c438605/0x5953bbf6b307356e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751604:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.751609:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.751618:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c438605/0x5953bbf6b307356e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.751626:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c438605/0x5953bbf6b307356e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.751668:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.751698:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.751706:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c438605/0x5953bbf6b307356e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290261.751720:0:26259:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290261.751731:0:26259:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049f9a593/0x5953bbf6b3073575 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.751763:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a2:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:2.0:1784290261.751764:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290261.751768:0:26259:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290261.751802:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c438605/0x5953bbf6b307356e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.751803:0:26259:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049f9a593/0x5953bbf6b3073575 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.751834:0:26259:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049f9a593/0x5953bbf6b3073575 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751838:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c438605/0x5953bbf6b307356e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.751844:0:26259:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049f9a593/0x5953bbf6b3073575 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.751866:0:26259:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049f9a593/0x5953bbf6b3073575 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751871:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c438605/0x5953bbf6b307356e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751881:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c438605/0x5953bbf6b307356e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.751883:0:26259:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.751903:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.751908:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049f9a593/0x5953bbf6b3073575 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751915:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290261.751916:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.751919:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049f9a593/0x5953bbf6b3073575 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751928:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049f9a593/0x5953bbf6b3073575 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751939:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049f9a593/0x5953bbf6b3073575 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751955:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049f9a593/0x5953bbf6b3073575 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.751976:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.751980:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.751983:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1784290261.752103:0:26259:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1666 00000100:00100000:3.0:1784290261.752174:0:26259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:84877:x1870961901020800:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11524us (11679us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290261.752185:0:26259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4907 00000100:00100000:1.0:1784290261.752242:0:84877:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d66300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:84877:1870961901020800:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1784290261.752261:0:84877:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x6c1:0x0] from OST, last_created [0x2c0000401:0x6c1:0x0]last_used is [0x2c0000401:0x682:0x0] 00000100:00100000:2.0:1784290261.752376:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901020928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784290261.752407:0:84877:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d67480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:84877:1870961901021056:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1784290261.752429:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290261.752477:0:84877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290261.752480:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901020928 00000100:00100000:3.0:1784290261.752497:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901020928 00000100:00100000:1.0:1784290261.752528:0:84877:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2461c15b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784290261.752577:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:3.0:1784290261.752592:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901020928:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784290261.752596:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901021056 00002000:00000024:3.0:1784290261.752610:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290261.752620:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901021056 00000100:00100000:3.0:1784290261.752678:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901020928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290261.752689:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4908 00000100:00100000:3.0:1784290261.752693:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:1.0:1784290261.752733:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:84877:x1870961901021056:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1784290261.752772:0:26252:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1730 00000100:00100000:2.0:1784290261.752773:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901020928:0@lo:13:osp-pre-1-0.0 00002000:00010000:0.0:1784290261.753082:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290261.753091:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9d719a8/0x5953bbf6b307357c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.753105:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c1:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:0.0:1784290261.753109:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290261.753117:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9d719a8/0x5953bbf6b307357c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.753132:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9d719a8/0x5953bbf6b307357c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.753144:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9d719a8/0x5953bbf6b307357c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.753154:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9d719a8/0x5953bbf6b307357c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.753206:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.753224:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.753231:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9d719a8/0x5953bbf6b307357c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.753240:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585be400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.753244:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9d719a8/0x5953bbf6b307357c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.753254:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9d719a8/0x5953bbf6b307357c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.753270:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9d719a8/0x5953bbf6b307357c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.753277:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9d719a8/0x5953bbf6b307357c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.753287:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290261.753302:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075acfaa5/0x5953bbf6b3073583 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.753317:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c0:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:2.0:1784290261.753318:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.753324:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.753327:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290261.753328:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.753383:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075acfaa5/0x5953bbf6b3073583 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.753402:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075acfaa5/0x5953bbf6b3073583 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.753415:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075acfaa5/0x5953bbf6b3073583 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.753428:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075acfaa5/0x5953bbf6b3073583 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.753477:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.753504:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.753514:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075acfaa5/0x5953bbf6b3073583 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.753526:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585bf000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.753533:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075acfaa5/0x5953bbf6b3073583 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.753575:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075acfaa5/0x5953bbf6b3073583 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.753600:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.753614:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075acfaa5/0x5953bbf6b3073583 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.753616:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000399ad594/0x5953bbf6b307358a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.753641:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075acfaa5/0x5953bbf6b3073583 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.753653:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bf:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:2.0:1784290261.753665:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.753673:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.753675:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290261.753677:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.753691:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000399ad594/0x5953bbf6b307358a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.753711:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000399ad594/0x5953bbf6b307358a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.753728:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000399ad594/0x5953bbf6b307358a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.753744:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000399ad594/0x5953bbf6b307358a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.753774:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.753812:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.753820:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000399ad594/0x5953bbf6b307358a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.753840:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585bf600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.753845:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000399ad594/0x5953bbf6b307358a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.753853:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000399ad594/0x5953bbf6b307358a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.753857:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.753867:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000399ad594/0x5953bbf6b307358a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.753869:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d25f8b5/0x5953bbf6b3073591 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.753887:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000399ad594/0x5953bbf6b307358a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.753895:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6be:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:0.0:1784290261.753902:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6be:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290261.753909:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.753909:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d25f8b5/0x5953bbf6b3073591 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.753914:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.753918:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.753931:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d25f8b5/0x5953bbf6b3073591 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.753944:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d25f8b5/0x5953bbf6b3073591 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.753966:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d25f8b5/0x5953bbf6b3073591 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.753990:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.753997:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.754002:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d25f8b5/0x5953bbf6b3073591 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.754011:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585be200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.754015:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d25f8b5/0x5953bbf6b3073591 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.754023:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d25f8b5/0x5953bbf6b3073591 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.754043:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d25f8b5/0x5953bbf6b3073591 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.754044:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290261.754061:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aea2a26e/0x5953bbf6b3073598 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.754062:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d25f8b5/0x5953bbf6b3073591 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.754117:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bd:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:2.0:1784290261.754122:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.754124:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290261.754127:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.754132:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.754139:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aea2a26e/0x5953bbf6b3073598 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.754160:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aea2a26e/0x5953bbf6b3073598 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.754177:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aea2a26e/0x5953bbf6b3073598 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.754192:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aea2a26e/0x5953bbf6b3073598 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.754221:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.754229:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.754236:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aea2a26e/0x5953bbf6b3073598 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.754246:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585bea00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.754252:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aea2a26e/0x5953bbf6b3073598 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.754262:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aea2a26e/0x5953bbf6b3073598 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.754278:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aea2a26e/0x5953bbf6b3073598 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.754285:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.754288:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aea2a26e/0x5953bbf6b3073598 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.754303:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ed9cb1/0x5953bbf6b307359f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.754330:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.754333:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bc:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:2.0:1784290261.754335:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.754363:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.754378:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290261.754388:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ed9cb1/0x5953bbf6b307359f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.754426:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6ed9cb1/0x5953bbf6b307359f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.754444:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6ed9cb1/0x5953bbf6b307359f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.754460:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6ed9cb1/0x5953bbf6b307359f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.754495:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.754522:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.754531:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6ed9cb1/0x5953bbf6b307359f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.754566:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585bee00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.754572:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ed9cb1/0x5953bbf6b307359f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.754583:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6ed9cb1/0x5953bbf6b307359f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.754618:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6ed9cb1/0x5953bbf6b307359f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.754622:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.754642:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6ed9cb1/0x5953bbf6b307359f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.754643:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1a4c516/0x5953bbf6b30735a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.754674:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bb:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:2.0:1784290261.754677:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.754681:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6bb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290261.754683:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.754688:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.754696:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1a4c516/0x5953bbf6b30735a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.754717:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1a4c516/0x5953bbf6b30735a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.754757:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1a4c516/0x5953bbf6b30735a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.754792:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1a4c516/0x5953bbf6b30735a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.754815:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.754826:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.754833:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1a4c516/0x5953bbf6b30735a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.754854:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585bfc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.754858:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1a4c516/0x5953bbf6b30735a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.754866:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1a4c516/0x5953bbf6b30735a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.754869:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290261.754886:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efa08939/0x5953bbf6b30735ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.754888:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1a4c516/0x5953bbf6b30735a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.754916:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1a4c516/0x5953bbf6b30735a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.754917:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ba:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:0.0:1784290261.754931:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290261.754940:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efa08939/0x5953bbf6b30735ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.754942:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.754947:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.754951:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.754962:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efa08939/0x5953bbf6b30735ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.754976:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efa08939/0x5953bbf6b30735ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.754987:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efa08939/0x5953bbf6b30735ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.755026:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.755032:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.755038:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efa08939/0x5953bbf6b30735ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.755044:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585be800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.755048:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efa08939/0x5953bbf6b30735ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.755057:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efa08939/0x5953bbf6b30735ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.755076:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efa08939/0x5953bbf6b30735ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.755079:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.755089:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efa08939/0x5953bbf6b30735ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.755094:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bcd25f9/0x5953bbf6b30735b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.755130:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b9:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:2.0:1784290261.755131:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.755138:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.755140:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290261.755144:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.755155:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bcd25f9/0x5953bbf6b30735b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.755174:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bcd25f9/0x5953bbf6b30735b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.755189:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bcd25f9/0x5953bbf6b30735b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.755203:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bcd25f9/0x5953bbf6b30735b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.755229:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.755237:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.755245:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bcd25f9/0x5953bbf6b30735b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.755254:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585bfa00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.755260:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bcd25f9/0x5953bbf6b30735b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.755270:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bcd25f9/0x5953bbf6b30735b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.755285:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bcd25f9/0x5953bbf6b30735b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290261.755291:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:84877:x1870961901021056:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2578us (2813us total) trans 4294968625 rc 0/0 00002000:00010000:0.0:1784290261.755298:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.755301:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bcd25f9/0x5953bbf6b30735b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.755312:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd97bd52/0x5953bbf6b30735bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290261.755317:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4908 00010000:00010000:0.0:1784290261.755377:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b8:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:0.0:1784290261.755399:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290261.755401:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.755409:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290261.755411:0:84877:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d67480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:84877:1870961901021056:0@lo:5:osp-pre-1-0.0 00010000:00010000:0.0:1784290261.755412:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd97bd52/0x5953bbf6b30735bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.755415:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784290261.755436:0:84877:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x6c1:0x0]-[0x2c0000401:0x6e1:0x0] 00010000:00010000:0.0:1784290261.755442:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd97bd52/0x5953bbf6b30735bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.755464:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd97bd52/0x5953bbf6b30735bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.755481:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd97bd52/0x5953bbf6b30735bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.755508:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.755520:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.755528:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd97bd52/0x5953bbf6b30735bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.755558:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585bf200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.755564:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd97bd52/0x5953bbf6b30735bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.755592:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd97bd52/0x5953bbf6b30735bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.755602:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.755604:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd97bd52/0x5953bbf6b30735bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.755611:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e936f222/0x5953bbf6b30735c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.755616:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd97bd52/0x5953bbf6b30735bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.755631:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b7:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:0.0:1784290261.755636:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290261.755659:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.755660:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e936f222/0x5953bbf6b30735c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.755664:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.755669:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.755681:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e936f222/0x5953bbf6b30735c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.755691:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e936f222/0x5953bbf6b30735c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.755708:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e936f222/0x5953bbf6b30735c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.755726:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.755739:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.755750:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e936f222/0x5953bbf6b30735c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.755782:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290261.755799:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e86b155/0x5953bbf6b30735c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.755800:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585bf400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.755827:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e936f222/0x5953bbf6b30735c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.755829:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b6:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:0.0:1784290261.755839:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290261.755851:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e86b155/0x5953bbf6b30735c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.755852:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e936f222/0x5953bbf6b30735c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.755872:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e86b155/0x5953bbf6b30735c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.755878:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e936f222/0x5953bbf6b30735c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.755882:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e86b155/0x5953bbf6b30735c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.755898:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e936f222/0x5953bbf6b30735c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.755901:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e86b155/0x5953bbf6b30735c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.755929:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.755933:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e86b155/0x5953bbf6b30735c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.755935:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784290261.755945:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585be000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.755949:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e86b155/0x5953bbf6b30735c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.755956:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e86b155/0x5953bbf6b30735c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.755968:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.755969:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e86b155/0x5953bbf6b30735c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.755984:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e86b155/0x5953bbf6b30735c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.755994:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.755997:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.756002:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.756004:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.756006:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3063919/0x5953bbf6b30735d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756027:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b5:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:0.0:1784290261.756030:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290261.756034:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3063919/0x5953bbf6b30735d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756044:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3063919/0x5953bbf6b30735d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756051:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3063919/0x5953bbf6b30735d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756058:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3063919/0x5953bbf6b30735d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756072:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.756100:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.756108:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3063919/0x5953bbf6b30735d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.756118:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585bf800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.756123:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3063919/0x5953bbf6b30735d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.756133:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3063919/0x5953bbf6b30735d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.756140:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.756147:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3063919/0x5953bbf6b30735d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756149:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4ab26f9/0x5953bbf6b30735d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.756176:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3063919/0x5953bbf6b30735d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756179:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b4:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:0.0:1784290261.756193:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290261.756201:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4ab26f9/0x5953bbf6b30735d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.756206:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.756212:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.756217:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4ab26f9/0x5953bbf6b30735d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.756226:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.756251:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4ab26f9/0x5953bbf6b30735d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756260:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4ab26f9/0x5953bbf6b30735d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756277:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.756287:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.756295:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4ab26f9/0x5953bbf6b30735d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.756306:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585be600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.756311:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4ab26f9/0x5953bbf6b30735d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.756321:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4ab26f9/0x5953bbf6b30735d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.756327:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.756373:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4ab26f9/0x5953bbf6b30735d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756376:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd586027/0x5953bbf6b30735de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.756399:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4ab26f9/0x5953bbf6b30735d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756411:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b3:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:0.0:1784290261.756419:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290261.756423:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.756428:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.756430:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd586027/0x5953bbf6b30735de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.756431:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.756453:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd586027/0x5953bbf6b30735de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756464:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd586027/0x5953bbf6b30735de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756472:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd586027/0x5953bbf6b30735de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756505:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.756514:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.756522:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd586027/0x5953bbf6b30735de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.756533:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585bec00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.756538:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd586027/0x5953bbf6b30735de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.756582:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd586027/0x5953bbf6b30735de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.756582:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290261.756598:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008857b437/0x5953bbf6b30735e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.756608:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd586027/0x5953bbf6b30735de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756612:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b2:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:0.0:1784290261.756626:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290261.756630:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd586027/0x5953bbf6b30735de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756634:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008857b437/0x5953bbf6b30735e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756663:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008857b437/0x5953bbf6b30735e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.756668:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.756673:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008857b437/0x5953bbf6b30735e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.756674:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.756680:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.756691:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008857b437/0x5953bbf6b30735e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756712:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290261.756754:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290261.756763:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008857b437/0x5953bbf6b30735e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.756772:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290261.756795:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290261.756797:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078c85ddc/0x5953bbf6b30735ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.756801:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008857b437/0x5953bbf6b30735e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756809:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b1:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:1.0:1784290261.756813:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008857b437/0x5953bbf6b30735e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756821:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290261.756827:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078c85ddc/0x5953bbf6b30735ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.756831:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008857b437/0x5953bbf6b30735e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756841:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078c85ddc/0x5953bbf6b30735ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.756843:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008857b437/0x5953bbf6b30735e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756855:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078c85ddc/0x5953bbf6b30735ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.756865:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.756865:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078c85ddc/0x5953bbf6b30735ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.756868:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290261.756876:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.756888:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.756909:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.756914:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078c85ddc/0x5953bbf6b30735ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.756923:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.756927:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078c85ddc/0x5953bbf6b30735ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.756934:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078c85ddc/0x5953bbf6b30735ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.756936:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290261.756950:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b18b9c3/0x5953bbf6b30735f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.756956:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078c85ddc/0x5953bbf6b30735ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.756959:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b0:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:0.0:1784290261.756970:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6b0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290261.756975:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b18b9c3/0x5953bbf6b30735f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.757003:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078c85ddc/0x5953bbf6b30735ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.757005:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b18b9c3/0x5953bbf6b30735f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.757028:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b18b9c3/0x5953bbf6b30735f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.757033:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.757038:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.757042:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.757050:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b18b9c3/0x5953bbf6b30735f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.757065:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.757073:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.757096:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b18b9c3/0x5953bbf6b30735f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.757108:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923fe00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.757113:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b18b9c3/0x5953bbf6b30735f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.757123:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b18b9c3/0x5953bbf6b30735f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.757131:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.757137:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b18b9c3/0x5953bbf6b30735f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.757140:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c759241c/0x5953bbf6b30735fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.757163:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b18b9c3/0x5953bbf6b30735f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.757167:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6af:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:0.0:1784290261.757180:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6af:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290261.757188:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c759241c/0x5953bbf6b30735fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.757191:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.757196:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.757204:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c759241c/0x5953bbf6b30735fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.757211:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.757220:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c759241c/0x5953bbf6b30735fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.757230:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c759241c/0x5953bbf6b30735fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.757247:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.757256:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.757264:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c759241c/0x5953bbf6b30735fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.757273:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923e400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.757277:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c759241c/0x5953bbf6b30735fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.757287:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c759241c/0x5953bbf6b30735fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.757304:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c759241c/0x5953bbf6b30735fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.757313:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c759241c/0x5953bbf6b30735fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.757323:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.757332:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.757333:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a5511e5/0x5953bbf6b3073601 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.757371:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.757378:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.757397:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ae:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:0.0:1784290261.757403:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290261.757412:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a5511e5/0x5953bbf6b3073601 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.757444:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a5511e5/0x5953bbf6b3073601 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.757457:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a5511e5/0x5953bbf6b3073601 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.757468:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a5511e5/0x5953bbf6b3073601 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.757489:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.757503:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.757512:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a5511e5/0x5953bbf6b3073601 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.757524:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923f800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.757530:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a5511e5/0x5953bbf6b3073601 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.757572:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290261.757602:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b40a004/0x5953bbf6b3073608 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.757607:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a5511e5/0x5953bbf6b3073601 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.757611:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ad:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:0.0:1784290261.757621:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290261.757628:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b40a004/0x5953bbf6b3073608 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.757630:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a5511e5/0x5953bbf6b3073601 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.757667:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b40a004/0x5953bbf6b3073608 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.757668:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a5511e5/0x5953bbf6b3073601 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.757708:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.757714:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.757717:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b40a004/0x5953bbf6b3073608 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.757719:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.757731:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b40a004/0x5953bbf6b3073608 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.757753:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290261.757810:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290261.757817:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b40a004/0x5953bbf6b3073608 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.757828:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923f000 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:0.0:1784290261.757830:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290261.757833:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b40a004/0x5953bbf6b3073608 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.757836:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fef98e90/0x5953bbf6b307360f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.757846:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b40a004/0x5953bbf6b3073608 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.757848:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ac:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:0.0:1784290261.757852:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290261.757858:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fef98e90/0x5953bbf6b307360f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.757863:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b40a004/0x5953bbf6b3073608 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.757872:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fef98e90/0x5953bbf6b307360f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.757875:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b40a004/0x5953bbf6b3073608 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.757885:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fef98e90/0x5953bbf6b307360f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.757895:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.757895:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fef98e90/0x5953bbf6b307360f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.757898:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290261.757900:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.757931:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.757942:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.757949:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fef98e90/0x5953bbf6b307360f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.757958:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923e200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.757962:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fef98e90/0x5953bbf6b307360f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.757970:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fef98e90/0x5953bbf6b307360f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.757975:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.757984:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fef98e90/0x5953bbf6b307360f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.757985:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032edccc5/0x5953bbf6b3073616 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758012:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ab:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:0.0:1784290261.758015:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290261.758019:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032edccc5/0x5953bbf6b3073616 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758048:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032edccc5/0x5953bbf6b3073616 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.758051:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fef98e90/0x5953bbf6b307360f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758062:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032edccc5/0x5953bbf6b3073616 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758095:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032edccc5/0x5953bbf6b3073616 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.758109:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290261.758118:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784290261.758120:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032edccc5/0x5953bbf6b3073616 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.758140:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923e000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.758146:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032edccc5/0x5953bbf6b3073616 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.758164:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032edccc5/0x5953bbf6b3073616 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.758170:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290261.758184:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e7c5f2f/0x5953bbf6b307361d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.758198:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032edccc5/0x5953bbf6b3073616 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758199:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6aa:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.758211:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.758219:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6aa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290261.758228:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032edccc5/0x5953bbf6b3073616 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758230:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e7c5f2f/0x5953bbf6b307361d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758267:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e7c5f2f/0x5953bbf6b307361d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758280:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e7c5f2f/0x5953bbf6b307361d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.758281:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.758289:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.758293:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e7c5f2f/0x5953bbf6b307361d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.758296:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.758319:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.758380:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.758391:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e7c5f2f/0x5953bbf6b307361d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.758413:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923ec00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.758418:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e7c5f2f/0x5953bbf6b307361d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.758422:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.758434:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e7c5f2f/0x5953bbf6b307361d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758436:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab02bb97/0x5953bbf6b3073624 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758467:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a9:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:2.0:1784290261.758470:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e7c5f2f/0x5953bbf6b307361d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758471:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290261.758486:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab02bb97/0x5953bbf6b3073624 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.758492:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e7c5f2f/0x5953bbf6b307361d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758508:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab02bb97/0x5953bbf6b3073624 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.758519:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.758522:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab02bb97/0x5953bbf6b3073624 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.758524:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.758528:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.758564:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab02bb97/0x5953bbf6b3073624 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758598:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.758610:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.758616:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab02bb97/0x5953bbf6b3073624 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.758625:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923f200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.758629:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab02bb97/0x5953bbf6b3073624 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.758637:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab02bb97/0x5953bbf6b3073624 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.758658:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290261.758671:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002750eb9f/0x5953bbf6b307362b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758687:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a8:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:2.0:1784290261.758688:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab02bb97/0x5953bbf6b3073624 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758692:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290261.758708:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002750eb9f/0x5953bbf6b307362b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.758712:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab02bb97/0x5953bbf6b3073624 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758728:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002750eb9f/0x5953bbf6b307362b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758741:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002750eb9f/0x5953bbf6b307362b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758751:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002750eb9f/0x5953bbf6b307362b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.758752:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.758760:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.758768:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290261.758795:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784290261.758808:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002750eb9f/0x5953bbf6b307362b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.758820:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923f600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.758824:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002750eb9f/0x5953bbf6b307362b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.758826:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.758835:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002750eb9f/0x5953bbf6b307362b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.758844:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.758847:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002750eb9f/0x5953bbf6b307362b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758856:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000999eab26/0x5953bbf6b3073632 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.758858:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002750eb9f/0x5953bbf6b307362b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758876:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a7:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:0.0:1784290261.758883:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290261.758888:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000999eab26/0x5953bbf6b3073632 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.758891:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.758896:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.758899:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.758902:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000999eab26/0x5953bbf6b3073632 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758911:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000999eab26/0x5953bbf6b3073632 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758919:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000999eab26/0x5953bbf6b3073632 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758934:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784290261.758970:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290261.758975:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008c60bf2/0x5953bbf6b3073639 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758981:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a6:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:0.0:1784290261.758984:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290261.758987:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008c60bf2/0x5953bbf6b3073639 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.758996:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008c60bf2/0x5953bbf6b3073639 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.759010:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290261.759021:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000999eab26/0x5953bbf6b3073632 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.759022:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008c60bf2/0x5953bbf6b3073639 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.759050:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923fa00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290261.759051:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008c60bf2/0x5953bbf6b3073639 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.759057:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000999eab26/0x5953bbf6b3073632 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.759074:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000999eab26/0x5953bbf6b3073632 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.759076:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.759113:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290261.759114:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000999eab26/0x5953bbf6b3073632 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.759124:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008c60bf2/0x5953bbf6b3073639 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.759129:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000999eab26/0x5953bbf6b3073632 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.759150:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290261.759155:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923e800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.759167:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008c60bf2/0x5953bbf6b3073639 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.759169:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d54738f/0x5953bbf6b3073640 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.759209:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008c60bf2/0x5953bbf6b3073639 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.759217:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a5:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:3.0:1784290261.759232:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.759233:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290261.759239:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.759243:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d54738f/0x5953bbf6b3073640 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.759244:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008c60bf2/0x5953bbf6b3073639 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.759245:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.759280:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008c60bf2/0x5953bbf6b3073639 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.759283:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d54738f/0x5953bbf6b3073640 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.759312:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d54738f/0x5953bbf6b3073640 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.759320:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.759322:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d54738f/0x5953bbf6b3073640 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.759326:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.759332:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.759414:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290261.759429:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290261.759437:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d54738f/0x5953bbf6b3073640 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.759462:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923ee00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.759467:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d54738f/0x5953bbf6b3073640 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.759478:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d54738f/0x5953bbf6b3073640 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.759481:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290261.759498:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ed5723e/0x5953bbf6b3073647 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.759505:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d54738f/0x5953bbf6b3073640 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.759513:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a4:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:2.0:1784290261.759525:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d54738f/0x5953bbf6b3073640 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.759525:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290261.759533:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ed5723e/0x5953bbf6b3073647 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.759571:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.759575:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ed5723e/0x5953bbf6b3073647 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290261.759576:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290261.759582:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.759593:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ed5723e/0x5953bbf6b3073647 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.759603:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ed5723e/0x5953bbf6b3073647 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.759624:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290261.759663:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290261.759672:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ed5723e/0x5953bbf6b3073647 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.759682:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290261.759686:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923e600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290261.759690:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c1f045a/0x5953bbf6b307364e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.759693:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ed5723e/0x5953bbf6b3073647 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.759703:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a3:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:0.0:1784290261.759715:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290261.759721:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ed5723e/0x5953bbf6b3073647 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.759723:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c1f045a/0x5953bbf6b307364e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.759741:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c1f045a/0x5953bbf6b307364e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.759743:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ed5723e/0x5953bbf6b3073647 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.759758:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c1f045a/0x5953bbf6b307364e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.759759:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ed5723e/0x5953bbf6b3073647 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.759773:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c1f045a/0x5953bbf6b307364e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.759785:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290261.759788:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290261.759794:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c1f045a/0x5953bbf6b307364e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.759797:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784290261.759806:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923fc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290261.759813:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290261.759814:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c1f045a/0x5953bbf6b307364e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.759833:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c1f045a/0x5953bbf6b307364e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.759851:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c1f045a/0x5953bbf6b307364e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290261.759856:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290261.759866:0:26261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040e2114a/0x5953bbf6b3073655 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.759867:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c1f045a/0x5953bbf6b307364e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.759879:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a2:0x0].0x0 since=2002s v=(0 0) 00010000:00010000:0.0:1784290261.759885:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6a2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290261.759892:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040e2114a/0x5953bbf6b3073655 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290261.759899:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290261.759902:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290261.759905:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290261.759908:0:26261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040e2114a/0x5953bbf6b3073655 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.759923:0:26261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040e2114a/0x5953bbf6b3073655 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.759946:0:26261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040e2114a/0x5953bbf6b3073655 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290261.759971:0:26261:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290261.760060:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290261.760071:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040e2114a/0x5953bbf6b3073655 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.760089:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923f400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290261.760096:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040e2114a/0x5953bbf6b3073655 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.760109:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040e2114a/0x5953bbf6b3073655 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.760133:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040e2114a/0x5953bbf6b3073655 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.760146:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040e2114a/0x5953bbf6b3073655 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290261.760175:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.760180:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290261.760182:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1784290261.763706:0:26261:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1116 00000100:00100000:0.0:1784290261.763768:0:26261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:84875:x1870961901020672:12345-0@lo:5:osp-pre-0-0.0 Request processed in 23163us (23325us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290261.763779:0:26261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4906 00000100:00100000:3.0:1784290261.763831:0:84875:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:84875:1870961901020672:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1784290261.763846:0:84875:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x6c1:0x0] from OST, last_created [0x280000401:0x6c1:0x0]last_used is [0x280000401:0x45c:0x0] 00000100:00100000:3.0:1784290261.763928:0:84875:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:84875:1870961901021312:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1784290261.763955:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901021184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784290261.763973:0:84875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290261.764008:0:84875:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dac6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784290261.764016:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290261.764019:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901021312 00000100:00100000:2.0:1784290261.764029:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901021312 00000100:00100000:2.0:1784290261.764100:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4909 00000100:00100000:1.0:1784290261.764100:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901021184 00000100:00100000:1.0:1784290261.764114:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901021184 00000100:00100000:2.0:1784290261.764122:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:84875:x1870961901021312:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1784290261.764162:0:26250:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1730 00000100:00100000:1.0:1784290261.764186:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:1.0:1784290261.764205:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901021184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784290261.764241:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 896 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290261.764312:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901021184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290261.764329:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:0.0:1784290261.764412:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901021184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784290261.766051:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:84875:x1870961901021312:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1937us (2078us total) trans 4294968625 rc 0/0 00000100:00100000:2.0:1784290261.766058:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4909 00000100:00100000:3.0:1784290261.766107:0:84875:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:84875:1870961901021312:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1784290261.766124:0:84875:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x6c1:0x0]-[0x280000401:0x6e1:0x0] 00010000:00010000:2.0:1784290262.567434:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784290262.696275:0:75386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1784290263.207723:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901021440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290263.207752:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901021568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290263.207818:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290263.207868:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290263.207911:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901021440 00000100:00100000:3.0:1784290263.207924:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901021440 00000100:00100000:0.0:1784290263.207971:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901021568 00000100:00100000:0.0:1784290263.207986:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901021568 00000100:00080000:2.0:1784290263.208004:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784290263.208013:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784290263.208020:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:3.0:1784290263.208038:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901021440:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784290263.208069:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00002000:00000024:3.0:1784290263.208077:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290263.208095:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901021568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784290263.208121:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290263.208158:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901021440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290263.208169:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:0.0:1784290263.208224:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901021568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290263.208236:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901021440:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784290263.208248:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:1.0:1784290263.208278:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901021568:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784290263.557687:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290263.557726:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290263.557745:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896202752 00000100:00100000:3.0:1784290263.557756:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896202752 00000100:00100000:0.0:1784290263.557761:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290263.557791:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290263.557822:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896203008 00000100:00100000:3.0:1784290263.557824:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:1.0:1784290263.557831:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896203008 00000100:00100000:2.0:1784290263.557838:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896203264 00000100:00100000:0.0:1784290263.557844:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290263.557845:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+10:2398:x1870961896202752:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290263.557848:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896203264 00000100:00100000:1.0:1784290263.557896:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896202880 00000100:00100000:1.0:1784290263.557901:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896202880 00000100:00100000:2.0:1784290263.557902:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896203136 00000100:00100000:2.0:1784290263.557908:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896203136 00000100:00100000:3.0:1784290263.557919:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+10:2398:x1870961896202752:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 83us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290263.557926:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 614 00000100:00100000:3.0:1784290263.557931:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:2.0:1784290263.557947:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1489 00000100:00100000:0.0:1784290263.557958:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896203008:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290263.557965:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2398:x1870961896203264:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290263.557973:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 615 00000100:00100000:1.0:1784290263.557987:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2398:x1870961896202880:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290263.558009:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1490 00000100:00100000:0.0:1784290263.558016:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896203008:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 62us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290263.558026:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2398:x1870961896203136:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290263.558027:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 614 00000100:00100000:2.0:1784290263.558035:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2398:x1870961896203264:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 74us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290263.558036:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2398:x1870961896202880:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 49us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290263.558053:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1489 00000100:00100000:1.0:1784290263.558056:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 615 00000100:00100000:3.0:1784290263.558070:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2398:x1870961896203136:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 48us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290263.558087:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1490 00000100:00080000:2.0:1784290263.558111:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784290263.558118:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784290263.558123:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784290263.558126:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1784290263.591622:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784290263.884027:0:85437:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00000001:02000400:3.0:1784290264.576636:0:85485:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1784290264.615456:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290265.639583:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290265.859384:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290265.859444:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896203392 00000100:00100000:3.0:1784290265.859455:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896203392 00000100:00080000:2.0:1784290265.859526:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784290265.859546:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 998 00000100:00100000:3.0:1784290265.859560:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:65518:x1870961896203392:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:3.0:1784290265.859599:0:66004:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444655104 avail 1298415616 00000100:00100000:3.0:1784290265.859664:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:65518:x1870961896203392:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 108us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290265.859672:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 998 00000100:00100000:0.0:1784290265.860543:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290265.860589:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896203520 00000100:00100000:3.0:1784290265.860594:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896203520 00000100:00100000:3.0:1784290265.860636:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 999 00000100:00100000:3.0:1784290265.860645:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:65518:x1870961896203520:12345-192.168.202.6@tcp:41:lfs.0 00000100:00080000:2.0:1784290265.860647:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:3.0:1784290265.860668:0:65988:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:3.0:1784290265.860711:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:65518:x1870961896203520:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 66us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290265.860720:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 999 00000100:00100000:0.0:1784290265.862147:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290265.862195:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896203648 00000100:00100000:1.0:1784290265.862201:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896203648 00000100:00100000:1.0:1784290265.862242:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1114 00000100:00100000:1.0:1784290265.862251:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:65518:x1870961896203648:12345-192.168.202.6@tcp:13:lfs.0 00000100:00080000:2.0:1784290265.862262:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1784290265.862271:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290265.862308:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:65518:x1870961896203648:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 59us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290265.862313:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1114 00000100:00100000:0.0:1784290265.863150:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290265.863184:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896203776 00000100:00100000:3.0:1784290265.863190:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896203776 00000100:00100000:3.0:1784290265.863228:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1115 00000100:00100000:3.0:1784290265.863239:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:65518:x1870961896203776:12345-192.168.202.6@tcp:13:lfs.0 00000100:00080000:2.0:1784290265.863249:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1784290265.863259:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290265.863300:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:65518:x1870961896203776:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 63us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290265.863325:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1115 00000100:00100000:0.0:1784290265.876203:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290265.876264:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896204032 00000100:00100000:1.0:1784290265.876272:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896204032 00000100:00100000:1.0:1784290265.876314:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1000 00000100:00100000:1.0:1784290265.876321:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:65534:x1870961896204032:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1784290265.876335:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290265.876379:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b307365c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b21f4 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876437:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d600/0x5953bbf6b3073663 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876448:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d600/0x5953bbf6b3073663 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876458:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d600/0x5953bbf6b3073663 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876468:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307366a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876472:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307366a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876488:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307366a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876573:0:65989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d600/0x5953bbf6b3073663 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876579:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d600/0x5953bbf6b3073663 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876584:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d600/0x5953bbf6b3073663 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876589:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d600/0x5953bbf6b3073663 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876593:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290265.876596:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d600/0x5953bbf6b3073663 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876601:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d600/0x5953bbf6b3073663 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876609:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2458ba5200) 00010000:00010000:1.0:1784290265.876612:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290265.876615:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d600/0x5953bbf6b3073663 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876619:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d600/0x5953bbf6b3073663 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876629:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307366a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876638:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307366a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876642:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307366a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876645:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290265.876647:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307366a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876651:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307366a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876656:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9c2458ba5100) 00010000:00010000:1.0:1784290265.876657:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290265.876659:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307366a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876662:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307366a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876687:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b307365c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21f4 expref: 8 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876694:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2458ba5200) 00010000:00010000:1.0:1784290265.876695:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784290265.876698:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b307365c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21f4 expref: 8 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.876711:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236cc00, rc 0) 00000100:00100000:1.0:1784290265.876749:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:65534:x1870961896204032:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 430us (558us total) trans 0 rc 301/301 00000100:00100000:1.0:1784290265.876755:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1000 00000100:00100000:0.0:1784290265.877900:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290265.877985:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896204160 00000100:00100000:1.0:1784290265.877991:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896204160 00000100:00100000:1.0:1784290265.878024:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1001 00000100:00100000:1.0:1784290265.878032:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:65534:x1870961896204160:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:1.0:1784290265.878061:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b3073671 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878070:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b3073671 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878076:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b3073671 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878083:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236de00/0x5953bbf6b3073678 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878088:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236de00/0x5953bbf6b3073678 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878092:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236de00/0x5953bbf6b3073678 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878120:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b307367f lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878135:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b307367f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878140:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b307367f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290265.878174:0:65990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784290265.878181:0:65990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b307367f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878189:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b3073671 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878194:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b3073671 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878198:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b3073671 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878201:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236da00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290265.878203:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b3073671 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878207:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b3073671 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878213:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2458ba5200) 00010000:00010000:1.0:1784290265.878215:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290265.878217:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b3073671 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878220:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b3073671 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878233:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236de00/0x5953bbf6b3073678 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878238:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236de00/0x5953bbf6b3073678 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878242:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236de00/0x5953bbf6b3073678 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878245:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236de00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290265.878247:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236de00/0x5953bbf6b3073678 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878250:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236de00/0x5953bbf6b3073678 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878255:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9c2458ba5a00) 00010000:00010000:1.0:1784290265.878256:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290265.878258:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236de00/0x5953bbf6b3073678 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878261:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236de00/0x5953bbf6b3073678 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878269:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b307367f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878273:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b307367f lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878276:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b307367f lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878283:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290265.878286:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b307367f lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878290:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b307367f lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878294:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff9c2458ba5c00) 00010000:00010000:1.0:1784290265.878295:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290265.878297:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b307367f lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290265.878300:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b307367f lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290265.878363:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:65534:x1870961896204160:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 310us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290265.878370:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1001 00010000:00010000:3.0:1784290266.663462:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290266.791531:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901021696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784290266.791538:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901021952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784290266.791542:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901021824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784290266.791635:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290266.791641:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290266.791703:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784290266.791710:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901022080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784290266.791729:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901021696 00000100:00100000:1.0:1784290266.791737:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290266.791740:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901021696 00000100:00100000:1.0:1784290266.791794:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901021824 00000100:00100000:1.0:1784290266.791803:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901021824 00000100:00100000:3.0:1784290266.791821:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:3.0:1784290266.791836:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901021696:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784290266.791862:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901022080 00002000:00000024:3.0:1784290266.791864:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290266.791869:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901022080 00000100:00100000:1.0:1784290266.791915:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3735 00000100:00100000:1.0:1784290266.791926:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901021824:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784290266.791935:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901021696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290266.791948:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000004:00000024:1.0:1784290266.791975:0:23867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:3.0:1784290266.791983:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1870961901022336:0@lo:400:kworker.0 00000100:00100000:1.0:1784290266.792039:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901021824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290266.792043:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290266.792062:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3735 00000100:00100000:1.0:1784290266.792102:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3736 00000100:00100000:1.0:1784290266.792116:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1870961901022080:12345-0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1784290266.792118:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784290266.792124:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901021696:0@lo:13:osp-pre-0-0.0 00000004:00000024:1.0:1784290266.792142:0:23867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444655104 avail 1298415616 00000100:00100000:3.0:1784290266.792147:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901022848:0@lo:400:kworker.0 00000100:00100000:2.0:1784290266.792163:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290266.792211:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1870961901022080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290266.792213:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290266.792225:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3736 00000100:00100000:2.0:1784290266.792241:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901022464:0@lo:400:kworker.0 00000100:00100000:3.0:1784290266.792257:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345b31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1870961901023360:0@lo:400:kworker.0 00000100:00100000:1.0:1784290266.792263:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901021952 00000100:00100000:1.0:1784290266.792274:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901021952 00000100:00100000:2.0:1784290266.792328:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290266.792363:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:1.0:1784290266.792378:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901021952:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784290266.792388:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901022336 00002000:00000024:1.0:1784290266.792393:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290266.792395:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901022336 00000100:00100000:2.0:1784290266.792408:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901022976:0@lo:400:kworker.0 00000100:00100000:2.0:1784290266.792453:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290266.792454:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901022464 00000100:00100000:3.0:1784290266.792459:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901022464 00000100:00100000:1.0:1784290266.792467:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901021952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290266.792480:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:3.0:1784290266.792518:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:3.0:1784290266.792529:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1870961901022336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290266.792538:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901021952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784290266.792560:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:1.0:1784290266.792581:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901022464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290266.792593:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1870961901022336:12345-0@lo:400:kworker.0 Request processed in 65us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290266.792609:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:2.0:1784290266.792614:0:26251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901022848 00000100:00100000:2.0:1784290266.792621:0:26251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901022848 00000100:00100000:3.0:1784290266.792648:0:8999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901022976 00000100:00100000:1.0:1784290266.792654:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901022464:12345-0@lo:400:kworker.0 Request processed in 83us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290266.792655:0:8999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901022976 00000100:00100000:1.0:1784290266.792669:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:2.0:1784290266.792691:0:26251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00100000:2.0:1784290266.792703:0:26251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901022848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290266.792711:0:8999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00000100:00100000:1.0:1784290266.792713:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1870961901022592:0@lo:400:kworker.0 00000100:00100000:3.0:1784290266.792727:0:8999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901022976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290266.792782:0:26251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901022848:12345-0@lo:400:kworker.0 Request processed in 79us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290266.792799:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290266.792801:0:8999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901022976:12345-0@lo:400:kworker.0 Request processed in 73us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290266.792814:0:26251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00100000:3.0:1784290266.792825:0:8999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00000100:00100000:1.0:1784290266.792867:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961901023104:0@lo:400:kworker.0 00000100:00100000:2.0:1784290266.792870:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901022208:0@lo:400:kworker.0 00000100:00100000:3.0:1784290266.792890:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290266.792930:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1870961901022336:0@lo:400:kworker.0 00000100:00100000:2.0:1784290266.792962:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290266.792967:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901022848:0@lo:400:kworker.0 00000100:00100000:1.0:1784290266.792968:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290266.793050:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1870961901022720:0@lo:400:kworker.0 00000100:00100000:3.0:1784290266.793051:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901022464:0@lo:400:kworker.0 00000100:00100000:1.0:1784290266.793066:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901022592 00000100:00100000:1.0:1784290266.793073:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901022592 00000100:00100000:3.0:1784290266.793085:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901022976:0@lo:400:kworker.0 00000100:00100000:2.0:1784290266.793115:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290266.793130:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901023360 00000100:00100000:1.0:1784290266.793135:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901023360 00000100:00100000:3.0:1784290266.793145:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901023104 00000100:00100000:3.0:1784290266.793151:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901023104 00000100:00100000:2.0:1784290266.793158:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901023232:0@lo:400:kworker.0 00000100:00100000:1.0:1784290266.793170:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:1.0:1784290266.793184:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1870961901022592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290266.793197:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901022720 00000100:00100000:3.0:1784290266.793204:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901022720 00000100:00100000:2.0:1784290266.793210:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290266.793243:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:1.0:1784290266.793255:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1870961901022592:12345-0@lo:400:kworker.0 Request processed in 75us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290266.793257:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1870961901023360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290266.793268:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00100000:2.0:1784290266.793276:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901022080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784290266.793298:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:1.0:1784290266.793316:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1870961901023104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290266.793317:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901021824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784290266.793332:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1870961901023360:12345-0@lo:400:kworker.0 Request processed in 73us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290266.793393:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:3.0:1784290266.793429:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:1.0:1784290266.793433:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1870961901023104:12345-0@lo:400:kworker.0 Request processed in 123us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290266.793439:0:15642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901023232 00000100:00100000:1.0:1784290266.793448:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00100000:3.0:1784290266.793451:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1870961901022720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290266.793451:0:15642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901023232 00000100:00080000:1.0:1784290266.793475:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784290266.793485:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784290266.793490:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784290266.793507:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784290266.793535:0:15642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:2.0:1784290266.793551:0:15642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901023232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290266.793558:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1870961901022720:12345-0@lo:400:kworker.0 Request processed in 119us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290266.793564:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1870961901022592:0@lo:400:kworker.0 00000100:00100000:3.0:1784290266.793569:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:1.0:1784290266.793591:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961901023104:0@lo:400:kworker.0 00000100:00100000:2.0:1784290266.793621:0:15642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901023232:12345-0@lo:400:kworker.0 Request processed in 74us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290266.793632:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345b31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1870961901023360:0@lo:400:kworker.0 00000100:00100000:2.0:1784290266.793664:0:15642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00100000:1.0:1784290266.793665:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901022208 00000100:00100000:1.0:1784290266.793674:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901022208 00000100:00100000:1.0:1784290266.793716:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784290266.793725:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3620:x1870961901022208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290266.793748:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1870961901022720:0@lo:400:kworker.0 00000100:00100000:3.0:1784290266.793771:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901023232:0@lo:400:kworker.0 00000100:00100000:1.0:1784290266.793773:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3620:x1870961901022208:12345-0@lo:400:kworker.0 Request processed in 48us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290266.793793:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901022208:0@lo:400:kworker.0 00000100:00100000:1.0:1784290266.793796:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:1.0:1784290267.687554:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784290267.818111:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968625 is committed 00000001:00080000:2.0:1784290267.818282:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968625 is committed 00000001:02000400:0.0:1784290268.296919:0:85680:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130b: DoM file create (inherited) replay ========================================================== 08:11:08 (1784290268) 00000100:00100000:0.0:1784290268.325994:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290268.326051:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896204288 00000100:00100000:3.0:1784290268.326061:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896204288 00000100:00100000:3.0:1784290268.326128:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1002 00000100:00080000:2.0:1784290268.326140:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784290268.326143:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:66118:x1870961896204288:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1784290268.326167:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290268.326228:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3073686 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b21fb expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326285:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b307368d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326297:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b307368d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326307:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b307368d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326319:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3073694 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326334:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3073694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326366:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3073694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326424:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b307368d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326430:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b307368d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326435:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b307368d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326439:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b307368d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326444:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045e00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290268.326447:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b307368d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326452:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b307368d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326464:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2458ba5200) 00010000:00010000:3.0:1784290268.326467:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290268.326470:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b307368d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326474:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b307368d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326509:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3073694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326513:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3073694 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326517:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3073694 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326522:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482044200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290268.326539:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3073694 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326546:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3073694 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326556:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9c2469585f00) 00010000:00010000:3.0:1784290268.326559:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290268.326563:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3073694 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326571:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3073694 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326607:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3073686 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21fb expref: 8 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326617:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2458ba5200) 00010000:00010000:3.0:1784290268.326618:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290268.326628:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3073686 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21fb expref: 8 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.326636:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2482044c00, rc 0) 00000100:00100000:3.0:1784290268.326698:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:66118:x1870961896204288:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 560us (710us total) trans 0 rc 301/301 00000100:00100000:3.0:1784290268.326706:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1002 00000100:00100000:0.0:1784290268.327455:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901023616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784290268.327515:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290268.327547:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784290268.327562:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901023488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784290268.327564:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901023616 00000100:00100000:0.0:1784290268.327570:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901023616 00000100:00100000:2.0:1784290268.327612:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290268.327616:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:0.0:1784290268.327625:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901023616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784290268.327646:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784290268.327671:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901023488 00000100:00100000:2.0:1784290268.327676:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901023488 00000100:00100000:0.0:1784290268.327684:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901023616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290268.327690:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:0.0:1784290268.327706:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:0.0:1784290268.327713:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901023488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784290268.327735:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1784290268.327737:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784290268.327741:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290268.327769:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901023488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290268.327775:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:2.0:1784290268.327809:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901023488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784290268.327812:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901023616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784290268.328601:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290268.328635:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896204544 00000100:00100000:2.0:1784290268.328640:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896204544 00000100:00100000:2.0:1784290268.328673:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1003 00000100:00100000:2.0:1784290268.328681:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:66118:x1870961896204544:12345-192.168.202.6@tcp:36:lfs.0 00010000:00010000:2.0:1784290268.328711:0:65989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290268.328723:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3073487 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21ed expref: 7 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.328734:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2458ba5200) 00010000:00010000:2.0:1784290268.328742:0:65989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290268.328773:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307369b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.328780:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307369b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.328796:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307369b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.328807:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30736a2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.328812:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30736a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.328818:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30736a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.330321:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30736a9 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.330329:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30736a9 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.330335:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30736a9 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784290268.330393:0:65989:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000035e177e1 reply state 00000000c7a0450b transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30736a9 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.330402:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30736a9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.330407:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c245a793e00) 00010000:00010000:2.0:1784290268.330410:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290268.330412:0:65989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784290268.330416:0:65989:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1784290268.330427:0:65989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307369b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.330433:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307369b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.330437:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307369b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.330442:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307369b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.330446:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290268.330448:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307369b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.330453:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307369b lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.330460:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2446227a00) 00010000:00010000:2.0:1784290268.330462:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290268.330464:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307369b lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.330468:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b307369b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784290268.330497:0:65989:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000035e177e1 reply state 00000000c7a0450b transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30736a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.330504:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30736a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.330517:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9c2446227f00) 00010000:00010000:2.0:1784290268.330518:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290268.330520:0:65989:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1784290268.330556:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:66118:x1870961896204544:12345-192.168.202.6@tcp:36:lfs.0 Request processed in 1877us (1957us total) trans 98784247809 rc 0/0 00000100:00100000:2.0:1784290268.330565:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1003 00000100:00100000:0.0:1784290268.339144:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290268.339189:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896204672 00000100:00100000:0.0:1784290268.339195:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896204672 00000100:00100000:0.0:1784290268.339247:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1004 00000100:00100000:0.0:1784290268.339259:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:66122:x1870961896204672:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1784290268.339278:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290268.339294:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f200/0x5953bbf6b30736b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2202 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.339373:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ec00/0x5953bbf6b30736b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.339385:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ec00/0x5953bbf6b30736b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.339396:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ec00/0x5953bbf6b30736b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290268.339428:0:66008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784290268.339432:0:66008:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784290268.339451:0:66008:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ec00/0x5953bbf6b30736b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.339505:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f200/0x5953bbf6b30736b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2202 expref: 10 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.339523:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ec00/0x5953bbf6b30736b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2202 expref: 9 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.339531:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2341fb0a00) 00010000:00010000:0.0:1784290268.339534:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784290268.339538:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246923ec00, rc 0) 00000100:00100000:0.0:1784290268.339590:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:66122:x1870961896204672:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 323us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290268.339600:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1004 00000100:00100000:2.0:1784290268.341000:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290268.341026:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896204800 00000100:00100000:0.0:1784290268.341032:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896204800 00000100:00100000:0.0:1784290268.341074:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1005 00000100:00100000:0.0:1784290268.341084:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:66122:x1870961896204800:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1784290268.341094:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290268.341105:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e200/0x5953bbf6b30736be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2209 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341140:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f800/0x5953bbf6b30736c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341150:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f800/0x5953bbf6b30736c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341158:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f800/0x5953bbf6b30736c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341178:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e400/0x5953bbf6b30736cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341186:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e400/0x5953bbf6b30736cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341194:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e400/0x5953bbf6b30736cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341247:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923fe00/0x5953bbf6b30736d3 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341255:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923fe00/0x5953bbf6b30736d3 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341263:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923fe00/0x5953bbf6b30736d3 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290268.341286:0:65990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1784290268.341289:0:65990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784290268.341301:0:65990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923fe00/0x5953bbf6b30736d3 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341311:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f800/0x5953bbf6b30736c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341319:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f800/0x5953bbf6b30736c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341326:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f800/0x5953bbf6b30736c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341372:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923f800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290268.341376:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f800/0x5953bbf6b30736c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341384:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f800/0x5953bbf6b30736c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341394:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2341fb0a00) 00010000:00010000:0.0:1784290268.341396:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290268.341400:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f800/0x5953bbf6b30736c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341407:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f800/0x5953bbf6b30736c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341419:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e400/0x5953bbf6b30736cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341425:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e400/0x5953bbf6b30736cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341431:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e400/0x5953bbf6b30736cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341437:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923e400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290268.341439:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e400/0x5953bbf6b30736cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341446:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e400/0x5953bbf6b30736cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341466:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9c2446227f00) 00010000:00010000:0.0:1784290268.341469:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290268.341473:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e400/0x5953bbf6b30736cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341499:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e400/0x5953bbf6b30736cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341523:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e200/0x5953bbf6b30736be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2209 expref: 11 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341536:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923fe00/0x5953bbf6b30736d3 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2209 expref: 10 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.341544:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c245a793e00) 00010000:00010000:0.0:1784290268.341547:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784290268.341550:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246923fe00, rc 0) 00000100:00100000:0.0:1784290268.341586:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:66122:x1870961896204800:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 504us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290268.341594:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1005 00000100:00100000:2.0:1784290268.342549:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290268.342578:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896205056 00000100:00100000:3.0:1784290268.342584:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896205056 00000100:00100000:3.0:1784290268.342619:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1006 00000100:00100000:3.0:1784290268.342630:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:66122:x1870961896205056:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1784290268.342640:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290268.342653:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b30736da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2210 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290268.342709:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1784290268.342785:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b30736da lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2210 expref: 12 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.342798:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2341fb0a00) 00010000:00010000:3.0:1784290268.342802:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784290268.342808:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b30736da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2210 expref: 12 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290268.342822:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2482044c00, rc 0) 00000100:00100000:3.0:1784290268.342859:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:66122:x1870961896205056:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 230us (309us total) trans 98784247810 rc 301/301 00000100:00100000:3.0:1784290268.342868:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1006 00000100:00100000:2.0:1784290268.344124:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290268.344164:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896205312 00000100:00100000:0.0:1784290268.344170:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896205312 00000100:00100000:0.0:1784290268.344201:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1007 00000100:00100000:0.0:1784290268.344208:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:66122:x1870961896205312:12345-192.168.202.6@tcp:36:lfs.0 00010000:00010000:0.0:1784290268.344233:0:66008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290268.344246:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923fe00/0x5953bbf6b30736d3 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2209 expref: 11 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.344271:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c245a793e00) 00010000:00010000:0.0:1784290268.344274:0:66008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290268.344283:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f400/0x5953bbf6b30736e8 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.344290:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f400/0x5953bbf6b30736e8 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.344296:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f400/0x5953bbf6b30736e8 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290268.344645:0:66008:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003fbd75bc reply state 00000000645e7681 transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f400/0x5953bbf6b30736e8 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.344656:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f400/0x5953bbf6b30736e8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.344661:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c245a793e00) 00010000:00010000:0.0:1784290268.344663:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:0.0:1784290268.344665:0:66008:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784290268.344669:0:66008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000100:00100000:0.0:1784290268.344717:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:66122:x1870961896205312:12345-192.168.202.6@tcp:36:lfs.0 Request processed in 507us (591us total) trans 98784247811 rc 0/0 00000100:00100000:0.0:1784290268.344726:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1007 00000100:00100000:2.0:1784290268.345502:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290268.345535:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896205568 00000100:00100000:3.0:1784290268.345540:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896205568 00000100:00100000:3.0:1784290268.345571:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 213 00000100:00100000:3.0:1784290268.345579:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c20b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:66122:x1870961896205568:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1784290268.345679:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c20b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:66122:x1870961896205568:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 100us (175us total) trans 98784247812 rc 0/0 00000100:00100000:3.0:1784290268.345688:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 213 00000001:00080000:0.0:1784290268.629278:0:84858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247812 is committed 00010000:00010000:1.0:1784290268.629317:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30736a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.629334:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30736a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.629370:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30736a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.629379:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aba00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290268.629386:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30736a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.629397:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30736a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.629415:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9c2446227f00) 00010000:00010000:1.0:1784290268.629418:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290268.629423:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30736a2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.629442:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30736a2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.629465:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30736a9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.629471:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30736a9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.629500:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30736a9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.629507:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290268.629510:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30736a9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.629518:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30736a9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.629530:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c245a793e00) 00010000:00010000:1.0:1784290268.629533:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290268.629538:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30736a9 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.629546:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30736a9 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.629565:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f400/0x5953bbf6b30736e8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.629572:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f400/0x5953bbf6b30736e8 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.629580:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f400/0x5953bbf6b30736e8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.629586:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923f400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290268.629590:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f400/0x5953bbf6b30736e8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.629608:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f400/0x5953bbf6b30736e8 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.629617:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c245a793e00) 00010000:00010000:1.0:1784290268.629620:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784290268.629623:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f400/0x5953bbf6b30736e8 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.629629:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f400/0x5953bbf6b30736e8 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290268.651807:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290268.651884:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896205696 00000100:00100000:1.0:1784290268.651896:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896205696 00000100:00100000:1.0:1784290268.651967:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1008 00000100:00100000:1.0:1784290268.651981:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:66132:x1870961896205696:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:1.0:1784290268.652023:0:66004:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444651008 avail 1298411520 00000100:00100000:1.0:1784290268.652101:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:66132:x1870961896205696:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 122us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290268.652111:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1008 00000100:00100000:2.0:1784290268.653144:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290268.653190:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896205824 00000100:00100000:0.0:1784290268.653196:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896205824 00000100:00080000:2.0:1784290268.653234:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784290268.653243:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1009 00000100:00100000:0.0:1784290268.653250:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:66132:x1870961896205824:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:0.0:1784290268.653277:0:65989:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:0.0:1784290268.653323:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:66132:x1870961896205824:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 72us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290268.653332:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1009 00000100:00100000:2.0:1784290268.654943:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290268.655035:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896205952 00000100:00100000:1.0:1784290268.655041:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896205952 00000100:00080000:2.0:1784290268.655086:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290268.655096:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1120 00000100:00100000:1.0:1784290268.655107:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:66132:x1870961896205952:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:1.0:1784290268.655125:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290268.655164:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:66132:x1870961896205952:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 59us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290268.655171:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1120 00000100:00100000:2.0:1784290268.656037:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290268.656119:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896206080 00000100:00100000:1.0:1784290268.656126:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896206080 00000100:00080000:2.0:1784290268.656162:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784290268.656169:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1121 00000100:00100000:1.0:1784290268.656176:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:66132:x1870961896206080:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:1.0:1784290268.656190:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290268.656223:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:66132:x1870961896206080:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 48us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290268.656229:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1121 00000100:00100000:2.0:1784290268.675382:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290268.675415:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896206336 00000100:00100000:1.0:1784290268.675424:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896206336 00000100:00100000:1.0:1784290268.675497:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1010 00000100:00100000:1.0:1784290268.675538:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:66139:x1870961896206336:12345-192.168.202.6@tcp:36:mcreate.0 00010000:00010000:1.0:1784290268.675601:0:74876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290268.675632:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ec00/0x5953bbf6b30736b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2202 expref: 7 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.675650:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2341fb0a00) 00010000:00010000:1.0:1784290268.675665:0:74876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290268.675734:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30736ef lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.675745:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30736ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.675753:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30736ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.675764:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30736f6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.675776:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30736f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.675782:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30736f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.676101:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30736ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.676108:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30736ef lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.676112:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30736ef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.676116:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236ce00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290268.676119:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30736ef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.676125:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30736ef lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.676133:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2449a35e00) 00010000:00010000:1.0:1784290268.676135:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290268.676138:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30736ef lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.676142:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30736ef lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784290268.676154:0:74876:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f233f32d reply state 00000000a2f2b2e0 transno 98784247813 ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30736f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.676169:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30736f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.676174:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2449a35d00) 00010000:00010000:1.0:1784290268.676175:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784290268.676177:0:74876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784290268.676246:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:66139:x1870961896206336:12345-192.168.202.6@tcp:36:mcreate.0 Request processed in 741us (870us total) trans 98784247813 rc 0/0 00000100:00100000:1.0:1784290268.676252:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1010 00000100:00100000:2.0:1784290268.677113:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290268.677159:0:84865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896206464 00000100:00100000:0.0:1784290268.677165:0:84865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896206464 00000100:00100000:0.0:1784290268.677200:0:84865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 75 00000100:00100000:0.0:1784290268.677209:0:84865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+10:2398:x1870961896206464:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290268.677245:0:84865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+10:2398:x1870961896206464:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 38us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290268.677250:0:84865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 75 00000100:00100000:2.0:1784290268.684313:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290268.684406:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896206592 00000100:00100000:0.0:1784290268.684415:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896206592 00000100:00100000:0.0:1784290268.684491:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1011 00000100:00100000:0.0:1784290268.684529:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:66142:x1870961896206592:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:0.0:1784290268.684549:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290268.684570:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923fa00/0x5953bbf6b30736fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2217 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.684621:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ec00/0x5953bbf6b3073704 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.684632:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ec00/0x5953bbf6b3073704 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.684641:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ec00/0x5953bbf6b3073704 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290268.684702:0:65990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784290268.684706:0:65990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784290268.684725:0:65990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ec00/0x5953bbf6b3073704 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.684746:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923fa00/0x5953bbf6b30736fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2217 expref: 10 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.684759:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ec00/0x5953bbf6b3073704 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2217 expref: 9 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290268.684766:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246dcbd800) 00010000:00010000:0.0:1784290268.684768:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784290268.684771:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246923ec00, rc 0) 00000100:00100000:0.0:1784290268.684813:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:66142:x1870961896206592:12345-192.168.202.6@tcp:101:rm.0 Request processed in 313us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290268.684819:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1011 00000100:00100000:2.0:1784290268.685931:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290268.685966:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896206720 00000100:00100000:1.0:1784290268.685971:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896206720 00000100:00100000:1.0:1784290268.686012:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1012 00000100:00100000:1.0:1784290268.686019:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:66142:x1870961896206720:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:1.0:1784290268.686026:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290268.686034:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b307370b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b221e expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686062:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3073712 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686070:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3073712 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686076:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3073712 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686082:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3073719 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686097:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3073719 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686102:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3073719 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686152:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d600/0x5953bbf6b3073720 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686158:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d600/0x5953bbf6b3073720 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686162:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d600/0x5953bbf6b3073720 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290268.686181:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x4:0x0]: returning size 0 00000004:00200000:1.0:1784290268.686184:0:65988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784290268.686192:0:65988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d600/0x5953bbf6b3073720 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686199:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d600/0x5953bbf6b3073720 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686207:0:65988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3073712 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686211:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3073712 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686216:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3073712 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686229:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3073712 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686233:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290268.686236:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3073712 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686240:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3073712 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686248:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246dcbd800) 00010000:00010000:1.0:1784290268.686250:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290268.686253:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3073712 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686258:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3073712 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686266:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3073719 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686269:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3073719 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686274:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3073719 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686277:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290268.686280:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3073719 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686290:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3073719 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686295:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2449a35d00) 00010000:00010000:1.0:1784290268.686297:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290268.686299:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3073719 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686302:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3073719 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686316:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b307370b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b221e expref: 11 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686323:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d600/0x5953bbf6b3073720 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b221e expref: 10 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.686327:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff9c2449a35e00) 00010000:00010000:1.0:1784290268.686329:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784290268.686330:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236d600, rc 0) 00000100:00100000:1.0:1784290268.686384:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:66142:x1870961896206720:12345-192.168.202.6@tcp:101:rm.0 Request processed in 365us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290268.686391:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1012 00000100:00100000:2.0:1784290268.687772:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290268.687838:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896206976 00000100:00100000:1.0:1784290268.687844:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896206976 00000100:00100000:1.0:1784290268.687875:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1013 00000100:00100000:1.0:1784290268.687881:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:66142:x1870961896206976:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:1.0:1784290268.687915:0:74876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784290268.687926:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d600/0x5953bbf6b3073720 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b221e expref: 10 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.687936:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff9c2449a35e00) 00010000:00010000:1.0:1784290268.687946:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ec00/0x5953bbf6b3073704 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2217 expref: 9 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.687952:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246dcbd800) 00010000:00010000:1.0:1784290268.687966:0:74876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290268.687976:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3073727 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.687983:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3073727 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.687988:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3073727 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.687994:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307372e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.687999:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307372e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688003:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307372e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688033:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3073735 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688046:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3073735 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688052:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3073735 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688186:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b307373c lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688193:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b307373c lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688198:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b307373c lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688203:0:74876:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b307373c lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688207:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b307373c lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688210:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b307373c lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688226:0:74876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290268.688235:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3073735 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688239:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3073735 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688242:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3073735 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688251:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236cc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290268.688254:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3073735 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.688261:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290268.688261:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3073735 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.688270:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b307373c lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688272:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff9c2449a35a00) 00010000:00010000:1.0:1784290268.688278:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784290268.688282:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3073735 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.688283:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236da00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290268.688289:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b307373c lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688291:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3073735 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688301:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3073727 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.688304:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b307373c lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688308:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3073727 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688316:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3073727 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.688318:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff9c2449a35a00) 00010000:00010000:2.0:1784290268.688324:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784290268.688324:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236ca00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290268.688331:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b307373c lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688331:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3073727 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688364:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3073727 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.688372:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b307373c lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688390:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2449a35c00) 00010000:00010000:1.0:1784290268.688392:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290268.688395:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3073727 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.688396:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290268.688399:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290268.688402:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3073727 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290268.688403:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1784290268.688416:0:74876:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f68b93a8 reply state 00000000b986483f transno 98784247814 ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307372e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688425:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307372e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290268.688429:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2449a35d00) 00010000:00010000:1.0:1784290268.688431:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784290268.688432:0:74876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784290268.688466:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:66142:x1870961896206976:12345-192.168.202.6@tcp:36:rm.0 Request processed in 584us (695us total) trans 98784247814 rc 0/0 00000100:00100000:1.0:1784290268.688471:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1013 00010000:00010000:1.0:1784290268.712491:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290269.735608:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290270.759475:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784290271.054388:0:86074:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1784290271.081607:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290271.083025:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896207104 00000100:00100000:3.0:1784290271.083036:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896207104 00000100:00100000:3.0:1784290271.083125:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1014 00000100:00080000:2.0:1784290271.083130:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784290271.083139:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:66209:x1870961896207104:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:3.0:1784290271.083162:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290271.083184:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3073743 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2225 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.083259:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b307374a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.083273:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b307374a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.083284:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b307374a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290271.083327:0:66004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784290271.083331:0:66004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784290271.083380:0:66004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b307374a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.083404:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3073743 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2225 expref: 12 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.083427:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b307374a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2225 expref: 11 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.083435:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2469585c00) 00010000:00010000:3.0:1784290271.083438:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784290271.083442:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2482044200, rc 0) 00010000:00000080:3.0:1784290271.083448:0:66004:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c247f98b480 x1870961896207104/t0(0) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:292/0 lens 576/688 e 0 to 0 dl 1784290282 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290271.083526:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:66209:x1870961896207104:12345-192.168.202.6@tcp:101:touch.0 Request processed in 392us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290271.083533:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1014 00000100:00100000:2.0:1784290271.084604:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290271.084657:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896207232 00000100:00100000:0.0:1784290271.084666:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896207232 00000100:00100000:3.0:1784290271.084746:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1015 00000100:00100000:3.0:1784290271.084759:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:66209:x1870961896207232:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:3.0:1784290271.084770:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290271.084783:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3073751 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b222c expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.084827:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073758 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.084840:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073758 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.084852:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073758 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.084885:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b307375f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.084896:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b307375f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.084907:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b307375f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.085007:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044a00/0x5953bbf6b3073766 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.085015:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044a00/0x5953bbf6b3073766 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.085022:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044a00/0x5953bbf6b3073766 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290271.085043:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1784290271.085046:0:65988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784290271.085059:0:65988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044a00/0x5953bbf6b3073766 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.085074:0:65988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073758 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.085083:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073758 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.085092:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073758 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.085116:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073758 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.085125:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290271.085130:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073758 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.085140:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073758 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.085154:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2469585c00) 00010000:00010000:3.0:1784290271.085158:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290271.085163:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073758 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.085171:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073758 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.085188:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b307375f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.085196:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b307375f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.085204:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b307375f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.085209:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290271.085213:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b307375f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.085237:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b307375f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.085249:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9c2469585800) 00010000:00010000:3.0:1784290271.085252:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290271.085256:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b307375f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.085264:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b307375f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.085300:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3073751 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b222c expref: 13 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.085318:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044a00/0x5953bbf6b3073766 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b222c expref: 12 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.085327:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c2469585000) 00010000:00010000:3.0:1784290271.085331:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784290271.085335:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2482044a00, rc 0) 00010000:00000080:3.0:1784290271.085383:0:65988:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c247f988a80 x1870961896207232/t0(0) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:292/0 lens 592/688 e 0 to 0 dl 1784290282 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290271.085436:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:66209:x1870961896207232:12345-192.168.202.6@tcp:101:touch.0 Request processed in 680us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290271.085447:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1015 00000100:00100000:2.0:1784290271.086357:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290271.086401:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896207488 00000100:00100000:0.0:1784290271.086409:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896207488 00000100:00100000:0.0:1784290271.086473:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1016 00000100:00100000:0.0:1784290271.086487:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:66209:x1870961896207488:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290271.086499:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290271.086522:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f000/0x5953bbf6b307376d lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2233 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.086613:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e600/0x5953bbf6b3073774 lrc: 3/0,1 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.086627:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e600/0x5953bbf6b3073774 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.086638:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e600/0x5953bbf6b3073774 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.086655:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923fc00/0x5953bbf6b307377b lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.086666:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923fc00/0x5953bbf6b307377b lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.086676:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923fc00/0x5953bbf6b307377b lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.087114:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ea00/0x5953bbf6b3073782 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.087127:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ea00/0x5953bbf6b3073782 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.087138:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ea00/0x5953bbf6b3073782 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290271.087179:0:66008:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1784290271.087184:0:66008:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb mtime from disk: 0 -> 1784290271 00000004:00010000:0.0:1784290271.087188:0:66008:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb atime from disk: 0 -> 1784290271 00000004:00010000:0.0:1784290271.087198:0:66008:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb ctime from disk: 0 -> 1784290271 00000004:00010000:0.0:1784290271.087201:0:66008:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:0.0:1784290271.087206:0:66008:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:0.0:1784290271.087213:0:66008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e600/0x5953bbf6b3073774 lrc: 4/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.087223:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e600/0x5953bbf6b3073774 lrc: 4/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.087231:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e600/0x5953bbf6b3073774 lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.087240:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e600/0x5953bbf6b3073774 lrc: 4/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.087248:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923e600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290271.087252:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e600/0x5953bbf6b3073774 lrc: 4/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.087260:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e600/0x5953bbf6b3073774 lrc: 5/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.087273:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c2469585000) 00010000:00010000:0.0:1784290271.087276:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290271.087281:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e600/0x5953bbf6b3073774 lrc: 3/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.087289:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923e600/0x5953bbf6b3073774 lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290271.087304:0:66008:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000483a8e13 reply state 00000000b07b7231 transno 98784247815 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923fc00/0x5953bbf6b307377b lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.087332:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923fc00/0x5953bbf6b307377b lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.087389:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9c246dcbd400) 00010000:00010000:0.0:1784290271.087392:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290271.087396:0:66008:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784290271.087423:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923f000/0x5953bbf6b307376d lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2233 expref: 15 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.087438:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ea00/0x5953bbf6b3073782 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2233 expref: 14 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.087446:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9c246dcbdb00) 00010000:00010000:0.0:1784290271.087449:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1784290271.087471:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246923ea00, rc 0) 00010000:00000080:0.0:1784290271.087479:0:66008:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c23443b8e00 x1870961896207488/t98784247815(0) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:292/0 lens 752/824 e 0 to 0 dl 1784290282 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290271.087539:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+15:66209:x1870961896207488:12345-192.168.202.6@tcp:101:touch.0 Request processed in 1056us (1200us total) trans 98784247815 rc 0/0 00000100:00100000:0.0:1784290271.087549:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1016 00000100:00100000:2.0:1784290271.089048:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290271.089102:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896207744 00000100:00100000:0.0:1784290271.089109:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896207744 00000100:00100000:0.0:1784290271.089150:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1017 00000100:00100000:0.0:1784290271.089161:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+15:66209:x1870961896207744:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:0.0:1784290271.089218:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ee00/0x5953bbf6b3073790 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.089245:0:65990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ea00/0x5953bbf6b3073782 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2233 expref: 15 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.089256:0:65990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ee00/0x5953bbf6b3073790 lrc: 4/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.089291:0:65990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ea00/0x5953bbf6b3073782 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2233 expref: 15 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.089306:0:65990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ea00/0x5953bbf6b3073782 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2233 expref: 15 pid: 66008 timeout: 2112 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290271.089322:0:65990:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c88380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:65990:1870961901023744:192.168.202.6@tcp:104: 00000100:00100000:0.0:1784290271.089434:0:65990:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24803b3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290271.090412:0:65990:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c88380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:65990:1870961901023744:192.168.202.6@tcp:104: 00010000:00010000:0.0:1784290271.090447:0:65990:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ee00/0x5953bbf6b3073790 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290271.090528:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290271.090575:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896207872 00000100:00100000:0.0:1784290271.090580:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896207872 00010000:00010000:0.0:1784290271.090597:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ea00/0x5953bbf6b3073782 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2233 expref: 16 pid: 66008 timeout: 2112 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290271.090624:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2575 00000100:00100000:0.0:1784290271.090631:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245818ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+16:2400:x1870961896207872:12345-192.168.202.6@tcp:102:ldlm_bl.0 00010000:00010000:0.0:1784290271.090643:0:7430:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ea00/0x5953bbf6b3073782 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2233 expref: 16 pid: 66008 timeout: 2112 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.090660:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ea00/0x5953bbf6b3073782 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2233 expref: 16 pid: 66008 timeout: 2112 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.090668:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ea00/0x5953bbf6b3073782 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2233 expref: 16 pid: 66008 timeout: 2112 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.090674:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9c246dcbdb00) 00010000:00010000:0.0:1784290271.090676:0:7430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1784290271.090679:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ee00/0x5953bbf6b3073790 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.090686:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ee00/0x5953bbf6b3073790 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.090691:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ee00/0x5953bbf6b3073790 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.090713:0:7430:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ea00/0x5953bbf6b3073782 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2233 expref: 16 pid: 66008 timeout: 2112 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.090735:0:65990:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ee00/0x5953bbf6b3073790 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.090745:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ee00/0x5953bbf6b3073790 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290271.090755:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245818ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+16:2400:x1870961896207872:12345-192.168.202.6@tcp:102:ldlm_bl.0 Request processed in 120us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290271.090768:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2575 00000004:00010000:2.0:1784290271.090817:0:65990:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1784290271.090821:0:65990:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb mtime from disk: 1784290271 -> 1784290271 00000004:00010000:2.0:1784290271.090824:0:65990:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb atime from disk: 1784290271 -> 1784290271 00000004:00010000:2.0:1784290271.090834:0:65990:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb ctime from disk: 1784290271 -> 1784290271 00000004:00010000:2.0:1784290271.090837:0:65990:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:2.0:1784290271.090843:0:65990:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aeb5ebb7 reply state 0000000057152eb8 transno 98784247816 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ee00/0x5953bbf6b3073790 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.090854:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ee00/0x5953bbf6b3073790 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.090861:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9c246dcbdb00) 00010000:00010000:2.0:1784290271.090864:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290271.090866:0:65990:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:2.0:1784290271.090894:0:65990:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c23443baa00 x1870961896207744/t98784247816(0) o36->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:292/0 lens 488/456 e 0 to 0 dl 1784290282 ref 1 fl Interpret:/200/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290271.090937:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+17:66209:x1870961896207744:12345-192.168.202.6@tcp:36:touch.0 Request processed in 1778us (1890us total) trans 98784247816 rc 0/0 00000100:00100000:2.0:1784290271.090944:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1017 00000100:00100000:2.0:1784290271.091735:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290271.091818:0:68995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896208128 00000100:00100000:1.0:1784290271.091825:0:68995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896208128 00000100:00100000:1.0:1784290271.091870:0:68995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 214 00000100:00100000:1.0:1784290271.091879:0:68995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+17:66209:x1870961896208128:12345-192.168.202.6@tcp:35:touch.0 00010000:00000080:1.0:1784290271.091991:0:68995:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2467def800 x1870961896208128/t98784247817(0) o35->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:292/0 lens 392/456 e 0 to 0 dl 1784290282 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290271.092046:0:68995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+18:66209:x1870961896208128:12345-192.168.202.6@tcp:35:touch.0 Request processed in 168us (313us total) trans 98784247817 rc 0/0 00000100:00100000:1.0:1784290271.092054:0:68995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 214 00000020:01000004:1.0:1784290271.667420:0:86171:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1784290271.667472:0:86171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440031800/0x5953bbf6b307330d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073314 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.667492:0:86171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440031800/0x5953bbf6b307330d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073314 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.667498:0:86171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440031800/0x5953bbf6b307330d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3073314 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.667502:0:86171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c2440031800/0x5953bbf6b307330d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3073314 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.667517:0:86171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784290271.667521:0:86171:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784290271.667542:0:86171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784290271.667546:0:86171:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784290271.667549:0:86171:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784290271.667569:0:86171:0:(import.c:65:import_set_state_nolock()) ffff9c246d58b000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1784290271.667581:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290271.667590:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c2440031800/0x5953bbf6b307330d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3073314 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.667597:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2440031800 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:2.0:1784290271.667600:0:8418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c2440031800/0x5953bbf6b307330d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3073314 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.667608:0:8418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2440031800/0x5953bbf6b307330d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3073314 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290271.667614:0:8418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2440031800/0x5953bbf6b307330d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3073314 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290271.667627:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901023872:0@lo:39:umount.0 10000000:01000000:2.0:1784290271.667628:0:8418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784290271.667632:0:8418:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784290271.667636:0:8418:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784290271.667664:0:8418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c2440031800/0x5953bbf6b307330d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073314 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.667669:0:8418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784290271.667708:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c2440031800/0x5953bbf6b307330d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073314 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.667713:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2440031800/0x5953bbf6b307330d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073314 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290271.667725:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1784290271.667726:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290271.667729:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290271.667731:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290271.667737:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290271.667739:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901024000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290271.667777:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290271.667782:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901023872 00000100:00100000:0.0:1784290271.667790:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901023872 00000100:00100000:2.0:1784290271.667824:0:10356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901024000 00000100:00100000:2.0:1784290271.667829:0:10356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901024000 00000100:00100000:0.0:1784290271.667845:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:0.0:1784290271.667857:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1870961901023872:12345-0@lo:39:umount.0 00000100:00100000:2.0:1784290271.667869:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:2.0:1784290271.667878:0:10356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3619:x1870961901024000:12345-0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1784290271.667879:0:65989:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307342c 00010000:00010000:2.0:1784290271.667889:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:0.0:1784290271.667899:0:65989:0:(import.c:65:import_set_state_nolock()) ffff9c2474ee7800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1784290271.667904:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3073314 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b307330d expref: 24 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.667919:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290271.667920:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:0.0:1784290271.667932:0:65989:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2445d6d880 x1870961901023872/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:292/0 lens 224/224 e 0 to 0 dl 1784290282 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290271.667963:0:10356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3619:x1870961901024000:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290271.667969:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:1.0:1784290271.667973:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467dec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901024000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290271.667990:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3616:x1870961901023872:12345-0@lo:39:umount.0 Request processed in 136us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290271.667998:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000020:00000080:0.0:1784290271.668008:0:65989:0:(genops.c:906:class_export_put()) final put ffff9c2474ee6800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1784290271.668028:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246d58b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:1.0:1784290271.668029:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2474ee6800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1784290271.668049:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901023872:0@lo:39:umount.0 00000100:00080000:2.0:1784290271.668079:0:86171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000020:00000080:1.0:1784290271.668084:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2474ee7800 for lustre-MDT0000 00000100:00100000:2.0:1784290271.668090:0:86171:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784290271.668094:0:86171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784290271.668882:0:86171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440030200/0x5953bbf6b307323b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073242 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.668889:0:86171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440030200/0x5953bbf6b307323b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073242 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.668893:0:86171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440030200/0x5953bbf6b307323b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3073242 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.668897:0:86171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c2440030200/0x5953bbf6b307323b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3073242 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.668910:0:86171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290271.668913:0:86171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440030000/0x5953bbf6b3073330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073337 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.668918:0:86171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440030000/0x5953bbf6b3073330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073337 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.668922:0:86171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440030000/0x5953bbf6b3073330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3073337 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.668925:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290271.668927:0:86171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c2440030000/0x5953bbf6b3073330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3073337 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.668931:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c2440030200/0x5953bbf6b307323b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3073242 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.668939:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2440030200 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:1.0:1784290271.668942:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c2440030200/0x5953bbf6b307323b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3073242 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.668943:0:86171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290271.668952:0:86171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30732ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073306 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.668954:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2440030200/0x5953bbf6b307323b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3073242 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290271.668965:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2440030200/0x5953bbf6b307323b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3073242 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.668975:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290271.668986:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c2440030000/0x5953bbf6b3073330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3073337 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290271.668987:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784290271.668989:0:86171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30732ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073306 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290271.668992:0:7429:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1784290271.669008:0:86171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30732ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3073306 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.669010:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c2440030200/0x5953bbf6b307323b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073242 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.669011:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2440030000 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:3.0:1784290271.669020:0:19681:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c2440030000/0x5953bbf6b3073330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3073337 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.669022:0:86171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30732ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3073306 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.669023:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784290271.669042:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c2440030200/0x5953bbf6b307323b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073242 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.669047:0:19681:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2440030000/0x5953bbf6b3073330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3073337 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.669049:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2440030200/0x5953bbf6b307323b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073242 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.669052:0:86171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290271.669061:0:86171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440030c00/0x5953bbf6b307322d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073234 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784290271.669078:0:19681:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2440030000/0x5953bbf6b3073330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3073337 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.669078:0:86171:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440030c00/0x5953bbf6b307322d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073234 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.669082:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290271.669083:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290271.669088:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290271.669092:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30732ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3073306 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.669097:0:86171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2440030c00/0x5953bbf6b307322d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3073234 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.669101:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784290271.669107:0:19681:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1784290271.669117:0:19681:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1784290271.669118:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa400 already unused, calling callback (ffffffffc14a9c20) 00010000:00010000:2.0:1784290271.669119:0:86171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c2440030c00/0x5953bbf6b307322d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3073234 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290271.669119:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901024128:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1784290271.669122:0:19681:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 10000000:00010000:0.0:1784290271.669126:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30732ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3073306 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.669144:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30732ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3073306 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.669147:0:86171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:00010000:0.0:1784290271.669150:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30732ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3073306 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.669151:0:19681:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c2440030000/0x5953bbf6b3073330 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073337 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290271.669152:0:86171:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1784290271.669159:0:86171:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:1.0:1784290271.669161:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1784290271.669170:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784290271.669174:0:19681:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1784290271.669174:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1784290271.669180:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1784290271.669188:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290271.669192:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c2440030000/0x5953bbf6b3073330 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073337 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.669194:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c2440030c00/0x5953bbf6b307322d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3073234 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290271.669202:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1784290271.669204:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30732ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073306 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290271.669212:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901024256:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784290271.669218:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2440030000/0x5953bbf6b3073330 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073337 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.669227:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784290271.669239:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2440030c00 already unused, calling callback (ffffffffc14a9c20) 00000100:00100000:1.0:1784290271.669240:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784290271.669245:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30732ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073306 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290271.669246:0:8418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c2440030c00/0x5953bbf6b307322d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3073234 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.669252:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290271.669263:0:8418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2440030c00/0x5953bbf6b307322d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3073234 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290271.669265:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290271.669272:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290271.669281:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30732ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073306 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290271.669282:0:8418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2440030c00/0x5953bbf6b307322d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3073234 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290271.669290:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901024128 00000100:00100000:1.0:1784290271.669296:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901024128 10000000:01000000:2.0:1784290271.669302:0:8418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1784290271.669305:0:8418:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1784290271.669307:0:8418:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1784290271.669308:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784290271.669309:0:86171:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00010000:00010000:0.0:1784290271.669313:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1784290271.669316:0:86171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00010000:00010000:0.0:1784290271.669317:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784290271.669325:0:86171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1784290271.669326:0:8418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c2440030c00/0x5953bbf6b307322d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073234 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290271.669327:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784290271.669328:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901024256 00000100:00100000:1.0:1784290271.669332:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901024256 00000020:02000400:3.0:1784290271.669336:0:86171:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:2.0:1784290271.669360:0:8418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784290271.669368:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901024384:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290271.669372:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c2440030c00/0x5953bbf6b307322d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073234 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.669379:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2440030c00/0x5953bbf6b307322d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073234 expref: -99 pid: 84857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.669393:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290271.669397:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290271.669401:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290271.669407:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:0.0:1784290271.669409:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290271.669418:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3617:x1870961901024128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290271.669437:0:19591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1784290271.669444:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901024384 00000100:00100000:2.0:1784290271.669463:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901024384 00010000:00010000:1.0:1784290271.669463:0:19591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ef8800/0x5953bbf6b3073242 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b307323b expref: 24 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.669480:0:19591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784290271.669487:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901024512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290271.669513:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:2.0:1784290271.669529:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245f7eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3617:x1870961901024256:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290271.669529:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3617:x1870961901024128:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290271.669534:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290271.669544:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00010000:00010000:2.0:1784290271.669548:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290271.669563:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073337 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073330 expref: 23 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290271.669570:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901024512 00000100:00100000:1.0:1784290271.669574:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901024512 00010000:00010000:2.0:1784290271.669576:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784290271.669590:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:0.0:1784290271.669602:0:19593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3620:x1870961901024384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290271.669613:0:19593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784290271.669616:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:2.0:1784290271.669619:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245f7eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3617:x1870961901024256:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (381us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290271.669628:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b3073306 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30732ff expref: 23 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290271.669632:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:1.0:1784290271.669633:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3620:x1870961901024512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290271.669647:0:19591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290271.669651:0:19593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290271.669661:0:19591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebfa00/0x5953bbf6b3073234 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b307322d expref: 21 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.669683:0:19591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784290271.669694:0:19593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:3620:x1870961901024384:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290271.669705:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:1.0:1784290271.669716:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:3620:x1870961901024512:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290271.669722:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:0.0:1784290271.669741:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ded500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901024512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290271.669752:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901024384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290271.669760:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901024256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290271.669770:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901024128:0@lo:103:ldlm_bl.0 00000004:00000080:3.0:1784290271.671835:0:86171:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:0.0:1784290271.672245:0:84858:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247817 is committed 00010000:00010000:1.0:1784290271.672270:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30736f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.672279:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30736f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.672284:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30736f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.672288:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290271.672291:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30736f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.672296:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30736f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.672308:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2449a35d00) 00010000:00010000:1.0:1784290271.672310:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290271.672313:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30736f6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.672317:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30736f6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784290271.672324:0:86171:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1784290271.672334:0:86171:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c24444ac800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1784290271.672337:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307372e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.672370:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307372e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.672375:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307372e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.672384:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d000 already unused, calling callback (ffffffffc1aba4f0) 00000020:00080000:3.0:1784290271.672387:0:86171:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2474ee3800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1784290271.672389:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307372e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.672404:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307372e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290271.672408:0:86171:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c24444ae000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1784290271.672413:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2449a35d00) 00000020:00080000:3.0:1784290271.672418:0:86171:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2474cc1800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1784290271.672418:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290271.672422:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307372e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.672433:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307372e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290271.672436:0:86171:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2474cc5800 bd808cf4-dd54-45f0-9b2b-1434e8330e5d 192.168.202.6@tcp 11 (0 0 3) 0 0 0 2: ffff9c2468b3d000 98784247817 stale:0 00000020:00080000:3.0:1784290271.672446:0:86171:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9c245fdd0000) has exports, disconnecting them 00010000:00010000:1.0:1784290271.672464:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923fc00/0x5953bbf6b307377b lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290271.672468:0:86171:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c24444ac800), last request at 1784290261 00010000:00010000:1.0:1784290271.672473:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923fc00/0x5953bbf6b307377b lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784290271.672477:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073425 00010000:00010000:1.0:1784290271.672479:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923fc00/0x5953bbf6b307377b lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784290271.672485:0:86171:0:(import.c:65:import_set_state_nolock()) ffff9c24444ab000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1784290271.672495:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923fc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290271.672498:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923fc00/0x5953bbf6b307377b lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.672502:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923fc00/0x5953bbf6b307377b lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.672509:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9c246dcbd400) 00000020:00080000:3.0:1784290271.672511:0:86171:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c24444ac800): rc 0 00010000:00010000:1.0:1784290271.672513:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00000080:3.0:1784290271.672519:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c24444ac800/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:1.0:1784290271.672519:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923fc00/0x5953bbf6b307377b lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.672521:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290271.672529:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923fc00/0x5953bbf6b307377b lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290271.672542:0:86171:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2474ee3800), last request at 1784290266 00010000:00010000:1.0:1784290271.672542:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ee00/0x5953bbf6b3073790 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784290271.672552:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307341e 00010000:00010000:1.0:1784290271.672553:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ee00/0x5953bbf6b3073790 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290271.672560:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ee00/0x5953bbf6b3073790 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784290271.672562:0:86171:0:(import.c:65:import_set_state_nolock()) ffff9c2474ee5000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1784290271.672567:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923ee00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290271.672571:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ee00/0x5953bbf6b3073790 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1784290271.672571:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c24444ac800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1784290271.672575:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ee00/0x5953bbf6b3073790 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290271.672583:0:86171:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2474ee3800): rc 0 00000020:00000080:3.0:1784290271.672591:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c2474ee3800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1784290271.672595:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290271.672598:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9c246dcbdb00) 00010000:00010000:1.0:1784290271.672601:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:3.0:1784290271.672602:0:86171:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c24444ae000), last request at 1784290266 00010000:00010000:1.0:1784290271.672605:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ee00/0x5953bbf6b3073790 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784290271.672610:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073417 00010000:00010000:1.0:1784290271.672612:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ee00/0x5953bbf6b3073790 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784290271.672622:0:86171:0:(import.c:65:import_set_state_nolock()) ffff9c24444ab800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1784290271.672634:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c24444ab000 for lustre-MDT0000 00000020:00000080:0.0:1784290271.672640:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2474ee3800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:3.0:1784290271.672652:0:86171:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c24444ae000): rc 0 00000020:00000080:3.0:1784290271.672657:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c24444ae000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:1.0:1784290271.672665:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784290271.672667:0:86171:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2474cc1800), last request at 1784290256 00000020:00000080:0.0:1784290271.672669:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2474ee5000 for lustre-MDT0000 00000020:00000080:0.0:1784290271.672677:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c24444ae000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1784290271.672685:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073281 00000100:00080000:3.0:1784290271.672701:0:86171:0:(import.c:65:import_set_state_nolock()) ffff9c2344b52800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1784290271.672704:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c24444ab800 for lustre-MDT0000 00010000:00010000:1.0:1784290271.672731:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784290271.672757:0:86171:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2474cc1800): rc 0 00000020:00000080:3.0:1784290271.672760:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c2474cc1800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:3.0:1784290271.672774:0:86171:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.6@tcp (ffff9c2474cc5800), last request at 1784290271 00000020:00000080:3.0:1784290271.672778:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307327a 00000020:00010000:3.0:1784290271.672785:0:86171:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2474cc5800: total 1 00000020:00000080:0.0:1784290271.672789:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2474cc1800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000100:00080000:3.0:1784290271.672791:0:86171:0:(import.c:65:import_set_state_nolock()) ffff9c24444ad800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784290271.672811:0:86171:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.6@tcp (ffff9c2474cc5800): rc 0 00000020:00000080:0.0:1784290271.672817:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2344b52800 for lustre-MDT0000 00000004:00000080:3.0:1784290271.672818:0:86171:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae5441d37ae0 00000020:00010000:2.0:1784290271.672822:0:8418:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2474cc5800: total 0 00000100:00080000:3.0:1784290271.672839:0:86171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784290271.672843:0:86171:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1784290271.672856:0:8418:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2474cc5800, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1784290271.672879:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246923ea00/0x5953bbf6b3073782 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2233 expref: 4 pid: 66008 timeout: 2112 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.672898:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b307374a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2225 expref: 3 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.672914:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044a00/0x5953bbf6b3073766 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b222c expref: 2 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290271.672924:0:8418:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2474cc5800, canceled 3 locks, left on hash table 0. 00000100:00080000:3.0:1784290271.680775:0:86171:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1784290271.680790:0:86171:0:(import.c:65:import_set_state_nolock()) ffff9c23458df800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784290271.680843:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901024640:0@lo:39:umount.0 00000100:00100000:0.0:1784290271.680897:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290271.680944:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901024640 00000100:00100000:1.0:1784290271.680950:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901024640 00000100:00080000:3.0:1784290271.680959:0:86171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784290271.680964:0:86171:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:3.0:1784290271.680973:0:86171:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c2445d6fb80 x1870961901021312/t4294968625(4294968625) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784290277 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290271.680983:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3737 00000100:00100000:1.0:1784290271.681001:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3616:x1870961901024640:12345-0@lo:39:umount.0 00000004:00080000:3.0:1784290271.681013:0:86171:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:1.0:1784290271.681018:0:23867:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30732c0 00000100:00080000:1.0:1784290271.681024:0:23867:0:(import.c:65:import_set_state_nolock()) ffff9c247f8f0800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1784290271.681044:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1784290271.681060:0:23867:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378739 00000100:00080000:3.0:1784290271.681090:0:86171:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1784290271.681104:0:86171:0:(import.c:65:import_set_state_nolock()) ffff9c23458de000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1784290271.681120:0:86171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784290271.681123:0:86171:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:3.0:1784290271.681131:0:86171:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c2347d67480 x1870961901021056/t4294968625(4294968625) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784290277 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290271.681136:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901024768:0@lo:9:umount.0 00000100:00100000:1.0:1784290271.681173:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3616:x1870961901024640:12345-0@lo:39:umount.0 Request processed in 174us (275us total) trans 81604378740 rc 0/0 00000004:00080000:3.0:1784290271.681178:0:86171:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784290271.681182:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290271.681183:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3737 00000100:00100000:1.0:1784290271.681212:0:26254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901024768 00000100:00100000:1.0:1784290271.681215:0:26254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901024768 00000100:00080000:0.0:1784290271.681220:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c23458df800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784290271.681226:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901024640:0@lo:39:umount.0 00000100:00100000:1.0:1784290271.681254:0:26254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4910 00000100:00080000:0.0:1784290271.681257:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784290271.681258:0:86171:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1784290271.681263:0:26254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3616:x1870961901024768:12345-0@lo:9:umount.0 00000100:00080000:3.0:1784290271.681275:0:86171:0:(import.c:65:import_set_state_nolock()) ffff9c23454bd000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784290271.681296:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901024896:0@lo:9:umount.0 00000100:00100000:0.0:1784290271.681321:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1784290271.681335:0:86171:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c245fdd0000) has no exports 00000100:00100000:0.0:1784290271.681369:0:26257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901024896 00000100:00100000:0.0:1784290271.681373:0:26257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901024896 00000100:00100000:0.0:1784290271.681409:0:26257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4911 00000100:00100000:0.0:1784290271.681415:0:26257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3616:x1870961901024896:12345-0@lo:9:umount.0 00000020:00000080:0.0:1784290271.681428:0:26257:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30732ea 00000100:00080000:0.0:1784290271.681433:0:26257:0:(import.c:65:import_set_state_nolock()) ffff9c2344981000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1784290271.681480:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1784290271.681483:0:26257:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968625 00000100:00100000:0.0:1784290271.681587:0:26257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+2:3616:x1870961901024896:12345-0@lo:9:umount.0 Request processed in 171us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290271.681607:0:26257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4911 00000100:00100000:3.0:1784290271.681610:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968625 gen 3 00000100:00080000:3.0:1784290271.681617:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c23454bd000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1784290271.681628:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1784290271.681630:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1784290271.681635:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784290271.681640:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901024896:0@lo:9:umount.0 00000020:00080000:3.0:1784290271.681830:0:86171:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c245fdd0000) has no exports 00000020:00000080:1.0:1784290271.682316:0:26254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30732dc 00000100:00080000:1.0:1784290271.682322:0:26254:0:(import.c:65:import_set_state_nolock()) ffff9c247f8f4000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784290271.682381:0:26254:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968625 00010000:00010000:0.0:1784290271.682382:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290271.682467:0:26254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+2:3616:x1870961901024768:12345-0@lo:9:umount.0 Request processed in 1207us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290271.682488:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968625 gen 3 00000100:00100000:1.0:1784290271.682492:0:26254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4910 00000100:00080000:0.0:1784290271.682495:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c23458de000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784290271.682504:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784290271.682506:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784290271.682509:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901024768:0@lo:9:umount.0 00000020:00000080:2.0:1784290271.861294:0:8418:0:(genops.c:906:class_export_put()) final put ffff9c2474cc5800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000020:00000080:0.0:1784290271.861391:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2474cc5800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d for lustre-MDT0000 00010000:00010000:1.0:1784290271.861422:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290271.861429:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290271.861433:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784290271.861462:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c24444ad800 for lustre-MDT0000 00000020:00000080:3.0:1784290271.873604:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073296 00000020:00000080:3.0:1784290271.873616:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c246dcff800/lustre-QMT0000_UUID 00000020:01000000:3.0:1784290271.873629:0:86171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1784290271.873652:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dcff800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1784290271.873674:0:86171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784290271.873684:0:86171:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784290271.873688:0:86171:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9c2445c14d40) has no exports 00010000:00010000:1.0:1784290271.873722:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784290271.873855:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307328f 00000020:00000080:0.0:1784290271.873861:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c2343837800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784290271.873928:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343837800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784290271.873931:0:86171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784290271.873939:0:86171:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1784290271.873942:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c2343830000/lustre-QMT0000_UUID 00000020:00000080:0.0:1784290271.873944:0:86171:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343830000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1784290271.873949:0:86171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1784290271.874079:0:86171:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c23458394e0 - data ffff9c247095a870/ffff9c234680b000 00000020:01000000:0.0:1784290271.874177:0:86171:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c247f9ac900 - data ffff9c247577d360/ffff9c2344607c00 00000100:00080000:1.0:1784290271.905210:0:86171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784290271.905218:0:86171:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784290271.905234:0:86171:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c2445d6ca80 x1870961901024640/t81604378740(81604378740) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290281 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290271.905259:0:86171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1784290271.906534:0:86171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784290271.906537:0:86171:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968625 gen 4 00000004:00080000:1.0:1784290271.906557:0:86171:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784290271.906559:0:86171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784290271.906730:0:84874:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784290271.906740:0:84874:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5c:0x0] index 1 count 1 00000040:00080000:2.0:1784290271.906751:0:84874:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 23 count 2 00000100:00080000:1.0:1784290271.907335:0:86171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784290271.907364:0:86171:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968625 gen 4 00000004:00080000:1.0:1784290271.907375:0:86171:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784290271.907377:0:86171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784290271.907557:0:84876:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784290271.907569:0:84876:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x5e:0x0] index 1 count 1 00000040:00080000:2.0:1784290271.907578:0:84876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 23 count 2 00000020:00000080:1.0:1784290271.908207:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073250 00000020:00000080:1.0:1784290271.908216:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c2342ef6800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784290271.908238:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2342ef6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784290271.909175:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073265 00000020:00000080:1.0:1784290271.909181:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c2474cc5000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784290271.909195:0:86171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1784290271.909211:0:86171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784290271.909216:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2474cc5000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1784290271.909228:0:86171:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784290271.909234:0:86171:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9c245fdd4d40) has no exports 00000004:01000000:1.0:1784290271.909519:0:86171:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1784290271.909527:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30732e3 00000020:00000080:1.0:1784290271.909532:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c234563f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784290271.909542:0:86171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1784290271.909549:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c234563f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784290271.909557:0:86171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784290271.909567:0:86171:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784290271.909571:0:86171:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9c247d2699c0) has no exports 00000020:00000080:1.0:1784290271.909577:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30732d5 00000020:00000080:1.0:1784290271.909580:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c23454bc800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784290271.909593:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c23454bc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1784290271.910138:0:86171:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1784290271.910142:0:86171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784290271.910144:0:86171:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968625 gen 5 00000004:00080000:1.0:1784290271.910148:0:86171:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784290271.910150:0:86171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784290271.910171:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c23454bd000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784290271.910191:0:86171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290271.910210:0:86171:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784290271.910214:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c246dd92800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784290271.910217:0:86171:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dd92800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1784290271.910223:0:86171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784290271.910303:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30732c7 00000020:00000080:1.0:1784290271.910309:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c246dd97000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784290271.910319:0:86171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1784290271.910323:0:86171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784290271.910325:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dd97000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784290271.910330:0:86171:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784290271.910335:0:86171:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9c247d268000) has no exports 00000020:00000080:1.0:1784290271.910363:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30732b9 00000020:00000080:1.0:1784290271.910368:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c23458da800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784290271.910383:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c23458da800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1784290271.910899:0:86171:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1784290271.910903:0:86171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784290271.910906:0:86171:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968625 gen 5 00000004:00080000:1.0:1784290271.910910:0:86171:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784290271.910912:0:86171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784290271.910930:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c23458de000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784290271.910951:0:86171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290271.910960:0:86171:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784290271.910964:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c246dd95000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784290271.910973:0:86171:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dd95000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1784290271.910979:0:86171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1784290271.911041:0:86171:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1784290271.911052:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30732ab 00000020:00000080:1.0:1784290271.911057:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c246dd93800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784290271.911067:0:86171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1784290271.911071:0:86171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784290271.911074:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dd93800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1784290271.911078:0:86171:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784290271.911084:0:86171:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9c247d26b380) has no exports 00000020:00000080:1.0:1784290271.911088:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30732a4 00000020:00000080:1.0:1784290271.911092:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c23458d9800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784290271.911106:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c23458d9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1784290271.911442:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901025024:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290271.911536:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290271.911551:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1870961901025536:0@lo:400:kworker.0 00000100:00100000:2.0:1784290271.911576:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901025152:0@lo:400:kworker.0 00000100:00100000:0.0:1784290271.911599:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290271.911618:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290271.911644:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901026048:0@lo:400:kworker.0 00000100:00100000:1.0:1784290271.911665:0:84864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901025152 00000100:00100000:1.0:1784290271.911672:0:84864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901025152 00000100:00100000:2.0:1784290271.911680:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1870961901025664:0@lo:400:kworker.0 00000100:00100000:0.0:1784290271.911690:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290271.911719:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290271.911729:0:84864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784290271.911744:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784290271.911746:0:84864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:3617:x1870961901025152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290271.911754:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1870961901025408:0@lo:400:kworker.0 00000100:00100000:2.0:1784290271.911756:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1870961901026176:0@lo:400:kworker.0 00000100:00100000:0.0:1784290271.911807:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290271.911813:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1870961901025280:0@lo:400:kworker.0 00000100:00100000:1.0:1784290271.911821:0:84864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474480050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:3617:x1870961901025152:12345-0@lo:400:kworker.0 Request processed in 78us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290271.911831:0:84864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784290271.911845:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901025920:0@lo:400:kworker.0 00000100:00100000:2.0:1784290271.911854:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290271.911883:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901025792:0@lo:400:kworker.0 00000100:00100000:0.0:1784290271.911891:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290271.911919:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290271.911948:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901025536 00000100:00100000:0.0:1784290271.911954:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901025536 00000100:00100000:2.0:1784290271.911981:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901025024 00000100:00100000:0.0:1784290271.911986:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901025664 00000100:00100000:0.0:1784290271.911990:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901025664 00000100:00100000:2.0:1784290271.911995:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901025024 00000100:00100000:2.0:1784290271.912031:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901025792 00000100:00100000:2.0:1784290271.912035:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901025792 00000100:00100000:0.0:1784290271.912035:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901025408 00000100:00100000:0.0:1784290271.912042:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901025408 00000100:00100000:2.0:1784290271.912064:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3738 00000100:00100000:2.0:1784290271.912071:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3617:x1870961901025024:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784290271.912071:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901025280 00000100:00100000:0.0:1784290271.912077:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901025280 00000020:00080000:2.0:1784290271.912081:0:8412:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784290271.912100:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:0.0:1784290271.912118:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1870961901025664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290271.912134:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3617:x1870961901025024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (598us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784290271.912141:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3738 00000100:00100000:2.0:1784290271.912159:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3739 00000100:00100000:2.0:1784290271.912163:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244405b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3618:x1870961901025792:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784290271.912169:0:8412:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784290271.912174:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1870961901025664:12345-0@lo:400:kworker.0 Request processed in 64us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290271.912185:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00100000:2.0:1784290271.912207:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244405b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3618:x1870961901025792:12345-0@lo:400:kworker.0 Request processed in 40us (287us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784290271.912213:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:2.0:1784290271.912218:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3739 00000100:00100000:0.0:1784290271.912228:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1870961901025408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290271.912244:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1784290271.912250:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3620:x1870961901025536:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784290271.912254:0:65990:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784290271.912281:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1870961901025408:12345-0@lo:400:kworker.0 Request processed in 55us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290271.912288:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3620:x1870961901025536:12345-0@lo:400:kworker.0 Request processed in 36us (690us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784290271.912295:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:2.0:1784290271.912302:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:0.0:1784290271.912327:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:0.0:1784290271.912362:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3618:x1870961901025280:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1784290271.912369:0:74876:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:2.0:1784290271.912419:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1784290271.912420:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3618:x1870961901025280:12345-0@lo:400:kworker.0 Request processed in 78us (567us total) trans 0 rc -107/-107 00000100:00080000:2.0:1784290271.912424:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784290271.912429:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784290271.912432:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290271.912441:0:3618:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2002 00000100:00100000:0.0:1784290271.912460:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00080000:2.0:1784290271.912462:0:3618:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290271.912493:0:26263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901026048 00000100:00100000:0.0:1784290271.912498:0:26263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901026048 00000100:00100000:2.0:1784290271.912505:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c244405a680 x1870961901026304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290271.912527:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901025792:0@lo:400:kworker.0 00000100:00100000:0.0:1784290271.912535:0:26263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901025920 00000100:00100000:0.0:1784290271.912546:0:26263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901025920 00000100:00080000:2.0:1784290271.912563:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784290271.912567:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784290271.912570:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784290271.912573:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290271.912577:0:3618:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2002 00000100:00100000:0.0:1784290271.912582:0:26263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00080000:2.0:1784290271.912583:0:3618:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290271.912597:0:26263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901026048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290271.912601:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2444059880 x1870961901026432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290271.912614:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1870961901025280:0@lo:400:kworker.0 00000100:00100000:0.0:1784290271.912664:0:26263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901026048:12345-0@lo:400:kworker.0 Request processed in 69us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290271.912672:0:26263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:0.0:1784290271.912687:0:26263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:0.0:1784290271.912694:0:26263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901025920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290271.912732:0:26263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901025920:12345-0@lo:400:kworker.0 Request processed in 38us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290271.912739:0:26263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00080000:0.0:1784290271.912779:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784290271.912783:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784290271.912786:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784290271.912802:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c244405a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901026304:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1784290271.912832:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290271.912856:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901026304 00000100:00100000:2.0:1784290271.912861:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901026304 00000100:00100000:0.0:1784290271.912865:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901026432:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1784290271.912884:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3740 00000100:00100000:2.0:1784290271.912890:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901026304:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1784290271.912899:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:2.0:1784290271.912907:0:8412:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1784290271.912952:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901026432 00000100:00100000:0.0:1784290271.912957:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901026432 00000100:00100000:0.0:1784290271.912974:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:0.0:1784290271.912978:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901026432:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1784290271.912987:0:65990:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1784290271.913023:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901026432:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 43us (130us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290271.913029:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00080000:0.0:1784290271.913050:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290271.913054:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290271.913057:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901026432:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1784290271.913073:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:02020000:0.0:1784290271.913104:0:3617:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1784290271.913107:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784290271.913110:0:3617:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9c246dd98000 already not connected (conn 27, was 26): CONNECTING 00000100:00100000:0.0:1784290271.913118:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901025152:0@lo:400:kworker.0 00000100:00100000:0.0:1784290271.913132:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1870961901025664:0@lo:400:kworker.0 00000100:00100000:0.0:1784290271.913146:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901026176 00000100:00100000:0.0:1784290271.913149:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901026176 00000100:00100000:0.0:1784290271.913165:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:0.0:1784290271.913169:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1870961901026176:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1784290271.913173:0:66008:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784290271.913197:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1870961901026176:12345-0@lo:400:kworker.0 Request processed in 27us (123us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784290271.913202:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:0.0:1784290271.913223:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1870961901025408:0@lo:400:kworker.0 00000100:00100000:0.0:1784290271.913230:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901025920:0@lo:400:kworker.0 00000100:00080000:0.0:1784290271.913248:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784290271.913251:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784290271.913254:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784290271.913262:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784290271.913265:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2002 00000100:00080000:0.0:1784290271.913269:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290271.913283:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c247f989880 x1870961901026560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290271.913297:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1870961901025536:0@lo:400:kworker.0 00000100:00100000:0.0:1784290271.913308:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901026048:0@lo:400:kworker.0 00000100:00100000:0.0:1784290271.913326:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901026560:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1784290271.913369:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290271.913391:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901026560 00000100:00100000:0.0:1784290271.913395:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901026560 00000100:00100000:0.0:1784290271.913410:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:0.0:1784290271.913414:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1870961901026560:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1784290271.913422:0:65988:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1784290271.913460:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1870961901026560:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 32us (77us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290271.913472:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00080000:0.0:1784290271.913494:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290271.913497:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290271.913500:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901026560:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1784290271.913516:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784290271.913518:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784290271.913521:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784290271.913530:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784290271.913533:0:3617:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2002 00000100:00080000:0.0:1784290271.913537:0:3617:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290271.913549:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c247f989880 x1870961901026688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290271.913563:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1870961901026176:0@lo:400:kworker.0 00000100:00100000:0.0:1784290271.913578:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901026688:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1784290271.913599:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290271.913619:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901026688 00000100:00100000:0.0:1784290271.913621:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901026688 00000100:00100000:0.0:1784290271.913635:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:0.0:1784290271.913639:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234326ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901026688:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1784290271.913647:0:65990:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1784290271.913670:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234326ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901026688:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 30us (70us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290271.913675:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00080000:0.0:1784290271.913693:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290271.913696:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290271.913698:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901026688:0@lo:38:ptlrpcd_00_00.0 00010000:01000000:0.0:1784290271.913720:0:86171:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1784290271.913722:0:86171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784290271.913724:0:86171:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784290271.913728:0:86171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784290271.913738:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c23458df800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1784290271.913762:0:86171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784290271.913774:0:86171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784290271.913777:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c23458df000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784290271.913779:0:86171:0:(genops.c:865:class_export_destroy()) destroying export ffff9c23458df000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1784290271.913785:0:86171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784290271.913837:0:86171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784290271.913841:0:86171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784290271.913843:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c245fd7a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784290271.913845:0:86171:0:(genops.c:865:class_export_destroy()) destroying export ffff9c245fd7a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1784290271.913848:0:86171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784290271.913888:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307326c 00000020:00000080:0.0:1784290271.913891:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c2474cc6000/lustre-MDD0000_UUID 00000020:01000000:0.0:1784290271.913897:0:86171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1784290271.913904:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2474cc6000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1784290271.913911:0:86171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784290271.913915:0:86171:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784290271.913917:0:86171:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9c245fdd19c0) has no exports 00000020:00000080:0.0:1784290271.913932:0:86171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784290271.913935:0:86171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1784290271.913937:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c244c90f800/lustre-MDD0000_UUID 00000020:00000080:0.0:1784290271.913939:0:86171:0:(genops.c:865:class_export_destroy()) destroying export ffff9c244c90f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1784290271.913942:0:86171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1784290271.913965:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073273 00000020:00000080:0.0:1784290271.913968:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c2474cc4800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784290271.913977:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2474cc4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1784290271.913984:0:86171:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2469a70000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1784290271.913988:0:86171:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c2469a70000 3 00000020:01000004:0.0:1784290271.913991:0:86171:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c2469a70000 from lustre-MDT0000 00000020:00000080:0.0:1784290271.914004:0:86171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784290271.914008:0:86171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000004:0.0:1784290271.914012:0:86171:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1784290271.914014:0:86171:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1784290271.914022:0:86171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1784290271.914024:0:86171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784290271.914026:0:86171:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1784290271.914032:0:86171:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c2474ee4800 bdffa268-fb6a-4248-991c-0ad16fac303f 192.168.202.6@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784290271.914037:0:86171:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c2458bef800 2e54cd1c-9dbd-4e31-b60e-998135d46053 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784290271.914042:0:86171:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff9c245fdd3380) has exports, disconnecting them 00000020:00080000:0.0:1784290271.914046:0:86171:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.6@tcp (ffff9c2474ee4800), last request at 1784290258 00000020:00000080:0.0:1784290271.914061:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30733f4 00000020:00010000:0.0:1784290271.914065:0:86171:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2474ee4800: total 0 00000100:00080000:0.0:1784290271.914067:0:86171:0:(import.c:65:import_set_state_nolock()) ffff9c2474ee5800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784290271.914076:0:86171:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.6@tcp (ffff9c2474ee4800): rc 0 00000020:00080000:0.0:1784290271.914079:0:86171:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c2458bef800), last request at 1784290256 00000020:00010000:0.0:1784290271.914108:0:6476:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2474ee4800: total 0 00010000:00010000:0.0:1784290271.914129:0:6476:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2474ee4800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1784290271.914153:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2440031400/0x5953bbf6b3073402 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21d8 expref: 5 pid: 84863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.914168:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2440030a00/0x5953bbf6b3073410 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21e6 expref: 4 pid: 84863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.914179:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c24488dd000/0x5953bbf6b3073409 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21df expref: 3 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.914189:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ef8400/0x5953bbf6b30733fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b21d1 expref: 2 pid: 84863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290271.914197:0:6476:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2474ee4800, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1784290271.914210:0:6476:0:(genops.c:906:class_export_put()) final put ffff9c2474ee4800/bdffa268-fb6a-4248-991c-0ad16fac303f 00010000:00010000:0.0:1784290271.914217:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290271.914223:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290271.914225:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784290271.914230:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2474ee4800/bdffa268-fb6a-4248-991c-0ad16fac303f for MGS 00000020:00000080:0.0:1784290271.914248:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2474ee5800 for MGS 00000020:00000080:0.0:1784290271.914259:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073211 00000020:00010000:0.0:1784290271.914262:0:86171:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2458bef800: total 0 00000100:00080000:0.0:1784290271.914265:0:86171:0:(import.c:65:import_set_state_nolock()) ffff9c2458be9800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784290271.914279:0:86171:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2458bef800): rc 0 00000020:00080000:0.0:1784290271.914284:0:86171:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9c245fdd3380) has no exports 00000100:00100000:0.0:1784290271.914326:0:84865:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c2470db4800:84865] 2 exiting: rc = 0 00000100:00100000:0.0:1784290271.914415:0:84864:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c2470db5a00:84864] 1 exiting: rc = 0 00000100:00100000:0.0:1784290271.914509:0:84863:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c2474562400:84863] 0 exiting: rc = 1 00000100:00100000:0.0:1784290271.914554:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914560:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914566:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914572:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914578:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914583:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914589:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914594:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914598:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914604:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914609:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914615:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914620:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914626:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914631:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914636:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914641:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914647:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914652:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914656:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914661:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914673:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914678:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914685:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914694:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:3.0:1784290271.914701:0:7429:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2458bef800: total 0 00000100:00100000:0.0:1784290271.914702:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290271.914707:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290271.914715:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914721:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914734:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914741:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290271.914751:0:7429:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2458bef800, canceled 0 locks, left on hash table 13. 00000100:00100000:0.0:1784290271.914752:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914761:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914768:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290271.914772:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ef9800/0x5953bbf6b3073361 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b307335a expref: 14 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290271.914781:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914791:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290271.914799:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ef8600/0x5953bbf6b30733df lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30733d8 expref: 13 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290271.914803:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914814:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290271.914821:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ef9600/0x5953bbf6b3073353 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b307334c expref: 12 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290271.914827:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914841:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290271.914844:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ef8c00/0x5953bbf6b30733d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30733ca expref: 11 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290271.914853:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914863:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914872:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290271.914880:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ef9e00/0x5953bbf6b307336f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073368 expref: 10 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290271.914884:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914893:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290271.914899:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ef9000/0x5953bbf6b30733ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30733e6 expref: 9 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290271.914908:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290271.914919:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ef9a00/0x5953bbf6b307337d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073376 expref: 8 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290271.914920:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.914931:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290271.914934:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ef8e00/0x5953bbf6b307338b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073384 expref: 7 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290271.914944:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290271.914948:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ef8a00/0x5953bbf6b3073399 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073392 expref: 6 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290271.914957:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290271.914961:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b30733a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30733a0 expref: 5 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290271.914972:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290271.914982:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ef9c00/0x5953bbf6b30733b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30733ae expref: 4 pid: 84864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290271.914984:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290271.914997:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebf400/0x5953bbf6b3073345 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b307333e expref: 3 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290271.914998:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.915011:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290271.915013:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ef8200/0x5953bbf6b30733c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30733bc expref: 2 pid: 84865 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290271.915023:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290271.915025:0:7429:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2458bef800, canceled 13 locks, left on hash table 0. 00000100:00100000:0.0:1784290271.915031:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.915043:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1784290271.915044:0:7429:0:(genops.c:906:class_export_put()) final put ffff9c2458bef800/2e54cd1c-9dbd-4e31-b60e-998135d46053 00010000:00010000:3.0:1784290271.915054:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290271.915059:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290271.915064:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290271.915066:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290271.915072:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1784290271.915074:0:60390:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458bef800/2e54cd1c-9dbd-4e31-b60e-998135d46053 for MGS 00000100:00100000:0.0:1784290271.915093:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.915101:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1784290271.915110:0:60390:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2458be9800 for MGS 00000100:00100000:0.0:1784290271.915112:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.915124:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.915131:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290271.915138:0:86171:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1784290271.915728:0:86171:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c244aa20ae0 - data ffff9c24709b5000/ffff9c2469cc8000 00000020:00000080:2.0:1784290271.915840:0:8412:0:(genops.c:906:class_export_put()) final put ffff9c2342ef3800/lustre-MDT0000_UUID 00000020:00000080:2.0:1784290271.915844:0:8412:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2342ef3800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1784290271.915848:0:86171:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2345582960 - data ffff9c247572d0d8/ffff9c244a4b0000 00000020:01000000:2.0:1784290271.915854:0:8412:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:0.0:1784290271.916593:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307320a 00000020:00000080:0.0:1784290271.916599:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c2458bef000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1784290271.916615:0:86171:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c2469a70000 from MGS, refs=2 00000020:01000004:0.0:1784290271.916618:0:86171:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c2469a70000 2 00000020:01000004:0.0:1784290271.916621:0:86171:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c2469a70000 from MGS 00000020:00000080:3.0:1784290271.916640:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458bef000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784290271.916649:0:86171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784290271.916654:0:86171:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1784290271.916658:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c2458bee800/MGS 00000020:00000080:0.0:1784290271.916660:0:86171:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458bee800/MGS for MGS 00000020:01000000:0.0:1784290271.916670:0:86171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1784290271.916723:0:86171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1784290271.916727:0:86171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784290271.916733:0:86171:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784290271.916737:0:86171:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c2458110000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784290271.916743:0:86171:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9c2445c13380) has exports, disconnecting them 00000020:00080000:0.0:1784290271.916747:0:86171:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c2458110000), last request at 1784290256 00000020:00000080:0.0:1784290271.916750:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073322 00000020:00080000:0.0:1784290271.916761:0:86171:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2458110000): rc 0 00000020:00000080:0.0:1784290271.916771:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c2458110000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1784290271.916786:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458110000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000100:00100000:2.0:1784290271.916944:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901026304:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 4051us (4110us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290271.916961:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3740 00000100:00080000:2.0:1784290271.917002:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290271.917008:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784290271.917018:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c244405a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901026304:0@lo:38:ptlrpcd_00_01.0 00010000:01000000:1.0:1784290271.918382:0:86171:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1784290271.918386:0:86171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784290271.918388:0:86171:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784290271.918392:0:86171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784290271.918419:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246d58b000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784290271.918534:0:86171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290271.918543:0:86171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1784290271.918546:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c2458116800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1784290271.918549:0:86171:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458116800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1784290271.918555:0:86171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1784290271.918606:0:86171:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c2469a70000 1 00000020:00000080:1.0:1784290271.918611:0:86171:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30731fc 00000020:00000080:1.0:1784290271.918621:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c2458bea000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1784290271.918628:0:86171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1784290271.918637:0:86171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784290271.918641:0:86171:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784290271.918645:0:86171:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9c246ff6cd40) has no exports 00000020:00000080:2.0:1784290271.918646:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458bea000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784290271.932851:0:86171:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290271.932856:0:86171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1784290271.932858:0:86171:0:(genops.c:906:class_export_put()) final put ffff9c2345f40000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784290271.932860:0:86171:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2345f40000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1784290271.932865:0:86171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1784290271.932943:0:86171:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c2469a71800 00000020:02000400:1.0:1784290271.932973:0:86171:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1784290272.935491:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290273.447534:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901026816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784290273.447541:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901026944:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290273.447610:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290273.447637:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901026816 00000100:00100000:1.0:1784290273.447657:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290273.447659:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901026816 00000100:00100000:2.0:1784290273.447688:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901026944 00000100:00100000:2.0:1784290273.447693:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901026944 00000100:00080000:3.0:1784290273.447715:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784290273.447722:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290273.447727:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:2.0:1784290273.447735:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:0.0:1784290273.447740:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244405a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901026816:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784290273.447749:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245f7ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901026944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784290273.447771:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1784290273.447771:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784290273.447824:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245f7ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901026944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290273.447832:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244405a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901026816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290273.447833:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:0.0:1784290273.447844:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:3.0:1784290273.447882:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901026816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290273.447882:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901026944:0@lo:13:osp-pre-0-1.0 00000400:00000100:0.0:1784290273.797463:0:3612:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.6@tcp portal 26 match 1870961896208256 offset 0 length 224: 4 00000100:00100000:0.0:1784290273.797527:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290273.797567:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290273.797601:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290273.797611:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896208384 00000100:00100000:2.0:1784290273.797622:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896208384 00000100:00100000:0.0:1784290273.797649:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290273.797667:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896208640 00000100:00100000:1.0:1784290273.797670:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896208512 00000100:00100000:3.0:1784290273.797676:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896208640 00000100:00100000:2.0:1784290273.797677:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1025 00000100:00100000:1.0:1784290273.797677:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896208512 00000100:00100000:2.0:1784290273.797689:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1870961896208384:12345-192.168.202.6@tcp:400:kworker.0 00000020:00080000:2.0:1784290273.797698:0:66004:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.6@tcp 00000100:00100000:0.0:1784290273.797729:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896208768 00000100:00100000:0.0:1784290273.797734:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896208768 00000100:00100000:1.0:1784290273.797750:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 624 00000100:00100000:1.0:1784290273.797762:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2399:x1870961896208512:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290273.797771:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1496 00000100:00100000:2.0:1784290273.797771:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2400:x1870961896208384:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 78us (241us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784290273.797782:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1025 00000100:00100000:0.0:1784290273.797787:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1497 00000100:00100000:3.0:1784290273.797791:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2400:x1870961896208640:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290273.797804:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2399:x1870961896208768:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290273.797812:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2399:x1870961896208512:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 53us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290273.797819:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 624 00000100:00100000:3.0:1784290273.797842:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2400:x1870961896208640:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 56us (239us total) trans 0 rc 0/0 00000100:00080000:1.0:1784290273.797846:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784290273.797853:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784290273.797859:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1496 00000100:00080000:1.0:1784290273.797860:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784290273.797860:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2399:x1870961896208768:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 57us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290273.797874:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1497 00000100:00100000:2.0:1784290273.798661:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290273.798697:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896208896 00000100:00100000:0.0:1784290273.798702:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896208896 00000100:00100000:0.0:1784290273.798726:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1026 00000100:00100000:0.0:1784290273.798730:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1870961896208896:12345-192.168.202.6@tcp:38:ptlrpcd_01_01.0 00010000:00020000:0.0:1784290273.798747:0:66008:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290273.798777:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444058a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1870961896208896:12345-192.168.202.6@tcp:38:ptlrpcd_01_01.0 Request processed in 46us (117us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290273.798798:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1026 00010000:00010000:1.0:1784290273.959545:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290274.983565:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290276.007497:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290277.031459:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784290277.031500:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784290277.031506:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784290277.031511:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784290277.031520:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2013 00000100:00080000:0.0:1784290277.031527:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1784290277.031533:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901027072:0@lo:400:kworker.0 00000100:00080000:0.0:1784290277.031536:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290277.031566:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2343891180 x1870961901027200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:1.0:1784290277.031594:0:3620:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870961901027072 offset 0 length 224: 4 00000100:00080000:0.0:1784290277.031620:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784290277.031625:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784290277.031627:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1784290277.031631:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901027200:0@lo:38:kworker.0 00000100:00080000:0.0:1784290277.031632:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2013 00000100:00080000:0.0:1784290277.031636:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784290277.031642:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290277.031649:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343892680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901027328:0@lo:400:kworker.0 00000100:00100000:0.0:1784290277.031660:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2343891880 x1870961901027456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290277.031692:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784290277.031695:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784290277.031699:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784290277.031701:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1784290277.031706:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1870961901027584:0@lo:400:kworker.0 00000100:00080000:0.0:1784290277.031708:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2013 00000100:00080000:0.0:1784290277.031714:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784290277.031720:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290277.031734:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290277.031737:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901027456:0@lo:38:kworker.0 00000100:00100000:0.0:1784290277.031745:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2343891f80 x1870961901027712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784290277.031769:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290277.031792:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901027840:0@lo:400:kworker.0 00000100:00080000:0.0:1784290277.031794:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1784290277.031795:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901027200 00000100:00080000:0.0:1784290277.031801:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784290277.031804:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1784290277.031808:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901027200 00000100:00080000:0.0:1784290277.031808:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2013 00000100:00080000:0.0:1784290277.031812:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784290277.031816:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290277.031824:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290277.031832:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2343891c00 x1870961901028096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784290277.031843:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290277.031846:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901027712:0@lo:38:kworker.0 00000100:00100000:2.0:1784290277.031849:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901027328 00000100:00100000:2.0:1784290277.031854:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901027328 00000100:00100000:0.0:1784290277.031876:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901027968:0@lo:400:kworker.0 00000100:00100000:1.0:1784290277.031884:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290277.031893:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901027840 00000100:00100000:3.0:1784290277.031898:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901027840 00000100:00100000:2.0:1784290277.031908:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901027584 00000100:00100000:1.0:1784290277.031912:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901028096:0@lo:38:kworker.0 00000100:00100000:2.0:1784290277.031915:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901027584 00000100:00100000:0.0:1784290277.031926:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290277.031944:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290277.031946:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901027456 00000100:00100000:2.0:1784290277.031950:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901027456 00000100:00100000:2.0:1784290277.031965:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901028096 00000100:00100000:2.0:1784290277.031968:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901028096 00000100:00100000:3.0:1784290277.031980:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901027968 00000100:00100000:3.0:1784290277.031984:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901027968 00000100:00100000:1.0:1784290277.031989:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:0.0:1784290277.031989:0:8999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498 00000100:00100000:2.0:1784290277.032000:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:1.0:1784290277.032005:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901027328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290277.032007:0:8999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901027840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290277.032010:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245f7eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1870961901027584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290277.032018:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1499 00000100:00100000:3.0:1784290277.032029:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901027968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290277.032070:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901027328:12345-0@lo:400:kworker.0 Request processed in 69us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290277.032076:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:0.0:1784290277.032089:0:8999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901027840:12345-0@lo:400:kworker.0 Request processed in 86us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290277.032090:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245f7eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1870961901027584:12345-0@lo:400:kworker.0 Request processed in 82us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290277.032096:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:0.0:1784290277.032101:0:8999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498 00000100:00100000:2.0:1784290277.032107:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:1.0:1784290277.032107:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244405bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901027200:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784290277.032117:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901027968:12345-0@lo:400:kworker.0 Request processed in 90us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290277.032125:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1499 00010000:00020000:1.0:1784290277.032128:0:65990:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784290277.032132:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:2.0:1784290277.032140:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245f7ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901027456:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290277.032142:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:0.0:1784290277.032148:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901028096:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784290277.032154:0:65989:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:0.0:1784290277.032159:0:66008:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784290277.032168:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244405bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901027200:12345-0@lo:38:kworker.0 Request processed in 63us (476us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784290277.032173:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901027968:0@lo:400:kworker.0 00000100:00100000:1.0:1784290277.032179:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:2.0:1784290277.032197:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245f7ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901027456:12345-0@lo:38:kworker.0 Request processed in 55us (371us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290277.032198:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901028096:12345-0@lo:38:kworker.0 Request processed in 49us (255us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290277.032207:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:0.0:1784290277.032211:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00080000:3.0:1784290277.032221:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784290277.032227:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290277.032227:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343892680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901027328:0@lo:400:kworker.0 00000100:00080000:3.0:1784290277.032232:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784290277.032239:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901027712 00000100:00100000:2.0:1784290277.032244:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901027712 00000100:00100000:0.0:1784290277.032252:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901027840:0@lo:400:kworker.0 00000100:00080000:1.0:1784290277.032266:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784290277.032272:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784290277.032276:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3741 00000100:00100000:1.0:1784290277.032280:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901028096:0@lo:38:kworker.0 00000100:00100000:2.0:1784290277.032289:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901027712:12345-0@lo:38:kworker.0 00000100:00080000:1.0:1784290277.032295:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1784290277.032296:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1870961901027584:0@lo:400:kworker.0 00000100:00080000:1.0:1784290277.032300:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00010000:00020000:2.0:1784290277.032303:0:8413:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784290277.032312:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901027456:0@lo:38:kworker.0 00000100:00080000:1.0:1784290277.032326:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784290277.032330:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784290277.032332:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901027200:0@lo:38:kworker.0 00000100:00100000:2.0:1784290277.032367:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901027712:12345-0@lo:38:kworker.0 Request processed in 80us (481us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290277.032377:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3741 00000100:00080000:1.0:1784290277.032377:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784290277.032381:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784290277.032384:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901027712:0@lo:38:kworker.0 00000001:00100000:1.0:1784290277.544415:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1784290277.544419:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1784290277.544424:0:75386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784290277.544427:0:9482:0:(genops.c:906:class_export_put()) final put ffff9c246ff98000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784290277.544428:0:8397:0:(genops.c:906:class_export_put()) final put ffff9c247f8f6000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1784290277.544438:0:75386:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378740 is committed 00000020:00000080:2.0:1784290277.544442:0:75386:0:(genops.c:906:class_export_put()) final put ffff9c247f8f5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784290277.544508:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246ff98000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1784290277.544555:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247f8f6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1784290277.544579:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247f8f5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1784290277.544608:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2344981000 for lustre-OST0001 00000020:00000080:0.0:1784290277.544612:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c247f8f4000 for lustre-OST0000 00000020:00000080:0.0:1784290277.544615:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c247f8f0800 for lustre-MDT0001 00010000:00010000:2.0:1784290278.055502:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290278.567553:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901028224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290278.567575:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901028352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290278.567636:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290278.567691:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901028224 00000100:00100000:2.0:1784290278.567695:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290278.567702:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901028224 00000100:00100000:0.0:1784290278.567741:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901028352 00000100:00100000:0.0:1784290278.567747:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901028352 00000100:00100000:3.0:1784290278.567765:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:2.0:1784290278.567776:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:3.0:1784290278.567781:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901028224:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290278.567787:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444058000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901028352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784290278.567816:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1784290278.567817:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784290278.567865:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444058000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901028352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290278.567872:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:3.0:1784290278.567886:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901028224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290278.567897:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:0.0:1784290278.567914:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901028352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290278.567920:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901028224:0@lo:13:osp-pre-0-1.0 00000400:00000100:2.0:1784290278.917569:0:3611:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.6@tcp portal 26 match 1870961896209024 offset 0 length 224: 4 00000100:00100000:2.0:1784290278.917603:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290278.917631:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290278.917670:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290278.917722:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290278.917757:0:26253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896209536 00000100:00100000:2.0:1784290278.917757:0:15642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896209408 00000100:00100000:1.0:1784290278.917757:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896209280 00000100:00100000:0.0:1784290278.917757:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896209152 00000100:00100000:1.0:1784290278.917769:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896209280 00000100:00100000:0.0:1784290278.917769:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896209152 00000100:00100000:3.0:1784290278.917770:0:26253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896209536 00000100:00100000:2.0:1784290278.917770:0:15642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896209408 00000100:00100000:0.0:1784290278.917818:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1030 00000100:00100000:0.0:1784290278.917827:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1870961896209152:12345-192.168.202.6@tcp:38:kworker.0 00000100:00100000:2.0:1784290278.917834:0:15642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1500 00000100:00100000:3.0:1784290278.917843:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1501 00000100:00100000:2.0:1784290278.917849:0:15642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444058e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2398:x1870961896209408:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290278.917850:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 627 00010000:00020000:0.0:1784290278.917851:0:65988:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784290278.917861:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444059f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2397:x1870961896209536:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290278.917866:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2397:x1870961896209280:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290278.917915:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1870961896209152:12345-192.168.202.6@tcp:38:kworker.0 Request processed in 86us (242us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290278.917916:0:15642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444058e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2398:x1870961896209408:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 72us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290278.917922:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444059f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2397:x1870961896209536:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 64us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290278.917928:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2397:x1870961896209280:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 65us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290278.917938:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1030 00000100:00100000:2.0:1784290278.917939:0:15642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1500 00000100:00100000:3.0:1784290278.917952:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1501 00000100:00100000:1.0:1784290278.917952:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 627 00000100:00080000:1.0:1784290278.918042:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784290278.918049:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784290278.918053:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784290279.079620:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290280.103587:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290281.127475:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290282.151489:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784290282.151533:0:60390:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290282.151547:0:60390:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1784290282.151551:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1784290282.151551:0:60390:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290282.151563:0:60390:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2018 00000100:00080000:2.0:1784290282.151569:0:60390:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00100000:3.0:1784290282.151571:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901028480:0@lo:400:kworker.0 00000100:00080000:2.0:1784290282.151579:0:60390:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290282.151607:0:60390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c234434c000 x1870961901028608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:3.0:1784290282.151620:0:3620:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870961901028480 offset 0 length 224: 4 00000100:00080000:2.0:1784290282.151657:0:60390:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1784290282.151662:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1870961901028736:0@lo:400:kworker.0 00000100:00080000:2.0:1784290282.151664:0:60390:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290282.151669:0:60390:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290282.151675:0:60390:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2018 00000100:00080000:2.0:1784290282.151679:0:60390:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784290282.151687:0:60390:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290282.151689:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901028608:0@lo:38:kworker.0 00000100:00100000:2.0:1784290282.151705:0:60390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2474b4d180 x1870961901028864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784290282.151709:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290282.151750:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290282.151751:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901028736 00000100:00100000:0.0:1784290282.151761:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901028736 00000100:00080000:2.0:1784290282.151764:0:60390:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290282.151769:0:60390:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290282.151771:0:60390:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290282.151776:0:60390:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2018 00000100:00080000:2.0:1784290282.151780:0:60390:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784290282.151785:0:60390:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290282.151789:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1870961901028992:0@lo:400:kworker.0 00000100:00100000:2.0:1784290282.151816:0:60390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2474b4e300 x1870961901029120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784290282.151818:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901028864:0@lo:38:kworker.0 00000100:00100000:3.0:1784290282.151837:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290282.151837:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901028608 00000100:00100000:0.0:1784290282.151842:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901028608 00000100:00100000:0.0:1784290282.151863:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901028992 00000100:00100000:0.0:1784290282.151868:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901028992 00000100:00100000:3.0:1784290282.151873:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784290282.151878:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784290282.151880:0:60390:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1784290282.151884:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901029248:0@lo:400:kworker.0 00000100:00080000:2.0:1784290282.151894:0:60390:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290282.151897:0:60390:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784290282.151900:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901028864 00000100:00080000:2.0:1784290282.151904:0:60390:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2018 00000100:00100000:0.0:1784290282.151906:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901028864 00000100:00080000:2.0:1784290282.151909:0:60390:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00100000:1.0:1784290282.151916:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901029120:0@lo:38:kworker.0 00000100:00080000:2.0:1784290282.151917:0:60390:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290282.151926:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:3.0:1784290282.151927:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290282.151939:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1870961901028736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290282.151942:0:60390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2474b4fb80 x1870961901029504/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784290282.151972:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290282.151974:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1784290282.151983:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1870961901028992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290282.151991:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901029376:0@lo:400:kworker.0 00000100:00100000:1.0:1784290282.152016:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901029504:0@lo:38:kworker.0 00000100:00100000:0.0:1784290282.152024:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1870961901028736:12345-0@lo:400:kworker.0 Request processed in 85us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290282.152034:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:3.0:1784290282.152038:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1870961901028992:12345-0@lo:400:kworker.0 Request processed in 57us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290282.152044:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:2.0:1784290282.152053:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290282.152058:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:3.0:1784290282.152065:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:0.0:1784290282.152066:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901028608:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784290282.152070:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901028864:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784290282.152080:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:0.0:1784290282.152085:0:66008:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:3.0:1784290282.152087:0:65990:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784290282.152106:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901029120 00000100:00100000:2.0:1784290282.152112:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901029120 00000100:00100000:1.0:1784290282.152141:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901029504 00000100:00100000:1.0:1784290282.152148:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901029504 00000100:00100000:2.0:1784290282.152153:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3742 00000100:00100000:3.0:1784290282.152155:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901028864:12345-0@lo:38:kworker.0 Request processed in 79us (278us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290282.152155:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901028608:12345-0@lo:38:kworker.0 Request processed in 85us (404us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290282.152165:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901029120:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784290282.152170:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:0.0:1784290282.152176:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00010000:00020000:2.0:1784290282.152184:0:8412:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784290282.152187:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:1.0:1784290282.152196:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1870961901029504:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784290282.152207:0:26259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901029248 00010000:00020000:1.0:1784290282.152212:0:65988:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784290282.152213:0:26259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901029248 00000100:00080000:0.0:1784290282.152218:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784290282.152229:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901029120:12345-0@lo:38:kworker.0 Request processed in 64us (261us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290282.152239:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3742 00000100:00080000:0.0:1784290282.152255:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784290282.152262:0:26259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901029376 00000100:00100000:1.0:1784290282.152262:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1870961901029504:12345-0@lo:38:kworker.0 Request processed in 62us (198us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784290282.152268:0:26259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901029376 00000100:00100000:1.0:1784290282.152288:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:2.0:1784290282.152289:0:26257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00100000:2.0:1784290282.152307:0:26257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901029248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290282.152311:0:26254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:0.0:1784290282.152324:0:26254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901029376:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784290282.152328:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784290282.152421:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1870961901028992:0@lo:400:kworker.0 00000100:00100000:2.0:1784290282.152435:0:26257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901029248:12345-0@lo:400:kworker.0 Request processed in 131us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290282.152444:0:26254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901029376:12345-0@lo:400:kworker.0 Request processed in 121us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290282.152446:0:26257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000100:00100000:1.0:1784290282.152449:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1870961901028736:0@lo:400:kworker.0 00000100:00100000:3.0:1784290282.152456:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901029248:0@lo:400:kworker.0 00000100:00100000:0.0:1784290282.152464:0:26254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00000100:00100000:0.0:1784290282.152506:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901029376:0@lo:400:kworker.0 00000100:00080000:2.0:1784290282.152517:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290282.152524:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784290282.152529:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901029504:0@lo:38:kworker.0 00000100:00080000:2.0:1784290282.152547:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290282.152550:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784290282.152553:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901029120:0@lo:38:kworker.0 00000100:00080000:2.0:1784290282.152561:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290282.152564:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784290282.152568:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901028864:0@lo:38:kworker.0 00000100:00080000:2.0:1784290282.152576:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290282.152579:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784290282.152582:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901028608:0@lo:38:kworker.0 00010000:00010000:2.0:1784290283.175475:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290283.687584:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901029632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784290283.687618:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901029760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290283.687664:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290283.687710:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290283.687741:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901029632 00000100:00100000:1.0:1784290283.687753:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901029632 00000100:00100000:0.0:1784290283.687784:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901029760 00000100:00100000:0.0:1784290283.687789:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901029760 00000100:00100000:1.0:1784290283.687823:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:0.0:1784290283.687836:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:1.0:1784290283.687838:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901029632:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784290283.687847:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901029760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784290283.687878:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1784290283.687878:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290283.687936:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901029760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290283.687941:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901029632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290283.687953:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:0.0:1784290283.687966:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:2.0:1784290283.687998:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901029760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290283.688038:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901029632:0@lo:13:osp-pre-1-1.0 00000400:00000100:2.0:1784290284.037699:0:3612:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.6@tcp portal 26 match 1870961896209664 offset 0 length 224: 4 00000100:00100000:2.0:1784290284.037765:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290284.037805:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290284.037832:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290284.037877:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290284.037918:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896209792 00000100:00100000:0.0:1784290284.037926:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896210048 00000100:00100000:3.0:1784290284.037929:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896209792 00000100:00100000:0.0:1784290284.037944:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896210048 00000100:00100000:1.0:1784290284.037971:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896209920 00000100:00100000:1.0:1784290284.037979:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896209920 00000100:00100000:3.0:1784290284.037998:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1034 00000100:00080000:2.0:1784290284.038012:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784290284.038014:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1870961896209792:12345-192.168.202.6@tcp:38:kworker.0 00000100:00100000:0.0:1784290284.038018:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896210176 00000100:00080000:2.0:1784290284.038021:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784290284.038025:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896210176 00000100:00100000:1.0:1784290284.038051:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 630 00010000:00020000:3.0:1784290284.038055:0:65990:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784290284.038078:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2397:x1870961896209920:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290284.038083:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1504 00000100:00080000:2.0:1784290284.038087:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290284.038101:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2398:x1870961896210048:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290284.038121:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1505 00000100:00100000:2.0:1784290284.038142:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2397:x1870961896210176:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290284.038144:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1870961896209792:12345-192.168.202.6@tcp:38:kworker.0 Request processed in 125us (328us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784290284.038144:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2397:x1870961896209920:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 68us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290284.038153:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2398:x1870961896210048:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 53us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290284.038168:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 630 00000100:00100000:0.0:1784290284.038176:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1504 00000100:00100000:3.0:1784290284.038184:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1034 00000100:00100000:2.0:1784290284.038206:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2397:x1870961896210176:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 75us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290284.038217:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1505 00010000:00010000:2.0:1784290284.199611:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290285.223485:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290286.247472:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784290286.430565:0:86789:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784290286.430569:0:86789:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1784290286.430570:0:86789:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1784290286.430645:0:86789:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9c246dce1800 00000020:01000004:1.0:1784290286.430657:0:86789:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1784290286.430668:0:86789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1784290286.430678:0:86789:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c246ff6cd40) 00000020:00000080:1.0:1784290286.430690:0:86789:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1784290286.460328:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1784290286.460909:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1784290286.463108:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1784290286.464040:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1784290286.464202:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1784290286.464373:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1784290286.464505:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1784290286.464670:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1784290286.464829:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1784290286.464954:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1784290286.465087:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1784290286.465238:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1784290286.465383:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1784290286.465518:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1784290286.465684:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1784290286.465835:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1784290286.466000:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1784290286.466128:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1784290286.466265:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1784290286.466417:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1784290286.466549:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1784290286.466680:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1784290286.466825:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1784290286.466943:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1784290286.467076:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1784290286.467214:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1784290286.467386:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1784290286.467546:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1784290286.467670:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1784290286.467856:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1784290286.467988:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1784290286.468147:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1784290286.468292:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1784290286.468459:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1784290286.468585:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1784290286.469164:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1784290286.469282:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1784290286.469533:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1784290286.469667:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1784290286.469813:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1784290286.469971:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1784290286.470090:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1784290286.470232:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1784290286.470392:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1784290286.470564:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1784290286.470735:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1784290286.470863:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1784290286.471325:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1784290286.471574:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1784290286.471706:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1784290286.472003:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1784290286.472161:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1784290286.472325:0:86789:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:3.0:1784290286.472654:0:86789:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1784290286.472848:0:86789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1784290286.472856:0:86789:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784290286.472868:0:86789:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b307379e 00000020:01000004:3.0:1784290286.472874:0:86789:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1784290286.472887:0:86789:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1784290286.472892:0:86789:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c246dce1800 from MGS 00000020:01000004:3.0:1784290286.472895:0:86789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1784290286.472906:0:86789:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c246ff119c0) 00000020:00000080:3.0:1784290286.472916:0:86789:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:3.0:1784290286.472975:0:86789:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c246dce1800 from MGS, refs=2 00080000:01000000:3.0:1784290286.472978:0:86789:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784290286.472982:0:86789:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b30737ac 00010000:00010000:3.0:1784290286.473077:0:86789:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1784290286.475366:0:86789:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1784290286.475765:0:86793:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1784290286.475782:0:86789:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1784290286.475825:0:86789:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784290286.476254:0:86789:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1784290286.476727:0:86789:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784290286.476913:0:86789:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1784290286.476919:0:86789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1784290286.477432:0:86789:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1784290286.477439:0:86789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1784290286.477675:0:86789:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1784290286.477681:0:86789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1784290286.478066:0:86789:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1784290286.478085:0:86789:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1784290286.478087:0:86789:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.106@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1784290286.478090:0:86789:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.106@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:1.0:1784290286.478096:0:86789:0:(import.c:65:import_set_state_nolock()) ffff9c2447cad800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1784290286.478101:0:86789:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1784290286.478105:0:86789:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.106@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1784290286.478107:0:86789:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1784290286.478115:0:86789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2343893480 x1870961901027072/t0(0) o400->MGC192.168.202.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784290293 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290286.478134:0:86789:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2444059880 x1870961901028480/t0(0) o400->MGC192.168.202.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784290298 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1784290286.478141:0:86789:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1784290286.478150:0:86789:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1784290286.478151:0:86789:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1784290286.478156:0:86789:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:2.0:1784290286.478182:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901028480:0@lo:400:kworker.0 00000100:00100000:2.0:1784290286.478203:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901027072:0@lo:400:kworker.0 10000000:01000000:1.0:1784290286.478218:0:86789:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1784290286.478233:0:86789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b30733d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b30733df expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290286.478245:0:86789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b30733d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b30733df expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290286.478251:0:86789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784290286.478266:0:86789:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290286.478277:0:86789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b30733d8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b30733df expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.478299:0:86789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2440030400/0x5953bbf6b307333e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073345 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290286.478305:0:86789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2440030400/0x5953bbf6b307333e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073345 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290286.478310:0:86789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290286.478327:0:86789:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290286.478331:0:86789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2440030400/0x5953bbf6b307333e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073345 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.478365:0:86789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b307335a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073361 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290286.478371:0:86789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b307335a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073361 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290286.478375:0:86789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290286.478390:0:86789:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290286.478402:0:86789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b307335a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073361 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.478421:0:86789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b307338b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290286.478427:0:86789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b307338b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290286.478431:0:86789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290286.478435:0:86789:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290286.478439:0:86789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073384 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b307338b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.478450:0:86789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf600/0x5953bbf6b3073392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073399 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290286.478455:0:86789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf600/0x5953bbf6b3073392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073399 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290286.478459:0:86789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290286.478464:0:86789:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290286.478468:0:86789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf600/0x5953bbf6b3073392 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073399 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.478477:0:86789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe000/0x5953bbf6b30733ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b30733b5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290286.478481:0:86789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe000/0x5953bbf6b30733ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b30733b5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290286.478494:0:86789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290286.478499:0:86789:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290286.478506:0:86789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe000/0x5953bbf6b30733ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b30733b5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.478516:0:86789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf000/0x5953bbf6b30733bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b30733c3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290286.478521:0:86789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf000/0x5953bbf6b30733bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b30733c3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290286.478525:0:86789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290286.478531:0:86789:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290286.478536:0:86789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf000/0x5953bbf6b30733bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b30733c3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.478549:0:86789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c24488dc600/0x5953bbf6b30733e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b30733ed expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290286.478557:0:86789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c24488dc600/0x5953bbf6b30733e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b30733ed expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290286.478563:0:86789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290286.478570:0:86789:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290286.478576:0:86789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c24488dc600/0x5953bbf6b30733e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b30733ed expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.478601:0:86789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe400/0x5953bbf6b307334c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073353 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290286.478616:0:86789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe400/0x5953bbf6b307334c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073353 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290286.478621:0:86789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290286.478626:0:86789:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290286.478631:0:86789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe400/0x5953bbf6b307334c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073353 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.478654:0:86789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfc00/0x5953bbf6b3073368 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b307336f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290286.478660:0:86789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfc00/0x5953bbf6b3073368 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b307336f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290286.478663:0:86789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290286.478668:0:86789:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290286.478672:0:86789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfc00/0x5953bbf6b3073368 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b307336f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.478688:0:86789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf200/0x5953bbf6b3073376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b307337d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290286.478693:0:86789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf200/0x5953bbf6b3073376 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b307337d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290286.478696:0:86789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784290286.478701:0:86789:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290286.478704:0:86789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf200/0x5953bbf6b3073376 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b307337d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.478720:0:86789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe800/0x5953bbf6b30733a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b30733a7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290286.478725:0:86789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe800/0x5953bbf6b30733a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b30733a7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290286.478729:0:86789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784290286.478734:0:86789:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290286.478738:0:86789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe800/0x5953bbf6b30733a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b30733a7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.478748:0:86789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe200/0x5953bbf6b30733ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b30733d1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290286.478753:0:86789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe200/0x5953bbf6b30733ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b30733d1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290286.478756:0:86789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784290286.478761:0:86789:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290286.478768:0:86789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe200/0x5953bbf6b30733ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b30733d1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784290286.478789:0:86789:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c2447cad800 already not connected (conn 47, was 0): DISCONN 00000100:00080000:1.0:1784290286.478794:0:86789:0:(import.c:65:import_set_state_nolock()) ffff9c2447cad800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290286.478798:0:86789:0:(import.c:510:import_select_connection()) MGC192.168.202.106@tcp: connect to NID 0@lo last attempt 1997 00000100:00080000:1.0:1784290286.478805:0:86789:0:(import.c:624:import_select_connection()) MGC192.168.202.106@tcp: import ffff9c2447cad800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290286.478834:0:86789:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2445d0c380 x1870961901029888/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784290286.478867:0:86789:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1784290286.478935:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e54cd1c-9dbd-4e31-b60e-998135d46053:3616:1870961901029888:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1784290286.478995:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290286.479056:0:86795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901029888 00000100:00100000:3.0:1784290286.479066:0:86795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901029888 00000100:00100000:3.0:1784290286.479123:0:86795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784290286.479134:0:86795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3616:x1870961901029888:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1784290286.479160:0:86795:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo t0 exp 0000000000000000 cur 2027 last 0 00000020:00000080:3.0:1784290286.479178:0:86795:0:(genops.c:1406:class_connect()) connect: client 2e54cd1c-9dbd-4e31-b60e-998135d46053, cookie 0x5953bbf6b30737b3 00000100:00080000:3.0:1784290286.479278:0:86795:0:(import.c:65:import_set_state_nolock()) ffff9c246dce5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784290286.479401:0:86795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:3616:x1870961901029888:12345-0@lo:250:mount.lustre.0 Request processed in 270us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290286.479410:0:86795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784290286.479431:0:3616:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.106@tcp: committing for last_committed 0 gen 24 00000100:00080000:2.0:1784290286.479441:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.106@tcp: connect to target with instance 0 00000100:00080000:2.0:1784290286.479450:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1784290286.479455:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1784290286.479458:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2447cad800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1784290286.479461:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1784290286.479491:0:3616:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1784290286.479510:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e54cd1c-9dbd-4e31-b60e-998135d46053:3616:1870961901029888:0@lo:250:mount.lustre.0 00000020:01000000:1.0:1784290286.479525:0:9947:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.202.106@tcp 00000100:00080000:3.0:1784290286.479527:0:86789:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:3.0:1784290286.479538:0:86789:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 10000000:01000000:1.0:1784290286.479540:0:9947:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1784290286.479545:0:9947:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784290286.479548:0:9947:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784290286.479550:0:9947:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290286.479552:0:9947:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290286.479553:0:9947:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290286.479555:0:9947:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290286.479557:0:9947:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784290286.479560:0:9947:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290286.479561:0:9947:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000004:3.0:1784290286.479568:0:86789:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1784290286.479574:0:86789:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000020:01000000:1.0:1784290286.479608:0:9947:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1784290286.479617:0:9947:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1784290286.479620:0:9947:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000040:01000000:3.0:1784290286.479622:0:86789:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784290286.479623:0:9947:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784290286.479626:0:9947:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:2.0:1784290286.479631:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901030016:0@lo:253:kworker.0 00000020:01000004:1.0:1784290286.479631:0:9947:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290286.479633:0:9947:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290286.479638:0:9947:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290286.479643:0:9947:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784290286.479648:0:9947:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290286.479649:0:9947:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000004:3.0:1784290286.479653:0:86789:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.106@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1784290286.479658:0:86789:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784290286.479661:0:86789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784290286.479663:0:86789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784290286.479664:0:86789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784290286.479666:0:86789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784290286.479669:0:86789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784290286.479670:0:86789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784290286.479671:0:86789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784290286.479673:0:86789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784290286.479675:0:86789:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784290286.479678:0:86789:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1784290286.479681:0:86789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784290286.479683:0:86789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784290286.479685:0:86789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000000:1.0:1784290286.479685:0:9947:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000020:01000004:3.0:1784290286.479687:0:86789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784290286.479690:0:86789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 10000000:01000000:1.0:1784290286.479691:0:9947:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1784290286.479694:0:86789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290286.479695:0:9947:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1784290286.479702:0:86789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784290286.479706:0:9947:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1784290286.479707:0:86789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000100:00100000:2.0:1784290286.479709:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1784290286.479711:0:9947:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784290286.479715:0:86789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290286.479720:0:9947:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290286.479725:0:9947:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784290286.479726:0:86789:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784290286.479727:0:9947:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290286.479731:0:9947:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784290286.479733:0:9947:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290286.479735:0:9947:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784290286.479748:0:86789:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000020:01000000:1.0:1784290286.479763:0:9947:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1784290286.479768:0:86789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901030272:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784290286.479813:0:86797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901030016 00000100:00100000:2.0:1784290286.479819:0:86797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901030016 00000100:00100000:3.0:1784290286.479827:0:86789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290286.479835:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901030144:0@lo:253:kworker.0 00000100:00100000:3.0:1784290286.479866:0:86789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290286.479883:0:86796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901030272 00000100:00100000:2.0:1784290286.479889:0:86796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901030272 00000100:00100000:1.0:1784290286.479898:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290286.479929:0:86796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901030144 00000100:00100000:2.0:1784290286.479936:0:86796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901030144 00000100:00100000:1.0:1784290286.479938:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784290286.479948:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901030400:0@lo:253:kworker.0 00000100:00100000:2.0:1784290286.479974:0:86796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784290286.480003:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290286.480004:0:86796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:3618:x1870961901030016:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1784290286.480044:0:86796:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:2.0:1784290286.480095:0:86795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901030400 00000100:00100000:2.0:1784290286.480099:0:86795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901030400 00000100:00100000:2.0:1784290286.480128:0:86795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784290286.480142:0:86795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:86789:x1870961901030272:12345-0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784290286.480231:0:86798:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1784290286.480387:0:86796:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 104 20000000:01000000:1.0:1784290286.481297:0:86799:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1784290286.481302:0:86799:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1784290286.481304:0:86799:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1784290286.481306:0:86799:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1784290286.481484:0:86799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1784290286.481574:0:86796:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784290286.481592:0:86796:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784290286.481617:0:86795:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784290286.481621:0:86795:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784290286.481625:0:86795:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1784290286.481632:0:86795:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1784290286.482294:0:86796:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784290286.482304:0:86796:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1784290286.482328:0:86798:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784290286.482333:0:86798:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784290286.482399:0:86798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c234236ca00/0x5953bbf6b30737ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290286.482410:0:86795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:86789:x1870961901030272:12345-0@lo:253:mount.lustre.0 Request processed in 2269us (2578us total) trans 0 rc 0/0 00010000:00010000:1.0:1784290286.482414:0:86798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236ca00/0x5953bbf6b30737ba lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290286.482422:0:86795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 20000000:01000000:1.0:1784290286.482425:0:86798:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000091779s 00010000:00010000:1.0:1784290286.482430:0:86798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c234236ca00/0x5953bbf6b30737ba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.482440:0:86798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c234236ca00/0x5953bbf6b30737ba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.482446:0:86798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c234236ca00/0x5953bbf6b30737ba lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290286.482448:0:86789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901030272:0@lo:253:mount.lustre.0 00010000:00010000:1.0:1784290286.482456:0:86798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c234236ca00/0x5953bbf6b30737ba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.482462:0:86798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236ca00 already unused, calling callback (ffffffffc0ec3230) 00000100:00100000:3.0:1784290286.482467:0:86795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 10000000:01000000:0.0:1784290286.482469:0:86789:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784290286.482473:0:86789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00010000:00010000:1.0:1784290286.482476:0:86798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c234236ca00/0x5953bbf6b30737ba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784290286.482476:0:86789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000100:00100000:3.0:1784290286.482482:0:86795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:3619:x1870961901030144:12345-0@lo:253:kworker.0 00000020:01000004:0.0:1784290286.482482:0:86789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00010000:00010000:1.0:1784290286.482486:0:86798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c234236ca00/0x5953bbf6b30737ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784290286.482487:0:86789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784290286.482492:0:86789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784290286.482495:0:86789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784290286.482498:0:86789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784290286.482500:0:86789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784290286.482501:0:86789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784290286.482502:0:86789:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 20000000:01000000:3.0:1784290286.482504:0:86795:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00010000:00010000:1.0:1784290286.482504:0:86798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c234236ca00/0x5953bbf6b30737ba lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.482514:0:86798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c234236ca00/0x5953bbf6b30737ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784290286.482515:0:86795:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:01000004:0.0:1784290286.482517:0:86789:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c246dce1800 from lustre-MDT0000 00010000:00010000:1.0:1784290286.482524:0:86798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236ca00/0x5953bbf6b30737ba lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290286.482540:0:86789:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1784290286.482550:0:86789:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784290286.482557:0:86789:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c246dce1800 10000000:01000000:0.0:1784290286.482561:0:86789:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784290286.482567:0:86789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c246dce1800 10000000:01000000:0.0:1784290286.482570:0:86789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1784290286.482576:0:86789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9c246dce1800 from 1 10000000:01000000:0.0:1784290286.482580:0:86789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1784290286.482609:0:86789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246923fc00/0x5953bbf6b30737c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.482616:0:86789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c246923fc00/0x5953bbf6b30737c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.482624:0:86789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c246923fc00/0x5953bbf6b30737c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290286.482633:0:86796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:3618:x1870961901030016:12345-0@lo:253:kworker.0 Request processed in 2648us (2931us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290286.482640:0:86789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343890a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901030528:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784290286.482645:0:86796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:1.0:1784290286.482651:0:3618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1784290286.482654:0:3618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784290286.482656:0:3618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290286.482658:0:3618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290286.482660:0:3618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290286.482662:0:3618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290286.482664:0:3618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784290286.482666:0:3618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290286.482669:0:3618:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784290286.482674:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901030016:0@lo:253:kworker.0 00000100:00100000:0.0:1784290286.482692:0:86789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290286.482699:0:86796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784290286.482709:0:86796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:3619:x1870961901030400:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1784290286.482724:0:86796:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1784290286.482740:0:86789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290286.482741:0:86797:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:3.0:1784290286.482748:0:86797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:3.0:1784290286.482883:0:86797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901030528 00000100:00100000:3.0:1784290286.482888:0:86797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901030528 00000100:00100000:0.0:1784290286.482949:0:86800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784290286.482956:0:86800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24425c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:86789:x1870961901030528:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784290286.482965:0:86800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290286.482976:0:86800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246923ea00/0x5953bbf6b30737c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30737c1 expref: -99 pid: 86800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.482989:0:86800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246923ea00/0x5953bbf6b30737c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30737c1 expref: 8 pid: 86800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.482996:0:86800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246923ea00/0x5953bbf6b30737c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30737c1 expref: 8 pid: 86800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.483008:0:86800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246923ea00, rc 0) 00000100:00100000:0.0:1784290286.483039:0:86800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24425c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:86789:x1870961901030528:12345-0@lo:101:mount.lustre.0 Request processed in 83us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290286.483044:0:86800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784290286.483079:0:86789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343890a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901030528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784290286.483092:0:86789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c246923fc00/0x5953bbf6b30737c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30737c8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290286.483100:0:86789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c246923fc00/0x5953bbf6b30737c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30737c8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290286.483112:0:86789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784290286.483124:0:86789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246923fc00/0x5953bbf6b30737c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30737c8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290286.483140:0:86789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c246923fc00/0x5953bbf6b30737c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30737c8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290286.483145:0:86789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784290286.483148:0:86789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784290286.483152:0:86789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c246dce1800 10000000:01000000:3.0:1784290286.483154:0:86789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1784290286.483157:0:86789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1784290286.483159:0:86789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784290286.483174:0:86789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2482045600/0x5953bbf6b30737cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290286.483180:0:86789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2482045600/0x5953bbf6b30737cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290286.483185:0:86789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2482045600/0x5953bbf6b30737cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290286.483194:0:86789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901030656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784290286.483215:0:86789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290286.483229:0:86789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246d46a300 going to sleep for 11 seconds 00000100:00100000:2.0:1784290286.483258:0:86797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901030656 00000100:00100000:2.0:1784290286.483266:0:86797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901030656 00000100:00100000:2.0:1784290286.483308:0:86797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784290286.483331:0:86797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e4d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:86789:x1870961901030656:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784290286.483388:0:86797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290286.483406:0:86797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c23450aae00/0x5953bbf6b30737d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30737cf expref: -99 pid: 86797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290286.483431:0:86797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c23450aae00/0x5953bbf6b30737d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30737cf expref: 9 pid: 86797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290286.483443:0:86797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c23450aae00/0x5953bbf6b30737d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30737cf expref: 9 pid: 86797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290286.483461:0:86797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aae00, rc 0) 00000100:00100000:2.0:1784290286.483513:0:86797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e4d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:86789:x1870961901030656:12345-0@lo:101:mount.lustre.0 Request processed in 184us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290286.483522:0:86797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784290286.483532:0:86789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901030656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784290286.483548:0:86789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2482045600/0x5953bbf6b30737cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30737d6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290286.483555:0:86789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2482045600/0x5953bbf6b30737cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30737d6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290286.483609:0:86789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901030784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784290286.483631:0:86789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290286.483651:0:86789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246d46a300 going to sleep for 11 seconds 00000100:00100000:0.0:1784290286.483662:0:86800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901030784 00000100:00100000:0.0:1784290286.483668:0:86800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901030784 00000100:00100000:0.0:1784290286.483697:0:86800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784290286.483703:0:86800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e4d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:86789:x1870961901030784:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784290286.483785:0:86800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e4d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:86789:x1870961901030784:12345-0@lo:501:mount.lustre.0 Request processed in 83us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290286.483792:0:86800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784290286.483833:0:86789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901030784:0@lo:501:mount.lustre.0 20000000:01000000:2.0:1784290286.483835:0:86795:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784290286.483849:0:86795:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1784290286.483859:0:86796:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784290286.483861:0:86798:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784290286.483867:0:86798:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:3.0:1784290286.483869:0:86789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901030912:0@lo:503:mount.lustre.0 00010000:00010000:0.0:1784290286.483885:0:86798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c246923e600/0x5953bbf6b30737dd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.483895:0:86798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246923e600/0x5953bbf6b30737dd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784290286.483902:0:86798:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000091779s 00010000:00010000:0.0:1784290286.483905:0:86798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c246923e600/0x5953bbf6b30737dd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.483911:0:86798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c246923e600/0x5953bbf6b30737dd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290286.483918:0:86789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784290286.483920:0:86798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c246923e600/0x5953bbf6b30737dd lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.483934:0:86798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c246923e600/0x5953bbf6b30737dd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290286.483936:0:86789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246d46a300 going to sleep for 11 seconds 00010000:00010000:0.0:1784290286.483941:0:86798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923e600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290286.483945:0:86798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c246923e600/0x5953bbf6b30737dd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.483950:0:86798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c246923e600/0x5953bbf6b30737dd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.483959:0:86798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c246923e600/0x5953bbf6b30737dd lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.483965:0:86798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c246923e600/0x5953bbf6b30737dd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.483969:0:86798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246923e600/0x5953bbf6b30737dd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290286.484003:0:86797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901030912 00000100:00100000:2.0:1784290286.484009:0:86797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901030912 00000100:00100000:2.0:1784290286.484053:0:86797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784290286.484055:0:86795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:3619:x1870961901030144:12345-0@lo:253:kworker.0 Request processed in 1574us (4158us total) trans 0 rc 0/0 00000020:01000004:1.0:1784290286.484074:0:3619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000100:00100000:2.0:1784290286.484076:0:86797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e4d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:86789:x1870961901030912:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784290286.484077:0:86795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:1.0:1784290286.484078:0:3619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784290286.484086:0:3619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290286.484096:0:3619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290286.484098:0:3619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290286.484100:0:3619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290286.484102:0:3619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784290286.484104:0:3619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290286.484106:0:3619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784290286.484110:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901030144:0@lo:253:kworker.0 00000100:00100000:3.0:1784290286.484575:0:86797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e4d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:86789:x1870961901030912:12345-0@lo:503:mount.lustre.0 Request processed in 514us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290286.484581:0:86797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784290286.484604:0:86789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901030912:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784290286.484895:0:86801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:86801:1870961901031040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290286.484946:0:86801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290286.484978:0:86800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901031040 00000100:00100000:0.0:1784290286.484983:0:86800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901031040 00000100:00100000:2.0:1784290286.484985:0:86801:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2480379900 going to sleep for 11 seconds 00000100:00100000:0.0:1784290286.485014:0:86800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784290286.485021:0:86800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e4d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:86801:x1870961901031040:12345-0@lo:502:llog_process_th.0 20000000:01000000:2.0:1784290286.485125:0:86796:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784290286.485138:0:86796:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1784290286.485146:0:86798:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784290286.485149:0:86798:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784290286.485158:0:86798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c246923f000/0x5953bbf6b30737e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.485223:0:86798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246923f000/0x5953bbf6b30737e4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784290286.485228:0:86798:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000091779s 00010000:00010000:0.0:1784290286.485231:0:86798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c246923f000/0x5953bbf6b30737e4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.485235:0:86798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c246923f000/0x5953bbf6b30737e4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.485240:0:86798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c246923f000/0x5953bbf6b30737e4 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.485244:0:86798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c246923f000/0x5953bbf6b30737e4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.485248:0:86798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923f000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290286.485252:0:86798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c246923f000/0x5953bbf6b30737e4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.485257:0:86798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c246923f000/0x5953bbf6b30737e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.485264:0:86798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c246923f000/0x5953bbf6b30737e4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.485270:0:86798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c246923f000/0x5953bbf6b30737e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.485275:0:86798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246923f000/0x5953bbf6b30737e4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290286.485399:0:86796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:3619:x1870961901030400:12345-0@lo:253:kworker.0 Request processed in 2628us (5347us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290286.485410:0:86796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:1.0:1784290286.485412:0:3619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1784290286.485415:0:3619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784290286.485417:0:3619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290286.485419:0:3619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290286.485421:0:3619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290286.485424:0:3619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290286.485427:0:3619:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784290286.485430:0:3619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290286.485432:0:3619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784290286.485439:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901030400:0@lo:253:kworker.0 00000100:00100000:0.0:1784290286.485477:0:86800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e4d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:86801:x1870961901031040:12345-0@lo:502:llog_process_th.0 Request processed in 451us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290286.485485:0:86800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784290286.485490:0:86801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:86801:1870961901031040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784290286.485518:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784290286.485527:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290286.485529:0:86801:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784290286.485533:0:86801:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1784290286.485535:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784290286.485544:0:86801:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c246ff10000) 00000020:00000080:3.0:1784290286.485556:0:86801:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1784290286.485559:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1784290286.485618:0:86801:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:3.0:1784290286.485623:0:86801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b30737f2 00000020:00000080:3.0:1784290286.485787:0:86801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784290286.485791:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290286.485798:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290286.485800:0:86801:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784290286.485802:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784290286.485805:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290286.485806:0:86801:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1784290286.485808:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784290286.485814:0:86801:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c246ff14d40) 00000020:00000080:3.0:1784290286.485824:0:86801:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1784290286.485827:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1784290286.485829:0:86801:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1784290286.485831:0:86801:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1784290286.485836:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784290286.485874:0:86801:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c246dce1800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1784290286.485883:0:86801:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c246ff13380) 00000020:00000080:3.0:1784290286.485890:0:86801:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1784290286.485938:0:86801:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1784290286.485942:0:86801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3073807 00000020:00000080:3.0:1784290286.486014:0:86801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1784290286.486020:0:86801:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1784290286.486022:0:86801:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5953bbf6b307380e 00080000:01000000:3.0:1784290286.486026:0:86801:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1784290286.486028:0:86801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3073815 00010000:00010000:3.0:1784290286.523568:0:86801:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1784290286.523712:0:86801:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: bd808cf4-dd54-45f0-9b2b-1434e8330e5d idx: 0 lr: 94489280519 srv lr: 98784247808 lx: 0 gen 22 00000001:00080000:3.0:1784290286.523760:0:86801:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 98784247808 lx: 0 gen 21 00000001:00000004:3.0:1784290286.523781:0:86801:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 98784247808 00000001:00080000:3.0:1784290286.523869:0:86801:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1784290286.523920:0:86801:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2342c3a240: xid 1870961896205568, transno 98784247812, client gen 22, slot idx 0 00000001:00080000:3.0:1784290286.523928:0:86801:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c246deb3d80: xid 1870961896205312, transno 98784247811, client gen 22, slot idx 1 00000020:00000080:3.0:1784290286.524354:0:86801:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c23440d4d40) 00000020:00000080:3.0:1784290286.524377:0:86801:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1784290286.524448:0:86801:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784290286.524455:0:86801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3073831 00000020:00000080:2.0:1784290286.524861:0:86801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1784290286.527158:0:86801:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5953bbf6b3073838 00000020:00000080:3.0:1784290286.527448:0:86801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1784290286.527462:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290286.527468:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290286.527470:0:86801:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1784290286.527472:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784290286.527474:0:86801:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1784290286.527476:0:86801:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784290286.527477:0:86801:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784290286.527478:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784290286.527480:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290286.527481:0:86801:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784290286.527482:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784290286.527486:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290286.527487:0:86801:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1784290286.527490:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784290286.527523:0:86801:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1784290286.527549:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290286.527552:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290286.527553:0:86801:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1784290286.527555:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784290286.527557:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290286.527559:0:86801:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1784290286.527563:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784290286.527568:0:86801:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:00000080:3.0:1784290286.527599:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784290286.527609:0:86801:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c23440d19c0) 00000020:00000080:3.0:1784290286.527621:0:86801:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1784290286.527625:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784290286.527694:0:86801:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1784290286.527701:0:86801:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:3.0:1784290286.527720:0:86801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3073846 00010000:00080000:3.0:1784290286.527778:0:86801:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c23452c2000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:3.0:1784290286.529630:0:86801:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1784290286.530326:0:86801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784290286.530331:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1784290286.530379:0:86801:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784290286.530396:0:86801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b307384d 00000100:00080000:3.0:1784290286.530404:0:86801:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784290286.530409:0:86801:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c23452c2000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290286.530443:0:86801:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c24483c8700 x1870961901031168/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784290286.530465:0:86801:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1784290286.530488:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901031168:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1784290286.530514:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290286.530523:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290286.530528:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000020:01000000:3.0:1784290286.530532:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290286.530537:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00080000:1.0:1784290286.530538:0:9947:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2023 00000020:00000080:3.0:1784290286.530542:0:86801:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000100:00080000:1.0:1784290286.530546:0:9947:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000020:01000000:3.0:1784290286.530555:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00100000:2.0:1784290286.530556:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784290286.530564:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000020:01000000:3.0:1784290286.530566:0:86801:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1784290286.530570:0:86801:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784290286.530573:0:86801:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784290286.530574:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784290286.530577:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290286.530579:0:86801:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784290286.530583:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784290286.530589:0:86801:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1784290286.530594:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290286.530598:0:86801:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000100:00100000:1.0:1784290286.530599:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c234434c000 x1870961901031296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:3.0:1784290286.530604:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784290286.530613:0:86801:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000100:00100000:0.0:1784290286.530621:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901031168 00000100:00100000:0.0:1784290286.530632:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901031168 00000020:01000000:3.0:1784290286.530637:0:86801:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000100:00100000:2.0:1784290286.530639:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901031296:0@lo:38:kworker.0 00000020:00000080:3.0:1784290286.530644:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784290286.530655:0:86801:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c23440d3380) 00000100:00080000:1.0:1784290286.530666:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290286.530673:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000020:00000080:3.0:1784290286.530678:0:86801:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000100:00080000:1.0:1784290286.530680:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784290286.530684:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3743 00000100:00100000:2.0:1784290286.530692:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1784290286.530697:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00080000:1.0:1784290286.530708:0:9947:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2023 00000100:00100000:0.0:1784290286.530709:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901031168:12345-0@lo:38:llog_process_th.0 00000100:00080000:1.0:1784290286.530716:0:9947:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784290286.530724:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00010000:00080000:0.0:1784290286.530738:0:8413:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2027 last 0 00000100:00100000:1.0:1784290286.530746:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2445d0c380 x1870961901031552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290286.530752:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901031296 00000100:00100000:2.0:1784290286.530759:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901031296 00000100:00080000:1.0:1784290286.530799:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000080:0.0:1784290286.530799:0:8413:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b307385b 00000100:00080000:1.0:1784290286.530813:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1784290286.530817:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000004:00080000:3.0:1784290286.530818:0:86801:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00000100:00080000:1.0:1784290286.530819:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000004:00100000:0.0:1784290286.530824:0:8413:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00080000:01000000:3.0:1784290286.530830:0:86801:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000100:00080000:1.0:1784290286.530833:0:9947:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2023 00000100:00080000:1.0:1784290286.530840:0:9947:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000020:00000080:3.0:1784290286.530843:0:86801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3073862 00000100:00100000:2.0:1784290286.530849:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901031296:12345-0@lo:38:kworker.0 00000100:00080000:1.0:1784290286.530854:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00010000:00080000:3.0:1784290286.530880:0:86801:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c246dcf8800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.106@tcp at head 00000100:00100000:1.0:1784290286.530883:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2474ecd180 x1870961901031808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290286.530938:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901031296:12345-0@lo:38:kworker.0 Request processed in 96us (262us total) trans 0 rc -11/-11 00000100:00080000:1.0:1784290286.530944:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290286.530947:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784290286.530948:0:8413:0:(import.c:65:import_set_state_nolock()) ffff9c2474ebc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784290286.530949:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00080000:1.0:1784290286.530954:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290286.530968:0:9947:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2023 00000100:00080000:1.0:1784290286.530972:0:9947:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784290286.530977:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290286.530994:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2474ecca80 x1870961901032192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290286.531005:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901031552:0@lo:38:kworker.0 00000100:00100000:1.0:1784290286.531044:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901031424:0@lo:400:kworker.0 00000100:00100000:0.0:1784290286.531063:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3616:x1870961901031168:12345-0@lo:38:llog_process_th.0 Request processed in 356us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290286.531074:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290286.531094:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3743 00000100:00100000:1.0:1784290286.531109:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290286.531122:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901031808:0@lo:38:kworker.0 00000100:00100000:1.0:1784290286.531158:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784290286.531167:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901031936:0@lo:400:kworker.0 00000100:00100000:1.0:1784290286.531182:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1870961901031680:0@lo:400:kworker.0 00000100:00100000:2.0:1784290286.531183:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784290286.531205:0:86801:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:0.0:1784290286.531231:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290286.531249:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784290286.531259:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290286.531268:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784290286.531271:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784290286.531273:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901031296:0@lo:38:kworker.0 00000100:00100000:0.0:1784290286.531284:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901032064:0@lo:400:kworker.0 00000100:00100000:2.0:1784290286.531308:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784290286.531331:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00100000:0.0:1784290286.531338:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290286.531372:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901031552 00000100:00080000:2.0:1784290286.531379:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00100000:1.0:1784290286.531379:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901031552 00000100:00080000:2.0:1784290286.531394:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1784290286.531399:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c23452c2000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784290286.531432:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901031168:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784290286.531434:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901031424 00000100:00100000:1.0:1784290286.531441:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901031424 00000100:00100000:0.0:1784290286.531459:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901031936 00000100:00100000:0.0:1784290286.531464:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901031936 00000100:00080000:3.0:1784290286.531477:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784290286.531484:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901032192:0@lo:38:kworker.0 00000100:00080000:3.0:1784290286.531487:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290286.531496:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901031680 00000100:00100000:1.0:1784290286.531500:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901031680 00000100:00100000:0.0:1784290286.531510:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901032064 00000100:00100000:0.0:1784290286.531515:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901032064 00000100:00080000:3.0:1784290286.531529:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784290286.531534:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784290286.531545:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290286.531554:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901032192 00000100:00100000:0.0:1784290286.531561:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:1.0:1784290286.531562:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901032192 00000100:00100000:0.0:1784290286.531575:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901031936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290286.531598:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:1.0:1784290286.531613:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901031424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290286.531632:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:0.0:1784290286.531638:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901031936:12345-0@lo:400:kworker.0 Request processed in 66us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290286.531649:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1870961901031680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290286.531670:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901031424:12345-0@lo:400:kworker.0 Request processed in 60us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290286.531673:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00100000:1.0:1784290286.531682:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:0.0:1784290286.531705:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00100000:1.0:1784290286.531712:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:0.0:1784290286.531719:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901032064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290286.531724:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901031552:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784290286.531740:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1870961901031680:12345-0@lo:400:kworker.0 Request processed in 95us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290286.531752:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00100000:0.0:1784290286.531770:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343890a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901032064:12345-0@lo:400:kworker.0 Request processed in 57us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290286.531780:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00100000:1.0:1784290286.531795:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901031552:12345-0@lo:38:kworker.0 Request processed in 68us (723us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784290286.531806:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:2.0:1784290286.531820:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:2.0:1784290286.531832:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901032192:12345-0@lo:38:kworker.0 00000100:00080000:3.0:1784290286.531838:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784290286.531847:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784290286.531853:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901031552:0@lo:38:kworker.0 00000100:00100000:0.0:1784290286.531871:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474ece300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901032064:0@lo:400:kworker.0 00000100:00100000:1.0:1784290286.531888:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1870961901031680:0@lo:400:kworker.0 00000100:00100000:0.0:1784290286.531913:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901031936:0@lo:400:kworker.0 00000100:00100000:2.0:1784290286.531921:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901032192:12345-0@lo:38:kworker.0 Request processed in 83us (377us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784290286.531923:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901031424:0@lo:400:kworker.0 00000100:00080000:3.0:1784290286.531926:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784290286.531942:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784290286.531961:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901032192:0@lo:38:kworker.0 00000100:00100000:2.0:1784290286.531965:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1784290286.532003:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901032320:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784290286.532036:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901031808 00000100:00100000:2.0:1784290286.532042:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901031808 00000100:00100000:1.0:1784290286.532060:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1784290286.532076:0:86801:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1784290286.532086:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901032320 00000100:00100000:2.0:1784290286.532091:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901032320 00000040:01000000:3.0:1784290286.532111:0:86801:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1784290286.532117:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3744 00000100:00100000:0.0:1784290286.532132:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901031808:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784290286.532138:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3745 00000100:00100000:1.0:1784290286.532154:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901032320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784290286.532181:0:8413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:0.0:1784290286.532188:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901031808:12345-0@lo:38:kworker.0 Request processed in 59us (1017us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784290286.532197:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3744 00000100:00080000:2.0:1784290286.532223:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290286.532234:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784290286.532242:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901032320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290286.532245:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474ecd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901031808:0@lo:38:kworker.0 00000100:00100000:1.0:1784290286.532260:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3745 00000100:00100000:3.0:1784290286.532277:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901032320:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1784290286.532433:0:86801:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000040:00080000:0.0:1784290286.532945:0:86801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784290286.532968:0:86801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].24, 64 off9728 00000040:00080000:0.0:1784290286.535132:0:86801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x60:0x0].1, 64 off8256 00000040:00080000:0.0:1784290286.535338:0:86807:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:0.0:1784290286.535364:0:86807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1784290286.535480:0:86807:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:0.0:1784290286.535494:0:86807:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1784290286.535602:0:86807:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:0.0:1784290286.535605:0:86807:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1784290286.535750:0:86801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784290286.535761:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784290286.535789:0:86801:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784290286.535805:0:86801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3073869 00000100:00080000:2.0:1784290286.535811:0:86801:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784290286.535815:0:86801:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c246dcf8800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290286.535835:0:86801:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c234434dc00 x1870961901032448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784290286.535855:0:86801:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1784290286.535892:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901032448:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1784290286.535933:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784290286.535938:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290286.535940:0:86801:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1784290286.535944:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00100000:3.0:1784290286.535952:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1784290286.535954:0:86801:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1784290286.535957:0:86801:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784290286.535960:0:86801:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784290286.535961:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784290286.535970:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290286.535973:0:86801:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784290286.535978:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784290286.535983:0:86801:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1784290286.535987:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290286.535989:0:86801:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1784290286.535995:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000100:00100000:0.0:1784290286.535996:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901032448 00000020:00000080:2.0:1784290286.536002:0:86801:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000100:00100000:0.0:1784290286.536003:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901032448 00000020:01000000:2.0:1784290286.536034:0:86801:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784290286.536037:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000100:00100000:0.0:1784290286.536043:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4912 00000020:00000080:2.0:1784290286.536049:0:86801:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c2445c13380) 00000100:00100000:0.0:1784290286.536066:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1870961901032448:12345-0@lo:8:llog_process_th.0 00000020:00000080:2.0:1784290286.536086:0:86801:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00010000:00080000:0.0:1784290286.536092:0:8402:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2027 last 0 00000020:00000080:2.0:1784290286.536093:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:00000080:0.0:1784290286.536123:0:8402:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3073877 00002000:00100000:0.0:1784290286.536134:0:8402:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c2458bea800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ad ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1784290286.536139:0:8402:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1784290286.536141:0:8402:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000004:00080000:2.0:1784290286.536186:0:86801:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1784290286.536193:0:86801:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00002000:00080000:0.0:1784290286.536199:0:8402:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000020:00000080:2.0:1784290286.536202:0:86801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b307387e 00000100:00080000:0.0:1784290286.536216:0:8402:0:(import.c:65:import_set_state_nolock()) ffff9c2458bec800 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1784290286.536247:0:86801:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2444aa5000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.106@tcp at head 00000100:00100000:0.0:1784290286.536265:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1870961901032448:12345-0@lo:8:llog_process_th.0 Request processed in 202us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290286.536273:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4912 00000100:00100000:3.0:1784290286.536292:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784290286.536299:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784290286.536306:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784290286.536322:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1784290286.536325:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dcf8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784290286.536369:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784290286.536380:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901032448:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1784290286.536433:0:86807:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1784290286.536444:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901032576:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1784290286.536488:0:86807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2027776145699ns, next at 0ns, rc = 0 00000100:00100000:0.0:1784290286.536498:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:00080000:1.0:1784290286.536503:0:86807:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1784290286.536546:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901032576 00000100:00100000:3.0:1784290286.536551:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901032576 00000100:00080000:0.0:1784290286.536582:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784290286.536617:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1784290286.536628:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901032576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784290286.536649:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290286.536706:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901032576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290286.536715:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901032576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784290286.536718:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00010000:00010000:2.0:1784290286.536829:0:86801:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1784290286.536875:0:86801:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784290286.536884:0:86801:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1784290286.537132:0:86801:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000004:00080000:1.0:1784290286.537547:0:86790:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:2.0:1784290286.537572:0:86801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784290286.537610:0:86801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].24, 64 off9728 00000040:00080000:2.0:1784290286.537710:0:86801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x62:0x0].1, 64 off8256 00000040:00080000:2.0:1784290286.537941:0:86809:0:(llog.c:805:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:2.0:1784290286.537945:0:86809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1784290286.538059:0:86809:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000040:00080000:2.0:1784290286.538070:0:86809:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1784290286.538166:0:86809:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:2.0:1784290286.538169:0:86809:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1784290286.538428:0:86801:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784290286.538435:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784290286.538464:0:86801:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784290286.538478:0:86801:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3073885 00000100:00080000:3.0:1784290286.538483:0:86801:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784290286.538487:0:86801:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c2444aa5000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290286.538501:0:86801:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2445d0dc00 x1870961901032704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784290286.538518:0:86801:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1784290286.538535:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901032704:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1784290286.538572:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290286.538577:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290286.538580:0:86801:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784290286.538585:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784290286.538595:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00100000:2.0:1784290286.538595:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1784290286.538602:0:86801:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784290286.538605:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784290286.538606:0:86801:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784290286.538609:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290286.538610:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290286.538621:0:86801:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784290286.538627:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784290286.538631:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290286.538633:0:86801:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784290286.538640:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784290286.538641:0:26255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901032704 00000100:00100000:0.0:1784290286.538648:0:26255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901032704 00000100:00100000:3.0:1784290286.538672:0:86801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:86801:1870961901032832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290286.538679:0:26255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4913 00000100:00100000:0.0:1784290286.538687:0:26255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3616:x1870961901032704:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1784290286.538702:0:26255:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2027 last 0 00000020:00000080:0.0:1784290286.538720:0:26255:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b307388c 00002000:00100000:0.0:1784290286.538727:0:26255:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c2458bef000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ad ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784290286.538730:0:26255:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784290286.538734:0:26255:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1784290286.538736:0:86801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290286.538768:0:86797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901032832 00000100:00100000:3.0:1784290286.538769:0:86801:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342f59840 going to sleep for 11 seconds 00000100:00100000:2.0:1784290286.538778:0:86797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901032832 00002000:00080000:0.0:1784290286.538784:0:26255:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784290286.538814:0:26255:0:(import.c:65:import_set_state_nolock()) ffff9c2458bef800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784290286.538819:0:86797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784290286.538833:0:86797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e4d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:86801:x1870961901032832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290286.538873:0:26255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3616:x1870961901032704:12345-0@lo:8:llog_process_th.0 Request processed in 182us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290286.538884:0:26255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4913 00000100:00100000:3.0:1784290286.538892:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784290286.538899:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1784290286.538906:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1784290286.538910:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1784290286.538913:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2444aa5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1784290286.538930:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1784290286.538936:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901032704:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1784290286.538956:0:86797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e4d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:86801:x1870961901032832:12345-0@lo:502:llog_process_th.0 Request processed in 121us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290286.538967:0:86797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784290286.538974:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784290286.538993:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901032960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290286.539021:0:86801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:86801:1870961901032832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784290286.539046:0:86801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784290286.539051:0:86801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290286.539052:0:86801:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000100:00100000:1.0:1784290286.539064:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1784290286.539065:0:86801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:0.0:1784290286.539107:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901032960 00000100:00100000:0.0:1784290286.539112:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901032960 00000004:00080000:1.0:1784290286.539139:0:86809:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1784290286.539163:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000020:01000000:3.0:1784290286.539174:0:86789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 00000100:00100000:0.0:1784290286.539176:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901032960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784290286.539199:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000004:00080000:1.0:1784290286.539201:0:86809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2027778857877ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784290286.539211:0:86809:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 10000000:01000000:3.0:1784290286.539232:0:86789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:0.0:1784290286.539246:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901032960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (191us total) trans 0 rc 0/0 00010000:00010000:3.0:1784290286.539251:0:86789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2482045600/0x5953bbf6b30737cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30737d6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290286.539254:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00010000:00010000:3.0:1784290286.539267:0:86789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2482045600/0x5953bbf6b30737cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30737d6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290286.539275:0:86789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9c246dce1800 from 1 10000000:01000000:3.0:1784290286.539278:0:86789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00080000:0.0:1784290286.539278:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784290286.539309:0:86789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2482045400/0x5953bbf6b3073893 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290286.539328:0:86789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2482045400/0x5953bbf6b3073893 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290286.539386:0:86789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2482045400/0x5953bbf6b3073893 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290286.539399:0:86789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901033088:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784290286.539437:0:86789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290286.539463:0:86789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342f59f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784290286.539483:0:86796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901033088 00000100:00100000:1.0:1784290286.539490:0:86796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901033088 00000100:00100000:1.0:1784290286.539537:0:86796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784290286.539543:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343892a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901032960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784290286.539553:0:86796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246df9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:86789:x1870961901033088:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784290286.539566:0:86796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290286.539584:0:86796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236ca00/0x5953bbf6b307389a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073893 expref: -99 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.539611:0:86796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236ca00/0x5953bbf6b307389a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073893 expref: 9 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.539624:0:86796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236ca00/0x5953bbf6b307389a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073893 expref: 9 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.539635:0:86796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236ca00, rc 0) 00000100:00100000:1.0:1784290286.539687:0:86796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246df9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:86789:x1870961901033088:12345-0@lo:101:mount.lustre.0 Request processed in 135us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290286.539699:0:86796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784290286.539742:0:86789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901033088:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784290286.539758:0:86789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2482045400/0x5953bbf6b3073893 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307389a expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290286.539767:0:86789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2482045400/0x5953bbf6b3073893 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307389a expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784290286.540184:0:86790:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1784290286.540238:0:86789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901033216:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1784290286.540269:0:86789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290286.540285:0:86789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342f59f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784290286.540300:0:86795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901033216 00000100:00100000:2.0:1784290286.540306:0:86795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901033216 00000100:00100000:3.0:1784290286.540376:0:86797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784290286.540389:0:86797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246df9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:86789:x1870961901033216:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1784290286.540402:0:86797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1784290286.540417:0:86797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784290286.540420:0:86797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784290286.540422:0:86797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784290286.540424:0:86797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 107 00000100:00100000:3.0:1784290286.540501:0:86797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246df9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:86789:x1870961901033216:12345-0@lo:256:mount.lustre.0 Request processed in 116us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290286.540508:0:86797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784290286.540514:0:86789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901033216:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1784290286.541113:0:86789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784290286.541127:0:86789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2482045400/0x5953bbf6b3073893 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307389a expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.541135:0:86789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2482045400/0x5953bbf6b3073893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307389a expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290286.541141:0:86789:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c246dce1800 from 1 10000000:01000000:0.0:1784290286.541142:0:86789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784290286.541157:0:86789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246923f000/0x5953bbf6b30738a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.541162:0:86789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c246923f000/0x5953bbf6b30738a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.541176:0:86789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c246923f000/0x5953bbf6b30738a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290286.541186:0:86789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901033344:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784290286.541206:0:86789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290286.541228:0:86789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95240 going to sleep for 11 seconds 00000100:00100000:1.0:1784290286.541240:0:86800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901033344 00000100:00100000:1.0:1784290286.541245:0:86800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901033344 00000100:00100000:1.0:1784290286.541271:0:86800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784290286.541278:0:86800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:86789:x1870961901033344:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784290286.541284:0:86800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290286.541298:0:86800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236cc00/0x5953bbf6b30738a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30738a1 expref: -99 pid: 86800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.541321:0:86800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236cc00/0x5953bbf6b30738a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30738a1 expref: 10 pid: 86800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.541330:0:86800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236cc00/0x5953bbf6b30738a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30738a1 expref: 10 pid: 86800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290286.541335:0:86800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236cc00, rc 0) 00000100:00100000:1.0:1784290286.541394:0:86800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c124850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:86789:x1870961901033344:12345-0@lo:101:mount.lustre.0 Request processed in 117us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290286.541400:0:86800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784290286.541411:0:86789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901033344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784290286.541423:0:86789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c246923f000/0x5953bbf6b30738a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30738a8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.541429:0:86789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c246923f000/0x5953bbf6b30738a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30738a8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290286.541472:0:86789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901033472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784290286.541490:0:86789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290286.541520:0:86795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901033472 00000100:00100000:0.0:1784290286.541523:0:86789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95240 going to sleep for 11 seconds 00000100:00100000:2.0:1784290286.541527:0:86795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901033472 00000100:00100000:2.0:1784290286.541558:0:86795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784290286.541564:0:86795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:86789:x1870961901033472:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784290286.541644:0:86795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c126450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:86789:x1870961901033472:12345-0@lo:501:mount.lustre.0 Request processed in 79us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290286.541650:0:86795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784290286.541657:0:86789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901033472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784290286.541687:0:86789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901033600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784290286.541725:0:86789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290286.541740:0:86789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95240 going to sleep for 11 seconds 00000100:00100000:2.0:1784290286.541752:0:86796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901033600 00000100:00100000:2.0:1784290286.541757:0:86796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901033600 00000100:00100000:2.0:1784290286.541780:0:86796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784290286.541791:0:86796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:86789:x1870961901033600:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784290286.541858:0:86796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c125850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:86789:x1870961901033600:12345-0@lo:503:mount.lustre.0 Request processed in 65us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290286.541863:0:86796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784290286.541891:0:86789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901033600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784290286.542101:0:86811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:86811:1870961901033728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290286.542137:0:86811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290286.542152:0:86811:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95900 going to sleep for 11 seconds 00000100:00100000:3.0:1784290286.542175:0:86797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901033728 00000100:00100000:3.0:1784290286.542181:0:86797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901033728 00000100:00100000:3.0:1784290286.542215:0:86797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784290286.542222:0:86797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:86811:x1870961901033728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290286.542457:0:86797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468e52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:86811:x1870961901033728:12345-0@lo:502:llog_process_th.0 Request processed in 236us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290286.542465:0:86797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784290286.542471:0:86811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:86811:1870961901033728:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784290286.542494:0:86811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784290286.542500:0:86811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290286.542502:0:86811:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784290286.542511:0:86811:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c246dce1800 00000020:00000080:0.0:1784290286.542513:0:86811:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784290286.542518:0:86811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784290286.542520:0:86811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290286.542521:0:86811:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1784290286.542523:0:86811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784290286.542525:0:86811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290286.542526:0:86811:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784290286.542528:0:86811:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c246dce1800 00000020:00000080:0.0:1784290286.542529:0:86811:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784290286.542584:0:86811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:86811:1870961901033856:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290286.542612:0:86811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290286.542635:0:86811:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95900 going to sleep for 11 seconds 00000100:00100000:2.0:1784290286.542647:0:86800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901033856 00000100:00100000:2.0:1784290286.542653:0:86800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901033856 00000100:00100000:2.0:1784290286.542687:0:86800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784290286.542692:0:86800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:86811:x1870961901033856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290286.542775:0:86800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:86811:x1870961901033856:12345-0@lo:502:llog_process_th.0 Request processed in 82us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290286.542782:0:86800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784290286.542792:0:86811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:86811:1870961901033856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784290286.542824:0:86811:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784290286.542828:0:86811:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290286.542829:0:86811:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1784290286.542833:0:86811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1784290286.542886:0:86789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1784290286.542915:0:86789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784290286.542928:0:86789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246923f000/0x5953bbf6b30738a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30738a8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290286.542936:0:86789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c246923f000/0x5953bbf6b30738a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30738a8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290286.542988:0:86789:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784290286.542991:0:86789:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c246dce1800 10000000:01000000:3.0:1784290286.542994:0:86789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c246dce1800 10000000:01000000:3.0:1784290286.542998:0:86789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784290286.543001:0:86789:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c246dce1800 from 1 10000000:01000000:3.0:1784290286.543002:0:86789:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784290286.543018:0:86789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2482044c00/0x5953bbf6b30738af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290286.543028:0:86789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2482044c00/0x5953bbf6b30738af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290286.543036:0:86789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2482044c00/0x5953bbf6b30738af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290286.543064:0:86789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901033984:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784290286.543101:0:86789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290286.543126:0:86789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342f59f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784290286.543128:0:86795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901033984 00000100:00100000:2.0:1784290286.543134:0:86795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901033984 00000100:00100000:2.0:1784290286.543162:0:86795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784290286.543169:0:86795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:86789:x1870961901033984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784290286.543175:0:86795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290286.543189:0:86795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c23450ab400/0x5953bbf6b30738b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30738af expref: -99 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290286.543207:0:86795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c23450ab400/0x5953bbf6b30738b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30738af expref: 11 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290286.543218:0:86795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c23450ab400/0x5953bbf6b30738b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30738af expref: 11 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290286.543228:0:86795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450ab400, rc 0) 00000100:00100000:2.0:1784290286.543272:0:86795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:86789:x1870961901033984:12345-0@lo:101:mount.lustre.0 Request processed in 105us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290286.543286:0:86795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1784290286.543323:0:86789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901033984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784290286.543382:0:86789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2482044c00/0x5953bbf6b30738af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30738b6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290286.543391:0:86789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2482044c00/0x5953bbf6b30738af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30738b6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290286.543439:0:86789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901034112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784290286.543472:0:86789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290286.543504:0:86796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901034112 00000100:00100000:3.0:1784290286.543509:0:86789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342f59f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784290286.543510:0:86796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901034112 00000100:00100000:2.0:1784290286.543557:0:86796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784290286.543566:0:86796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:86789:x1870961901034112:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784290286.543640:0:86796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:86789:x1870961901034112:12345-0@lo:501:mount.lustre.0 Request processed in 78us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290286.543647:0:86796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784290286.543682:0:86789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901034112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784290286.543716:0:86789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901034240:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784290286.543769:0:86789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290286.543786:0:86789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342f59f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784290286.543799:0:86797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901034240 00000100:00100000:2.0:1784290286.543804:0:86797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901034240 00000100:00100000:2.0:1784290286.543839:0:86797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784290286.543848:0:86797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:86789:x1870961901034240:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784290286.543929:0:86797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:86789:x1870961901034240:12345-0@lo:503:mount.lustre.0 Request processed in 84us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290286.543935:0:86797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784290286.543948:0:86789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901034240:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784290286.544192:0:86812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:86812:1870961901034368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290286.544231:0:86812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290286.544251:0:86812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342f59840 going to sleep for 11 seconds 00000100:00100000:2.0:1784290286.544274:0:86800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901034368 00000100:00100000:2.0:1784290286.544279:0:86800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901034368 00000100:00100000:2.0:1784290286.544308:0:86800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784290286.544331:0:86800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:86812:x1870961901034368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290286.544477:0:86800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:86812:x1870961901034368:12345-0@lo:502:llog_process_th.0 Request processed in 147us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290286.544487:0:86800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784290286.544509:0:86812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:86812:1870961901034368:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1784290286.544556:0:86812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1784290286.544573:0:86812:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c23440d0000) 00000020:00000080:3.0:1784290286.544588:0:86812:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1784290286.544699:0:86812:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c246dce1800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784290286.544705:0:86812:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c246dce1800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784290286.544708:0:86812:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c246dce1800 4 00010000:00080000:3.0:1784290286.544741:0:86812:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c234529d800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:3.0:1784290286.546708:0:86812:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1784290286.546813:0:86812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1784290286.546856:0:86812:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784290286.546865:0:86812:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5953bbf6b30738c4 00000100:00080000:3.0:1784290286.546873:0:86812:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784290286.546877:0:86812:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c234529d800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290286.546895:0:86812:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2445d0dc00 x1870961901034496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784290286.546915:0:86812:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784290286.546941:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901034496:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784290286.547004:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290286.547051:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901034496 00000100:00100000:3.0:1784290286.547056:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901034496 00000100:00100000:3.0:1784290286.547088:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:3.0:1784290286.547094:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901034496:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784290286.547145:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901034496:12345-0@lo:38:llog_process_th.0 Request processed in 48us (138us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784290286.547153:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1784290286.547158:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784290286.547165:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234529d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784290286.547170:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784290286.547175:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901034496:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784290286.547476:0:86812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:86812:1870961901034624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290286.547518:0:86812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290286.547536:0:86812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a77bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784290286.547548:0:86795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901034624 00000100:00100000:1.0:1784290286.547551:0:86795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901034624 00000100:00100000:1.0:1784290286.547578:0:86795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784290286.547583:0:86795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:86812:x1870961901034624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290286.547662:0:86795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:86812:x1870961901034624:12345-0@lo:502:llog_process_th.0 Request processed in 77us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290286.547673:0:86795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784290286.547708:0:86812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:86812:1870961901034624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290286.547741:0:86812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:86812:1870961901034752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290286.547765:0:86812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290286.547776:0:86812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a77bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784290286.547785:0:86796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901034752 00000100:00100000:1.0:1784290286.547788:0:86796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901034752 00000100:00100000:1.0:1784290286.547827:0:86796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784290286.547839:0:86796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:86812:x1870961901034752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290286.547901:0:86796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:86812:x1870961901034752:12345-0@lo:502:llog_process_th.0 Request processed in 68us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290286.547911:0:86796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784290286.547951:0:86812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:86812:1870961901034752:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784290286.547965:0:86812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1784290286.548085:0:86789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1784290286.548113:0:86789:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784290286.548131:0:86789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2482044c00/0x5953bbf6b30738af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30738b6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.548140:0:86789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2482044c00/0x5953bbf6b30738af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30738b6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784290286.548200:0:86789:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784290286.548203:0:86789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784290286.548204:0:86789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784290286.548205:0:86789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784290286.548206:0:86789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784290286.548207:0:86789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784290286.548209:0:86789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784290286.548210:0:86789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784290286.548212:0:86789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784290286.548213:0:86789:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784290286.548217:0:86789:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1784290286.548218:0:86789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784290286.548219:0:86789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784290286.548220:0:86789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784290286.548221:0:86789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784290286.548222:0:86789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784290286.548222:0:86789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784290286.548223:0:86789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784290286.548224:0:86789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784290286.548224:0:86789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784290286.548225:0:86789:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784290286.548239:0:86789:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784290286.548248:0:86789:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901034880:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784290286.548282:0:86789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290286.548305:0:86789:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95900 going to sleep for 11 seconds 00000100:00100000:2.0:1784290286.548338:0:86797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901034880 00000100:00100000:2.0:1784290286.548427:0:86797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901034880 00000100:00100000:2.0:1784290286.548464:0:86797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784290286.548476:0:86797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:86789:x1870961901034880:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784290286.548500:0:86797:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784290286.548511:0:86797:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784290286.550127:0:86797:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784290286.550139:0:86797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1784290286.550192:0:86798:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784290286.550198:0:86798:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784290286.550214:0:86798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c246923e600/0x5953bbf6b30738cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.550226:0:86798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c234236ca00/0x5953bbf6b307389a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073893 expref: 11 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.550232:0:86798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c246923e600/0x5953bbf6b30738cb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.550265:0:86798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c234236ca00/0x5953bbf6b307389a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3073893 expref: 11 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.550280:0:86798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c234236ca00/0x5953bbf6b307389a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3073893 expref: 11 pid: 86796 timeout: 2127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290286.550289:0:86798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:86798:1870961901035008:0@lo:104: 00000100:00100000:2.0:1784290286.550391:0:86797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:86789:x1870961901034880:12345-0@lo:253:mount.lustre.0 Request processed in 1912us (2103us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290286.550391:0:86798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290286.550402:0:86797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784290286.550433:0:86798:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95240 going to sleep for 11 seconds 00000100:00100000:0.0:1784290286.550456:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901035008 00000100:00100000:0.0:1784290286.550460:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901035008 00000100:00100000:0.0:1784290286.550495:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1784290286.550504:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343891880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:86798:x1870961901035008:12345-0@lo:104: 00010000:00010000:0.0:1784290286.550515:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c2482045400/0x5953bbf6b3073893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b307389a expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.550563:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784290286.550568:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343891880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:86798:x1870961901035008:12345-0@lo:104: Request processed in 66us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290286.550573:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1784290286.550580:0:86798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:86798:1870961901035008:0@lo:104: 00010000:00010000:0.0:1784290286.550595:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290286.550598:0:86798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c246923e600/0x5953bbf6b30738cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.550601:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c2482045400/0x5953bbf6b3073893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b307389a expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.550615:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045400 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:0.0:1784290286.550619:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c2482045400/0x5953bbf6b3073893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b307389a expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.550636:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2482045400/0x5953bbf6b3073893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b307389a expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290286.550642:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2482045400/0x5953bbf6b3073893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b307389a expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290286.550647:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784290286.550676:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c2482045400/0x5953bbf6b3073893 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307389a expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.550681:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784290286.550698:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c2482045400/0x5953bbf6b3073893 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307389a expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290286.550704:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2482045400/0x5953bbf6b3073893 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307389a expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290286.550708:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901035136:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290286.550741:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290286.550745:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290286.550748:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290286.550766:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290286.550789:0:86789:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:86789:1870961901034880:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784290286.550807:0:86789:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784290286.550808:0:86789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784290286.550810:0:86789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784290286.550813:0:86789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784290286.550814:0:86789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784290286.550816:0:86789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784290286.550817:0:86789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784290286.550818:0:86789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784290286.550819:0:86789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784290286.550820:0:86789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:2.0:1784290286.550821:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901035136 00000100:00100000:2.0:1784290286.550826:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901035136 00000020:01000004:0.0:1784290286.550828:0:86789:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784290286.550845:0:86789:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1784290286.550859:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c234236ca00/0x5953bbf6b307389a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3073893 expref: 11 pid: 86796 timeout: 2127 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290286.550884:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2576 00000100:00100000:2.0:1784290286.550890:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:3620:x1870961901035136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290286.550898:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290286.550903:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c234236ca00/0x5953bbf6b307389a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3073893 expref: 11 pid: 86796 timeout: 2127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290286.550911:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c234236ca00/0x5953bbf6b307389a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3073893 expref: 11 pid: 86796 timeout: 2127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290286.550923:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236ca00/0x5953bbf6b307389a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3073893 expref: 11 pid: 86796 timeout: 2127 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290286.550934:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c246923e600/0x5953bbf6b30738cb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290286.550949:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246923e600/0x5953bbf6b30738cb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784290286.550960:0:6474:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000763471s 00010000:00010000:2.0:1784290286.550964:0:6474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c246923e600/0x5953bbf6b30738cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290286.550969:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c246923e600/0x5953bbf6b30738cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290286.550974:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c246923e600/0x5953bbf6b30738cb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290286.550978:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c246923e600/0x5953bbf6b30738cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290286.550983:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923e600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290286.550986:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c246923e600/0x5953bbf6b30738cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290286.550992:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c246923e600/0x5953bbf6b30738cb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290286.551007:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c246923e600/0x5953bbf6b30738cb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290286.551014:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290286.551048:0:86798:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c246923e600/0x5953bbf6b30738cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290286.551050:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:3620:x1870961901035136:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (288us total) trans 0 rc 0/0 00010000:00010000:1.0:1784290286.551082:0:86798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c246923e600/0x5953bbf6b30738cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290286.551083:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2576 00010000:00010000:1.0:1784290286.551090:0:86798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246923e600/0x5953bbf6b30738cb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290286.551136:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901035136:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1784290286.559910:0:86789:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444064 00000040:01000000:2.0:1784290286.560058:0:86789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1784290286.560061:0:86819:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444064 00000020:00080000:0.0:1784290286.560065:0:86819:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444064 00000040:01000000:2.0:1784290286.560199:0:86820:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784290286.560212:0:86789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1784290286.560504:0:86820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784290286.560714:0:86821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444059880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:86821:1870961901035264:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784290286.560747:0:86821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290286.560772:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901035264 00000100:00100000:2.0:1784290286.560775:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901035264 00000100:00100000:2.0:1784290286.560815:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3746 00000100:00100000:2.0:1784290286.560825:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:86821:x1870961901035264:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784290286.560889:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:86821:x1870961901035264:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 65us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290286.560896:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3746 00000100:00100000:2.0:1784290286.560915:0:86821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345844600 going to sleep for 11 seconds 00000100:00100000:2.0:1784290286.560934:0:86821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444059880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:86821:1870961901035264:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1784290286.560962:0:86821:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1784290286.560998:0:86821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:86821:1870961901035392:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784290286.561040:0:86821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290286.561058:0:86821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345844240 going to sleep for 11 seconds 00000040:01000000:3.0:1784290286.561062:0:86789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1784290286.561093:0:86789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784290286.561117:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901035392 00000100:00100000:1.0:1784290286.561125:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901035392 00000100:00100000:1.0:1784290286.561169:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3747 00000100:00100000:1.0:1784290286.561178:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:86821:x1870961901035392:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784290286.561337:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:86821:x1870961901035392:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 158us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290286.561392:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3747 00000100:00100000:2.0:1784290286.561393:0:86821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:86821:1870961901035392:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784290286.561456:0:86821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:86821:1870961901035520:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784290286.561482:0:86821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290286.561501:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901035520 00000100:00100000:2.0:1784290286.561503:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901035520 00000100:00100000:2.0:1784290286.561522:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3748 00000100:00100000:2.0:1784290286.561526:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:86821:x1870961901035520:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784290286.561571:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:86821:x1870961901035520:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 44us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290286.561576:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3748 00000100:00100000:2.0:1784290286.561760:0:86821:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345844600 going to sleep for 11 seconds 00000100:00100000:2.0:1784290286.561770:0:86821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:86821:1870961901035520:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1784290286.561798:0:86821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1784290286.570522:0:86789:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1784290286.570530:0:86789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1784290286.570565:0:86789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784290286.587898:0:86789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1784290286.594888:0:86820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1784290286.594960:0:86820:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1784290286.595805:0:86789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1784290286.595856:0:86789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1784290286.595947:0:86789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784290286.596263:0:86821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400090a3:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784290286.596363:0:86821:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1784290286.596370:0:86821:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:3.0:1784290286.596540:0:86789:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4b:0x0] (8/32) registered 00010000:00080000:3.0:1784290286.597647:0:86789:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 98784247812 00010000:00080000:3.0:1784290286.598284:0:86822:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 86822 00010000:02000000:3.0:1784290286.598295:0:86822:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1784290286.598298:0:86822:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1784290286.598302:0:86822:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1784290286.598554:0:86789:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784290286.598569:0:86789:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784290286.598593:0:86789:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1784290286.598607:0:86789:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1784290286.599821:0:86789:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784290286.600057:0:86789:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784290287.271801:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784290287.928522:0:87064:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:1.0:1784290288.255444:0:87116:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784290288.255587:0:87116:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784290288.295412:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784290288.487392:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784290288.487399:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9c246dce1800 from 108 10000000:01000000:2.0:1784290288.487403:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784290288.487445:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa000/0x5953bbf6b30738d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.487458:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450aa000/0x5953bbf6b30738d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.487470:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450aa000/0x5953bbf6b30738d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290288.487495:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901035648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.487573:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290288.487629:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458b93e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784290288.487660:0:86800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901035648 00000100:00100000:3.0:1784290288.487670:0:86800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901035648 00000100:00100000:3.0:1784290288.487743:0:86800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784290288.487757:0:86800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:6485:x1870961901035648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290288.487773:0:86800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290288.487791:0:86800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2482044a00/0x5953bbf6b30738d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30738d2 expref: -99 pid: 86800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.487819:0:86800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2482044a00/0x5953bbf6b30738d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30738d2 expref: 11 pid: 86800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.487832:0:86800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2482044a00/0x5953bbf6b30738d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30738d2 expref: 11 pid: 86800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.487853:0:86800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2482044a00, rc 0) 00000100:00100000:3.0:1784290288.487908:0:86800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901035648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290288.487919:0:86800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784290288.487936:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901035648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290288.487960:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450aa000/0x5953bbf6b30738d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30738d9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.487968:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450aa000/0x5953bbf6b30738d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30738d9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290288.488009:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901035776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.488043:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290288.488060:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458b93e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784290288.488095:0:86795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901035776 00000100:00100000:3.0:1784290288.488101:0:86795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901035776 00000100:00100000:3.0:1784290288.488149:0:86795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784290288.488158:0:86795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901035776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784290288.488176:0:86795:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784290288.488197:0:86795:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784290288.488201:0:86795:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 108 00000100:00100000:3.0:1784290288.488333:0:86795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901035776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 175us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290288.488361:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901035776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784290288.488378:0:86795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 10000000:01000000:2.0:1784290288.488419:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784290288.488428:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa000/0x5953bbf6b30738d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30738d9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.488438:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450aa000/0x5953bbf6b30738d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30738d9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290288.488448:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784290288.488450:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c23452c5000 from 52 10000000:01000000:2.0:1784290288.488452:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784290288.488468:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30738e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.488474:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30738e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.488479:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30738e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290288.488498:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901035904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.488525:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290288.488546:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458b93e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784290288.488558:0:86796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901035904 00000100:00100000:3.0:1784290288.488563:0:86796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901035904 00000100:00100000:3.0:1784290288.488590:0:86796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784290288.488596:0:86796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244a4b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901035904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290288.488602:0:86796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290288.488610:0:86796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2482045400/0x5953bbf6b30738e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30738e0 expref: -99 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.488623:0:86796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2482045400/0x5953bbf6b30738e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30738e0 expref: 12 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.488630:0:86796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2482045400/0x5953bbf6b30738e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30738e0 expref: 12 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.488635:0:86796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2482045400, rc 0) 00000100:00100000:3.0:1784290288.488669:0:86796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244a4b2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901035904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290288.488675:0:86796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784290288.488678:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901035904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290288.488692:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30738e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30738e7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.488699:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30738e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30738e7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290288.488751:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901036032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.488773:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290288.488789:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458b93e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784290288.488804:0:86797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901036032 00000100:00100000:3.0:1784290288.488808:0:86797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901036032 00000100:00100000:3.0:1784290288.488833:0:86797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784290288.488847:0:86797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244a4b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901036032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290288.488952:0:86797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244a4b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901036032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290288.488959:0:86797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784290288.488972:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901036032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.489003:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901036160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.489038:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290288.489052:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458b93e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784290288.489066:0:86800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901036160 00000100:00100000:3.0:1784290288.489070:0:86800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901036160 00000100:00100000:3.0:1784290288.489094:0:86800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784290288.489101:0:86800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244a4b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901036160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290288.489178:0:86800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244a4b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901036160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290288.489184:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901036160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290288.489185:0:86800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000040:00080000:2.0:1784290288.490009:0:87149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1784290288.490119:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1784290288.490143:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290288.490148:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30738e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30738e7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.490156:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30738e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30738e7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290288.490162:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784290288.490164:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9c23452c5000 from 105 10000000:01000000:3.0:1784290288.490165:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784290288.490181:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2482044200/0x5953bbf6b30738ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.490187:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2482044200/0x5953bbf6b30738ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.490193:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2482044200/0x5953bbf6b30738ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290288.490211:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901036288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290288.490246:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290288.490275:0:86795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901036288 00000100:00100000:2.0:1784290288.490282:0:86795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901036288 00000100:00100000:3.0:1784290288.490289:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2461e97780 going to sleep for 11 seconds 00000100:00100000:2.0:1784290288.490336:0:86795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784290288.490373:0:86795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247b253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901036288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290288.490382:0:86795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290288.490397:0:86795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c23450abe00/0x5953bbf6b30738f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30738ee expref: -99 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.490421:0:86795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c23450abe00/0x5953bbf6b30738f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30738ee expref: 13 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.490432:0:86795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c23450abe00/0x5953bbf6b30738f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30738ee expref: 13 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.490440:0:86795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450abe00, rc 0) 00000100:00100000:2.0:1784290288.490484:0:86795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247b253850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901036288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290288.490493:0:86795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784290288.490521:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901036288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290288.490536:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2482044200/0x5953bbf6b30738ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30738f5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.490547:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2482044200/0x5953bbf6b30738ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30738f5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290288.490599:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901036416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784290288.490643:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290288.490670:0:86796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901036416 00000100:00100000:2.0:1784290288.490676:0:86796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901036416 00000100:00100000:1.0:1784290288.490678:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2449fb5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784290288.490705:0:86796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784290288.490714:0:86796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901036416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784290288.490725:0:86796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784290288.490738:0:86796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784290288.490742:0:86796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1784290288.490745:0:86796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1784290288.490748:0:86796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1784290288.490751:0:86796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 108 00000100:00100000:2.0:1784290288.490834:0:86796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901036416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290288.490844:0:86796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784290288.490854:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901036416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784290288.490934:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784290288.490941:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2482044200/0x5953bbf6b30738ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30738f5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.490950:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2482044200/0x5953bbf6b30738ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30738f5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290288.490966:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1784290288.490969:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1784290288.490972:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1784290288.490991:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236de00/0x5953bbf6b30738fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.491000:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c234236de00/0x5953bbf6b30738fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.491010:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c234236de00/0x5953bbf6b30738fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290288.491025:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901036544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290288.491059:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290288.491083:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341e0f600 going to sleep for 11 seconds 00000100:00100000:2.0:1784290288.491098:0:86797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901036544 00000100:00100000:2.0:1784290288.491103:0:86797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901036544 00000100:00100000:2.0:1784290288.491134:0:86797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784290288.491154:0:86797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901036544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290288.491166:0:86797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290288.491176:0:86797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c23450aa800/0x5953bbf6b3073903 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30738fc expref: -99 pid: 86797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.491191:0:86797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c23450aa800/0x5953bbf6b3073903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30738fc expref: 14 pid: 86797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.491217:0:86797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c23450aa800/0x5953bbf6b3073903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30738fc expref: 14 pid: 86797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.491225:0:86797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aa800, rc 0) 00000100:00100000:2.0:1784290288.491263:0:86797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901036544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290288.491272:0:86797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784290288.491285:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901036544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290288.491313:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c234236de00/0x5953bbf6b30738fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073903 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.491320:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c234236de00/0x5953bbf6b30738fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073903 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290288.491385:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901036672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290288.491418:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290288.491445:0:86800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901036672 00000100:00100000:2.0:1784290288.491451:0:86800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901036672 00000100:00100000:1.0:1784290288.491454:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341e0f600 going to sleep for 11 seconds 00000100:00100000:2.0:1784290288.491485:0:86800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784290288.491494:0:86800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901036672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.491612:0:86800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901036672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290288.491621:0:86800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784290288.491633:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901036672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290288.491667:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901036800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290288.491719:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290288.491758:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341e0f600 going to sleep for 11 seconds 00000100:00100000:2.0:1784290288.491773:0:86795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901036800 00000100:00100000:2.0:1784290288.491778:0:86795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901036800 00000100:00100000:2.0:1784290288.491806:0:86795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784290288.491814:0:86795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901036800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.492475:0:86795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901036800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 660us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290288.492489:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901036800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.492503:0:86795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000040:00080000:2.0:1784290288.493236:0:87152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1784290288.493322:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1784290288.493374:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1784290288.493382:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236de00/0x5953bbf6b30738fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073903 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.493392:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c234236de00/0x5953bbf6b30738fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073903 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290288.493401:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1784290288.493404:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9c23452c5000 from 1 10000000:01000000:1.0:1784290288.493407:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784290288.493426:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b307390a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.493435:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b307390a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.493444:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b307390a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290288.493460:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901036928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290288.493492:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290288.493535:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2449fb5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784290288.493538:0:86796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901036928 00000100:00100000:2.0:1784290288.493550:0:86796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901036928 00000100:00100000:2.0:1784290288.493589:0:86796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784290288.493600:0:86796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901036928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290288.493609:0:86796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290288.493619:0:86796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c23450aa600/0x5953bbf6b3073911 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307390a expref: -99 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.493637:0:86796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c23450aa600/0x5953bbf6b3073911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307390a expref: 15 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.493648:0:86796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c23450aa600/0x5953bbf6b3073911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307390a expref: 15 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.493657:0:86796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aa600, rc 0) 00000100:00100000:2.0:1784290288.493697:0:86796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:6485:x1870961901036928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290288.493704:0:86796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784290288.493710:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901036928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290288.493725:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b307390a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073911 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.493742:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b307390a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073911 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290288.493758:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784290288.493764:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b307390a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073911 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.493773:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b307390a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073911 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290288.493781:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784290288.493783:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c23452c5000 from 7 10000000:01000000:1.0:1784290288.493786:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784290288.493813:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236c400/0x5953bbf6b3073918 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.493822:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c234236c400/0x5953bbf6b3073918 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.493831:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c234236c400/0x5953bbf6b3073918 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290288.493846:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901037056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290288.493874:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290288.493895:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2449fb5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784290288.493901:0:86797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901037056 00000100:00100000:2.0:1784290288.493907:0:86797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901037056 00000100:00100000:2.0:1784290288.493937:0:86797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784290288.493948:0:86797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:6485:x1870961901037056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290288.493956:0:86797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290288.493965:0:86797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c23450ab000/0x5953bbf6b307391f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073918 expref: -99 pid: 86797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.493993:0:86797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c23450ab000/0x5953bbf6b307391f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073918 expref: 16 pid: 86797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.494002:0:86797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c23450ab000/0x5953bbf6b307391f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073918 expref: 16 pid: 86797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.494010:0:86797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450ab000, rc 0) 00000100:00100000:2.0:1784290288.494050:0:86797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901037056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290288.494058:0:86797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784290288.494063:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901037056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290288.494079:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c234236c400/0x5953bbf6b3073918 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307391f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.494103:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c234236c400/0x5953bbf6b3073918 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307391f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290288.494148:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901037184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290288.494183:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290288.494206:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2449fb5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784290288.494210:0:86800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901037184 00000100:00100000:2.0:1784290288.494216:0:86800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901037184 00000100:00100000:2.0:1784290288.494250:0:86800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784290288.494258:0:86800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901037184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.494373:0:86800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901037184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290288.494385:0:86800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784290288.494385:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901037184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290288.494425:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901037312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290288.494473:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290288.494503:0:86795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901037312 00000100:00100000:2.0:1784290288.494508:0:86795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901037312 00000100:00100000:1.0:1784290288.494522:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2449fb5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784290288.494543:0:86795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784290288.494556:0:86795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901037312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.494638:0:86795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901037312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290288.494646:0:86795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784290288.494652:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901037312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784290288.495248:0:87153:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784290288.495325:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784290288.495367:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784290288.495375:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236c400/0x5953bbf6b3073918 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307391f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.495385:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c234236c400/0x5953bbf6b3073918 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307391f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290288.495394:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784290288.495396:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c246ff27800 from 52 10000000:01000000:1.0:1784290288.495399:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784290288.495415:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236ce00/0x5953bbf6b3073926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.495423:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c234236ce00/0x5953bbf6b3073926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.495444:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c234236ce00/0x5953bbf6b3073926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290288.495459:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901037440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290288.495486:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290288.495514:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2447eed000 going to sleep for 11 seconds 00000100:00100000:2.0:1784290288.495526:0:86796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901037440 00000100:00100000:2.0:1784290288.495532:0:86796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901037440 00000100:00100000:2.0:1784290288.495568:0:86796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784290288.495578:0:86796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234680b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901037440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290288.495587:0:86796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290288.495596:0:86796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c23450aba00/0x5953bbf6b307392d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073926 expref: -99 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.495612:0:86796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c23450aba00/0x5953bbf6b307392d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073926 expref: 17 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.495621:0:86796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c23450aba00/0x5953bbf6b307392d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073926 expref: 17 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.495640:0:86796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aba00, rc 0) 00000100:00100000:2.0:1784290288.495676:0:86796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234680b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901037440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290288.495684:0:86796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784290288.495710:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901037440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290288.495726:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c234236ce00/0x5953bbf6b3073926 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307392d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.495735:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c234236ce00/0x5953bbf6b3073926 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307392d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290288.495777:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901037568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290288.495815:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290288.495834:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2447eed000 going to sleep for 11 seconds 00000100:00100000:3.0:1784290288.495880:0:86797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901037568 00000100:00100000:3.0:1784290288.495886:0:86797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901037568 00000100:00100000:3.0:1784290288.495915:0:86797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784290288.495921:0:86797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234680ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901037568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290288.495992:0:86797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234680ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901037568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290288.495998:0:86797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784290288.496022:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901037568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290288.496053:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901037696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290288.496106:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290288.496136:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2447eed000 going to sleep for 11 seconds 00000100:00100000:2.0:1784290288.496139:0:86800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901037696 00000100:00100000:2.0:1784290288.496145:0:86800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901037696 00000100:00100000:2.0:1784290288.496177:0:86800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784290288.496186:0:86800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fec4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901037696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.496267:0:86800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fec4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901037696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290288.496276:0:86800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784290288.496311:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901037696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784290288.496935:0:87155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1784290288.496986:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1784290288.497008:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784290288.497013:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236ce00/0x5953bbf6b3073926 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307392d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.497029:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c234236ce00/0x5953bbf6b3073926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307392d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290288.497034:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1784290288.497036:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1784290288.497038:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1784290288.497050:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450ab200/0x5953bbf6b3073934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.497055:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450ab200/0x5953bbf6b3073934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.497061:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450ab200/0x5953bbf6b3073934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290288.497071:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901037824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.497095:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290288.497121:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b2356c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290288.497129:0:86795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901037824 00000100:00100000:3.0:1784290288.497134:0:86795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901037824 00000100:00100000:3.0:1784290288.497160:0:86795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784290288.497168:0:86795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fec6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901037824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290288.497174:0:86795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290288.497182:0:86795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2482045000/0x5953bbf6b307393b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073934 expref: -99 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.497196:0:86795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2482045000/0x5953bbf6b307393b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073934 expref: 18 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.497212:0:86795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2482045000/0x5953bbf6b307393b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073934 expref: 18 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.497217:0:86795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2482045000, rc 0) 00000100:00100000:3.0:1784290288.497268:0:86795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fec6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901037824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290288.497272:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901037824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290288.497284:0:86795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1784290288.497287:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450ab200/0x5953bbf6b3073934 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307393b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.497318:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450ab200/0x5953bbf6b3073934 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307393b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290288.497439:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901037952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.497460:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290288.497492:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b2356c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290288.497500:0:86796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901037952 00000100:00100000:0.0:1784290288.497505:0:86796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901037952 00000100:00100000:0.0:1784290288.497535:0:86796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784290288.497544:0:86796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fec4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901037952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290288.497647:0:86796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fec4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901037952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290288.497653:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901037952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290288.497655:0:86796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784290288.497678:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901038080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.497726:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290288.497740:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b2356c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290288.497796:0:86797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901038080 00000100:00100000:3.0:1784290288.497802:0:86797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901038080 00000100:00100000:3.0:1784290288.497832:0:86797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784290288.497839:0:86797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fec4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901038080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290288.498394:0:86797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fec4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901038080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 554us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290288.498402:0:86797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784290288.498430:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901038080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784290288.498953:0:87156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1784290288.499010:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1784290288.499025:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1784290288.499030:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450ab200/0x5953bbf6b3073934 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307393b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.499037:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450ab200/0x5953bbf6b3073934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307393b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290288.499042:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784290288.499044:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c246ff27800 from 7 10000000:01000000:3.0:1784290288.499045:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784290288.499058:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2482045800/0x5953bbf6b3073942 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.499071:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2482045800/0x5953bbf6b3073942 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.499076:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2482045800/0x5953bbf6b3073942 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290288.499086:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901038208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290288.499108:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290288.499130:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2449ba0240 going to sleep for 11 seconds 00000100:00100000:2.0:1784290288.499139:0:86800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901038208 00000100:00100000:2.0:1784290288.499143:0:86800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901038208 00000100:00100000:2.0:1784290288.499174:0:86800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784290288.499184:0:86800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901038208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290288.499192:0:86800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290288.499202:0:86800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c23450ab600/0x5953bbf6b3073949 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073942 expref: -99 pid: 86800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.499219:0:86800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c23450ab600/0x5953bbf6b3073949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073942 expref: 19 pid: 86800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.499226:0:86800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c23450ab600/0x5953bbf6b3073949 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073942 expref: 19 pid: 86800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.499231:0:86800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450ab600, rc 0) 00000100:00100000:2.0:1784290288.499261:0:86800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344607c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901038208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290288.499266:0:86800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784290288.499306:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901038208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290288.499318:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2482045800/0x5953bbf6b3073942 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073949 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.499323:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2482045800/0x5953bbf6b3073942 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073949 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290288.499576:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901038336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290288.499603:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290288.499626:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2449ba0240 going to sleep for 11 seconds 00000100:00100000:2.0:1784290288.499637:0:86795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901038336 00000100:00100000:2.0:1784290288.499644:0:86795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901038336 00000100:00100000:2.0:1784290288.499681:0:86795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784290288.499690:0:86795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23441c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901038336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.499775:0:86795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23441c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901038336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290288.499788:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901038336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.499796:0:86795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784290288.499814:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901038464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290288.499846:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290288.499861:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2449ba0240 going to sleep for 11 seconds 00000100:00100000:1.0:1784290288.499874:0:86796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901038464 00000100:00100000:1.0:1784290288.499880:0:86796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901038464 00000100:00100000:1.0:1784290288.499916:0:86796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784290288.499927:0:86796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23441c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901038464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290288.500019:0:86796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23441c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901038464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290288.500027:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901038464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290288.500045:0:86796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000040:00080000:1.0:1784290288.500864:0:87158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784290288.500928:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784290288.500947:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784290288.500951:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2482045800/0x5953bbf6b3073942 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073949 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.500958:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2482045800/0x5953bbf6b3073942 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073949 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290288.500963:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784290288.500965:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c247d3d2000 from 52 10000000:01000000:3.0:1784290288.500966:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784290288.500979:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2469a7dc00/0x5953bbf6b3073950 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.500984:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2469a7dc00/0x5953bbf6b3073950 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.500989:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2469a7dc00/0x5953bbf6b3073950 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290288.500998:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901038592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290288.501020:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290288.501045:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2449ba0240 going to sleep for 11 seconds 00000100:00100000:0.0:1784290288.501064:0:86797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901038592 00000100:00100000:0.0:1784290288.501070:0:86797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901038592 00000100:00100000:0.0:1784290288.501103:0:86797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784290288.501113:0:86797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2480355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901038592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290288.501120:0:86797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290288.501129:0:86797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246923f600/0x5953bbf6b3073957 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073950 expref: -99 pid: 86797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290288.501157:0:86797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246923f600/0x5953bbf6b3073957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073950 expref: 20 pid: 86797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290288.501167:0:86797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246923f600/0x5953bbf6b3073957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073950 expref: 20 pid: 86797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290288.501175:0:86797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246923f600, rc 0) 00000100:00100000:0.0:1784290288.501221:0:86797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2480355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901038592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290288.501224:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901038592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784290288.501238:0:86797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1784290288.501243:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2469a7dc00/0x5953bbf6b3073950 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073957 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.501254:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2469a7dc00/0x5953bbf6b3073950 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073957 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290288.501336:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901038720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290288.501397:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290288.501426:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2449ba0240 going to sleep for 11 seconds 00000100:00100000:1.0:1784290288.501466:0:86800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901038720 00000100:00100000:1.0:1784290288.501471:0:86800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901038720 00000100:00100000:1.0:1784290288.501501:0:86800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784290288.501507:0:86800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2480355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901038720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290288.501589:0:86800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2480355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901038720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290288.501595:0:86800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784290288.501614:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901038720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290288.501644:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901038848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290288.501674:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290288.501691:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2449ba0240 going to sleep for 11 seconds 00000100:00100000:0.0:1784290288.501746:0:86795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901038848 00000100:00100000:0.0:1784290288.501753:0:86795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901038848 00000100:00100000:0.0:1784290288.501786:0:86795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784290288.501795:0:86795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2480354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901038848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290288.501885:0:86795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2480354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901038848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290288.501888:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901038848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290288.501902:0:86795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000040:00080000:0.0:1784290288.502747:0:87159:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1784290288.502815:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1784290288.502830:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290288.502834:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2469a7dc00/0x5953bbf6b3073950 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073957 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.502840:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2469a7dc00/0x5953bbf6b3073950 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073957 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290288.502846:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1784290288.502847:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1784290288.502849:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784290288.502861:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2469a7d400/0x5953bbf6b307395e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.502866:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2469a7d400/0x5953bbf6b307395e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.502871:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2469a7d400/0x5953bbf6b307395e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290288.502879:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901038976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290288.502910:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290288.502929:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2449ba0240 going to sleep for 11 seconds 00000100:00100000:0.0:1784290288.502947:0:86796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901038976 00000100:00100000:0.0:1784290288.502953:0:86796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901038976 00000100:00100000:0.0:1784290288.502984:0:86796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784290288.502992:0:86796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c248207f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901038976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290288.503000:0:86796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290288.503009:0:86796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246923e000/0x5953bbf6b3073965 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307395e expref: -99 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290288.503025:0:86796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246923e000/0x5953bbf6b3073965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307395e expref: 21 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290288.503042:0:86796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246923e000/0x5953bbf6b3073965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307395e expref: 21 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290288.503050:0:86796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246923e000, rc 0) 00000100:00100000:0.0:1784290288.503090:0:86796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c248207f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901038976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290288.503099:0:86796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784290288.503107:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901038976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290288.503117:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2469a7d400/0x5953bbf6b307395e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073965 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.503123:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2469a7d400/0x5953bbf6b307395e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073965 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290288.503149:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901039104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290288.503167:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290288.503180:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2449ba0240 going to sleep for 11 seconds 00000100:00100000:0.0:1784290288.503191:0:86797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901039104 00000100:00100000:0.0:1784290288.503197:0:86797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901039104 00000100:00100000:0.0:1784290288.503228:0:86797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784290288.503237:0:86797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2341714c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901039104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290288.503336:0:86797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2341714c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901039104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290288.503369:0:86797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784290288.503415:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901039104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290288.503502:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901039232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290288.503534:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290288.503555:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2449ba0240 going to sleep for 11 seconds 00000100:00100000:1.0:1784290288.503570:0:86800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901039232 00000100:00100000:1.0:1784290288.503576:0:86800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901039232 00000100:00100000:1.0:1784290288.503610:0:86800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784290288.503621:0:86800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2341714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901039232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290288.504285:0:86800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2341714850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901039232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 666us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290288.504309:0:86800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784290288.504315:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901039232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784290288.505135:0:87161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1784290288.505190:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1784290288.505211:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1784290288.505217:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2469a7d400/0x5953bbf6b307395e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073965 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.505224:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2469a7d400/0x5953bbf6b307395e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073965 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290288.505230:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784290288.505232:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c247d3d2000 from 7 10000000:01000000:2.0:1784290288.505233:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784290288.505245:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aac00/0x5953bbf6b307396c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.505250:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450aac00/0x5953bbf6b307396c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.505267:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450aac00/0x5953bbf6b307396c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290288.505276:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901039360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.505321:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290288.505435:0:86795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901039360 00000100:00100000:1.0:1784290288.505440:0:86795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901039360 00000100:00100000:1.0:1784290288.505479:0:86795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784290288.505489:0:86795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2341715850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901039360:12345-0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.505493:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b2356c0 going to sleep for 11 seconds 00010000:00010000:1.0:1784290288.505498:0:86795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290288.505510:0:86795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236d600/0x5953bbf6b3073973 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307396c expref: -99 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.505526:0:86795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236d600/0x5953bbf6b3073973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307396c expref: 22 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.505554:0:86795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236d600/0x5953bbf6b3073973 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307396c expref: 22 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.505561:0:86795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236d600, rc 0) 00000100:00100000:1.0:1784290288.505600:0:86795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2341715850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901039360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290288.505608:0:86795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784290288.505618:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901039360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290288.505630:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450aac00/0x5953bbf6b307396c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073973 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290288.505636:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450aac00/0x5953bbf6b307396c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073973 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290288.505672:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901039488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.505695:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290288.505713:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b2356c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290288.505729:0:86796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901039488 00000100:00100000:0.0:1784290288.505733:0:86796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901039488 00000100:00100000:0.0:1784290288.505762:0:86796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784290288.505771:0:86796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24691fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901039488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290288.505854:0:86796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24691fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901039488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290288.505862:0:86796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784290288.505875:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901039488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.505900:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901039616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290288.505940:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290288.505962:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b2356c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290288.505973:0:86797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901039616 00000100:00100000:0.0:1784290288.505977:0:86797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901039616 00000100:00100000:0.0:1784290288.506010:0:86797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784290288.506018:0:86797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901039616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290288.506099:0:86797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ddec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901039616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290288.506111:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901039616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290288.506113:0:86797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000040:00080000:0.0:1784290288.506924:0:87163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784290288.506982:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784290288.507003:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784290288.507010:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aac00/0x5953bbf6b307396c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073973 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.507020:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450aac00/0x5953bbf6b307396c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073973 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290288.507029:0:6485:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784290288.507032:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9c2480260000 from 1 10000000:01000000:1.0:1784290288.507034:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784290288.507053:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b307397a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.507062:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b307397a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.507071:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b307397a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290288.507087:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901039744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290288.507129:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290288.507159:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341700780 going to sleep for 11 seconds 00000100:00100000:0.0:1784290288.507172:0:86800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901039744 00000100:00100000:0.0:1784290288.507178:0:86800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901039744 00000100:00100000:0.0:1784290288.507211:0:86800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784290288.507221:0:86800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901039744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290288.507229:0:86800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290288.507240:0:86800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246923fe00/0x5953bbf6b3073981 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307397a expref: -99 pid: 86800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290288.507256:0:86800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246923fe00/0x5953bbf6b3073981 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307397a expref: 23 pid: 86800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290288.507264:0:86800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246923fe00/0x5953bbf6b3073981 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307397a expref: 23 pid: 86800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290288.507272:0:86800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246923fe00, rc 0) 00000100:00100000:0.0:1784290288.507324:0:86800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901039744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290288.507352:0:86800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784290288.507382:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901039744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290288.507400:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b307397a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073981 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.507409:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b307397a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073981 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290288.507427:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784290288.507432:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b307397a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073981 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.507439:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b307397a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073981 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290288.507445:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784290288.507447:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9c2480260000 from 1 10000000:01000000:1.0:1784290288.507449:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784290288.507463:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236da00/0x5953bbf6b3073988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.507470:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c234236da00/0x5953bbf6b3073988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.507476:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c234236da00/0x5953bbf6b3073988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290288.507487:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901039872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290288.507527:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290288.507558:0:86795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901039872 00000100:00100000:1.0:1784290288.507564:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341700780 going to sleep for 11 seconds 00000100:00100000:3.0:1784290288.507566:0:86795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901039872 00000100:00100000:3.0:1784290288.507624:0:86795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784290288.507631:0:86795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901039872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290288.507641:0:86795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290288.507652:0:86795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2469a7ce00/0x5953bbf6b307398f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073988 expref: -99 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.507670:0:86795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2469a7ce00/0x5953bbf6b307398f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073988 expref: 24 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.507715:0:86795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2469a7ce00/0x5953bbf6b307398f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073988 expref: 24 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290288.507720:0:86795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2469a7ce00, rc 0) 00000100:00100000:3.0:1784290288.507768:0:86795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901039872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290288.507773:0:86795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784290288.507795:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901039872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290288.507808:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c234236da00/0x5953bbf6b3073988 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307398f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.507814:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c234236da00/0x5953bbf6b3073988 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307398f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290288.507855:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901040000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290288.507885:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290288.507908:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341700780 going to sleep for 11 seconds 00000100:00100000:0.0:1784290288.507925:0:86796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901040000 00000100:00100000:0.0:1784290288.507931:0:86796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901040000 00000100:00100000:0.0:1784290288.507961:0:86796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784290288.507971:0:86796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901040000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290288.508031:0:86796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901040000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 61us (143us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784290288.508039:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901040000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290288.508042:0:86796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 10000000:01000000:1.0:1784290288.508069:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784290288.508076:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236da00/0x5953bbf6b3073988 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307398f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290288.508084:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c234236da00/0x5953bbf6b3073988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307398f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1784290288.532773:0:87175:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784290288.532930:0:87175:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1784290288.807548:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901040256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290288.807561:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901040128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784290288.807622:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290288.807666:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290288.807685:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901040256 00000100:00100000:0.0:1784290288.807697:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901040256 00000100:00100000:3.0:1784290288.807735:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901040128 00000100:00100000:3.0:1784290288.807744:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901040128 00000100:00080000:2.0:1784290288.807755:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784290288.807761:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290288.807773:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:0.0:1784290288.807787:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901040256:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784290288.807805:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00002000:00000024:0.0:1784290288.807818:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290288.807820:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901040128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784290288.807843:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290288.807877:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901040256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290288.807885:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:2.0:1784290288.807913:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901040256:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784290288.807920:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901040128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290288.807934:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:1.0:1784290288.807969:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901040128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784290289.157928:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290289.158030:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290289.158048:0:86797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896210304 00000100:00100000:0.0:1784290289.158065:0:86797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896210304 00000100:00100000:2.0:1784290289.158089:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290289.158143:0:86797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:0.0:1784290289.158160:0:86797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2398:x1870961896210304:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290289.158173:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000020:00080000:0.0:1784290289.158181:0:86797:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.6@tcp 00000100:00100000:1.0:1784290289.158223:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896210560 00000100:00100000:3.0:1784290289.158231:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896210432 00000100:00100000:1.0:1784290289.158237:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896210560 00000100:00100000:3.0:1784290289.158245:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896210432 00000100:00100000:0.0:1784290289.158278:0:86797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2398:x1870961896210304:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 119us (364us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784290289.158312:0:86797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:2.0:1784290289.158330:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290289.158397:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 633 00000100:00100000:1.0:1784290289.158421:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1039 00000100:00100000:3.0:1784290289.158423:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896210560:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290289.158451:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1870961896210432:12345-192.168.202.6@tcp:38:kworker.0 00000100:00100000:0.0:1784290289.158477:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896210688 00000100:00100000:0.0:1784290289.158486:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896210688 00010000:00080000:1.0:1784290289.158492:0:65990:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'bd808cf4-dd54-45f0-9b2b-1434e8330e5d' at ffff9c246ff64800, cookie 0x5953bbf6b307381c 00010000:00080000:1.0:1784290289.158505:0:65990:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp recovering/t98784247813 exp ffff9c246ff64800 cur 2030 last 1784290286 00010000:02000400:1.0:1784290289.158522:0:65990:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1784290289.158536:0:65990:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000100:00080000:2.0:1784290289.158548:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784290289.158549:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896210816 00000100:00100000:0.0:1784290289.158559:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896210816 00000100:00080000:2.0:1784290289.158564:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00100000:1.0:1784290289.158574:0:65990:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784290289.158576:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290289.158604:0:26262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4914 00000100:00100000:0.0:1784290289.158623:0:26262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2396:x1870961896210688:12345-192.168.202.6@tcp:9:kworker.0 00000100:00100000:2.0:1784290289.158641:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4915 00000020:00000080:0.0:1784290289.158658:0:26262:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307348e 00000100:00100000:3.0:1784290289.158662:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896210560:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 244us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290289.158669:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2396:x1870961896210816:12345-192.168.202.6@tcp:9:kworker.0 00000100:00080000:0.0:1784290289.158677:0:26262:0:(import.c:65:import_set_state_nolock()) ffff9c247e4b2800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1784290289.158702:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 633 00000020:00000080:2.0:1784290289.158717:0:26253:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073495 00000100:00080000:2.0:1784290289.158735:0:26253:0:(import.c:65:import_set_state_nolock()) ffff9c247e4b6800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784290289.158758:0:26262:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968625 00000001:00000004:2.0:1784290289.158817:0:26253:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968625 00000100:00080000:1.0:1784290289.158900:0:65990:0:(import.c:65:import_set_state_nolock()) ffff9c247f8f3800 : changing import state from RECOVER to FULL 00010000:00010000:3.0:1784290289.158944:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290289.158982:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896210432:12345-192.168.202.6@tcp:38:kworker.0 Request processed in 531us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290289.158997:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1039 00000100:00100000:0.0:1784290289.159009:0:26262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+2:2396:x1870961896210688:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 387us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290289.159028:0:26262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4914 00010000:00010000:1.0:1784290289.159035:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290289.159059:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+2:2396:x1870961896210816:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 398us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290289.159074:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4915 00000100:00100000:2.0:1784290289.160218:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290289.160378:0:86800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896210944 00000100:00100000:1.0:1784290289.160389:0:86800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896210944 00000100:00100000:1.0:1784290289.160438:0:86800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:1.0:1784290289.160447:0:86800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0+-99:2396:x1870961896210944:12345-192.168.202.6@tcp:250:ptlrpcd_00_01.0 00010000:00080000:1.0:1784290289.160473:0:86800:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from bdffa268-fb6a-4248-991c-0ad16fac303f@192.168.202.6@tcp t0 exp 0000000000000000 cur 2030 last 0 00000020:00000080:1.0:1784290289.160509:0:86800:0:(genops.c:1406:class_connect()) connect: client bdffa268-fb6a-4248-991c-0ad16fac303f, cookie 0x5953bbf6b3073996 00000100:00080000:1.0:1784290289.160666:0:86800:0:(import.c:65:import_set_state_nolock()) ffff9c247f8f1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784290289.160731:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290289.160754:0:86800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdffa268-fb6a-4248-991c-0ad16fac303f+5:2396:x1870961896210944:12345-192.168.202.6@tcp:250:ptlrpcd_00_01.0 Request processed in 299us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290289.160774:0:86800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:0.0:1784290289.160832:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896206336 00000100:00100000:0.0:1784290289.160843:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896206336 00000100:00100000:0.0:1784290289.160905:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1040 00000100:00100000:0.0:1784290289.160924:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896206336:12345-192.168.202.6@tcp:36:mcreate.0 00010000:00080000:0.0:1784290289.160950:0:65988:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247813, current: 98784247813, replaying 00000100:00100000:0.0:1784290289.160990:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896206336:12345-192.168.202.6@tcp:36:mcreate.0 Request processed in 71us (264us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784290289.161005:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1040 00010000:00080000:1.0:1784290289.161030:0:86822:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:0.0:1784290289.319528:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290290.343559:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290290.821793:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290290.821880:0:86795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896211200 00000100:00100000:3.0:1784290290.821894:0:86795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896211200 00000100:00100000:3.0:1784290290.821981:0:86795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:3.0:1784290290.821993:0:86795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdffa268-fb6a-4248-991c-0ad16fac303f+5:42227:x1870961896211200:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290290.822013:0:86795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290290.822032:0:86795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2469a7ca00/0x5953bbf6b307399d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b223a expref: -99 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290290.822066:0:86795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2469a7ca00/0x5953bbf6b307399d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b223a expref: 6 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290290.822080:0:86795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2469a7ca00/0x5953bbf6b307399d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b223a expref: 6 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290290.822091:0:86795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2469a7ca00, rc 0) 00000100:00100000:3.0:1784290290.822178:0:86795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdffa268-fb6a-4248-991c-0ad16fac303f+6:42227:x1870961896211200:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 185us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290290.822193:0:86795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:2.0:1784290290.823638:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290290.823718:0:86796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896211328 00000100:00100000:0.0:1784290290.823727:0:86796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896211328 00000100:00100000:0.0:1784290290.823778:0:86796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:0.0:1784290290.823788:0:86796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+6:42227:x1870961896211328:12345-192.168.202.6@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784290290.823808:0:86796:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1784290290.823831:0:86796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784290290.823836:0:86796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1784290290.823840:0:86796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1784290290.823843:0:86796:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1784290290.823847:0:86796:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 108 00000100:00100000:1.0:1784290290.825049:0:86796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+6:42227:x1870961896211328:12345-192.168.202.6@tcp:256:ll_cfg_requeue.0 Request processed in 1257us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290290.825064:0:86796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:2.0:1784290290.826378:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290290.826463:0:86797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896211456 00000100:00100000:0.0:1784290290.826473:0:86797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896211456 00000100:00100000:0.0:1784290290.826530:0:86797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:0.0:1784290290.826543:0:86797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+6:42227:x1870961896211456:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290290.826558:0:86797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290290.826574:0:86797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246923f800/0x5953bbf6b30739a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2241 expref: -99 pid: 86797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290290.826603:0:86797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246923f800/0x5953bbf6b30739a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2241 expref: 7 pid: 86797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290290.826632:0:86797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246923f800/0x5953bbf6b30739a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2241 expref: 7 pid: 86797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290290.826644:0:86797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246923f800, rc 0) 00000100:00100000:0.0:1784290290.826698:0:86797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+7:42227:x1870961896211456:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 157us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290290.826710:0:86797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:2.0:1784290290.827945:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290290.828020:0:86800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896211584 00000100:00100000:1.0:1784290290.828027:0:86800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896211584 00000100:00100000:1.0:1784290290.828070:0:86800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:1.0:1784290290.828078:0:86800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdffa268-fb6a-4248-991c-0ad16fac303f+7:42227:x1870961896211584:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290290.828226:0:86800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdffa268-fb6a-4248-991c-0ad16fac303f+8:42227:x1870961896211584:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 147us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290290.828235:0:86800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:3.0:1784290290.829223:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290290.829304:0:86795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896211712 00000100:00100000:1.0:1784290290.829311:0:86795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896211712 00000100:00100000:1.0:1784290290.829387:0:86795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:1.0:1784290290.829397:0:86795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdffa268-fb6a-4248-991c-0ad16fac303f+8:42227:x1870961896211712:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290290.829488:0:86795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdffa268-fb6a-4248-991c-0ad16fac303f+8:42227:x1870961896211712:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 92us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290290.829496:0:86795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:2.0:1784290290.831732:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290290.831800:0:86796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896211840 00000100:00100000:0.0:1784290290.831806:0:86796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896211840 00000100:00100000:0.0:1784290290.831848:0:86796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:0.0:1784290290.831860:0:86796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24425c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+8:42227:x1870961896211840:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290290.831872:0:86796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290290.831887:0:86796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246923f200/0x5953bbf6b30739ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2248 expref: -99 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290290.831913:0:86796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246923f200/0x5953bbf6b30739ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2248 expref: 9 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290290.831928:0:86796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246923f200/0x5953bbf6b30739ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2248 expref: 9 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290290.831936:0:86796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246923f200, rc 0) 00000100:00100000:0.0:1784290290.831972:0:86796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24425c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896211840:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 115us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290290.831980:0:86796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:2.0:1784290290.832903:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290290.832963:0:86797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896211968 00000100:00100000:0.0:1784290290.832976:0:86797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896211968 00000100:00100000:0.0:1784290290.833013:0:86797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:0.0:1784290290.833024:0:86797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e4d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896211968:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290290.833119:0:86797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e4d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896211968:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 97us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290290.833137:0:86797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:3.0:1784290290.834095:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290290.834199:0:86800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896212096 00000100:00100000:1.0:1784290290.834208:0:86800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896212096 00000100:00100000:1.0:1784290290.834255:0:86800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:1.0:1784290290.834267:0:86800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e4d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896212096:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290290.834411:0:86800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e4d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896212096:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 146us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290290.834419:0:86800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:2.0:1784290290.836490:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290290.836574:0:86795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896212224 00000100:00100000:1.0:1784290290.836580:0:86795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896212224 00000100:00100000:1.0:1784290290.836618:0:86795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:1.0:1784290290.836630:0:86795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896212224:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290290.836655:0:86795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290290.836669:0:86795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236d000/0x5953bbf6b30739b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b224f expref: -99 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290290.836694:0:86795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236d000/0x5953bbf6b30739b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b224f expref: 10 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290290.836708:0:86795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236d000/0x5953bbf6b30739b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b224f expref: 10 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290290.836719:0:86795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236d000, rc 0) 00000100:00100000:1.0:1784290290.836767:0:86795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdffa268-fb6a-4248-991c-0ad16fac303f+10:42227:x1870961896212224:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 138us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290290.836776:0:86795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:2.0:1784290290.837670:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290290.837745:0:86796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896212352 00000100:00100000:0.0:1784290290.837754:0:86796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896212352 00000100:00100000:0.0:1784290290.837808:0:86796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:0.0:1784290290.837819:0:86796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e4d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+10:42227:x1870961896212352:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290290.837899:0:86796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e4d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+10:42227:x1870961896212352:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 81us (231us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784290290.837909:0:86796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 71 00010000:00010000:3.0:1784290291.367451:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784290291.879483:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290291.879492:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290291.879496:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290291.879511:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290291.879513:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901040384:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784290291.879537:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2474cbce00 x1870961901040640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784290291.879582:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290291.879587:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290291.879591:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784290291.879591:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901040640:0@lo:38:kworker.0 00000100:00080000:1.0:1784290291.879602:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290291.879620:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2468538a80 x1870961901040896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290291.879623:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246853ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1870961901040768:0@lo:400:kworker.0 00000100:00100000:3.0:1784290291.879638:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290291.879644:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290291.879683:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901040512:0@lo:400:kworker.0 00000100:00100000:2.0:1784290291.879688:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290291.879690:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901040896:0@lo:38:kworker.0 00000100:00080000:1.0:1784290291.879692:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290291.879699:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290291.879702:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290291.879710:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290291.879732:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2468538000 x1870961901041152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290291.879736:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290291.879738:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290291.879742:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901040384 00000100:00100000:2.0:1784290291.879752:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901040384 00000100:00100000:0.0:1784290291.879766:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901041152:0@lo:38:kworker.0 00000100:00080000:1.0:1784290291.879790:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1784290291.879795:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290291.879798:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468539880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901041408:0@lo:400:kworker.0 00000100:00080000:1.0:1784290291.879801:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290291.879805:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1784290291.879808:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901041152 00000100:00080000:1.0:1784290291.879814:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290291.879822:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901041152 00000100:00100000:0.0:1784290291.879830:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901040640 00000100:00100000:1.0:1784290291.879835:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246853b480 x1870961901041536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290291.879836:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901040640 00000100:00100000:3.0:1784290291.879845:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290291.879854:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3749 00000100:00100000:0.0:1784290291.879866:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901040768 00000100:00100000:0.0:1784290291.879870:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901040768 00000100:00100000:2.0:1784290291.879871:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901040384:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784290291.879900:0:26263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901041408 00000100:00100000:3.0:1784290291.879906:0:26263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901041408 00000100:00100000:0.0:1784290291.879907:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901040896 00000004:00000024:2.0:1784290291.879911:0:8413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:0.0:1784290291.879912:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901040896 00000100:00080000:1.0:1784290291.879915:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1784290291.879921:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290291.879924:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c234529d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290291.879931:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c234529d800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290291.879935:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:0.0:1784290291.879944:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1870961901040768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290291.879950:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246853b100 x1870961901041920/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784290291.879961:0:26263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1508 00000100:00100000:2.0:1784290291.879961:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901040384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290291.879975:0:26263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901041408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290291.879979:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3749 00000100:00100000:0.0:1784290291.879998:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1870961901040768:12345-0@lo:400:kworker.0 Request processed in 55us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290291.880008:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3750 00000100:00100000:0.0:1784290291.880008:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:2.0:1784290291.880021:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901041152:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784290291.880022:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:3.0:1784290291.880025:0:26263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901041408:12345-0@lo:400:kworker.0 Request processed in 52us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290291.880033:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:1.0:1784290291.880036:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901040640:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784290291.880039:0:26263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1508 00000100:00100000:0.0:1784290291.880044:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901040896:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784290291.880049:0:8413:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9c246ff67800, cookie 0x5953bbf6b3073823 00010000:00080000:2.0:1784290291.880056:0:8413:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9c246ff67800 cur 2033 last 1784290286 00010000:00080000:1.0:1784290291.880065:0:66008:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2033 last 0 00010000:00080000:0.0:1784290291.880069:0:65989:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2033 last 0 00000004:00100000:2.0:1784290291.880076:0:8413:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1784290291.880090:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468539880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901041408:0@lo:400:kworker.0 00000100:00100000:3.0:1784290291.880105:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901040384:0@lo:41:osp-pre-1-0.0 00000020:00000080:0.0:1784290291.880114:0:65989:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5953bbf6b30739b9 00000020:00000080:1.0:1784290291.880124:0:66008:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5953bbf6b30739c0 00000004:00100000:0.0:1784290291.880126:0:65989:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1784290291.880128:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00100000:1.0:1784290291.880136:0:66008:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1784290291.880139:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901041664:0@lo:400:kworker.0 00000100:00080000:0.0:1784290291.880155:0:65989:0:(import.c:65:import_set_state_nolock()) ffff9c247e4b5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784290291.880176:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784290291.880180:0:66008:0:(import.c:65:import_set_state_nolock()) ffff9c245fd78800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290291.880206:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1870961901040896:12345-0@lo:38:kworker.0 Request processed in 164us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290291.880213:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:3.0:1784290291.880220:0:26254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901041664 00000100:00100000:3.0:1784290291.880226:0:26254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901041664 00000100:00100000:0.0:1784290291.880244:0:86797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901040512 00000100:00100000:1.0:1784290291.880245:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1870961901040640:12345-0@lo:38:kworker.0 Request processed in 207us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290291.880249:0:86797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901040512 00000100:00100000:3.0:1784290291.880282:0:26254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00100000:1.0:1784290291.880285:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00080000:2.0:1784290291.880286:0:8413:0:(import.c:65:import_set_state_nolock()) ffff9c2343901800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784290291.880294:0:26254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901041664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290291.880300:0:86797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784290291.880311:0:86797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3619:x1870961901040512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290291.880321:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246853b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901041536:0@lo:38:kworker.0 00000100:00100000:3.0:1784290291.880369:0:26254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901041664:12345-0@lo:400:kworker.0 Request processed in 78us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290291.880369:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1870961901041152:12345-0@lo:38:kworker.0 Request processed in 348us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290291.880379:0:86797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3619:x1870961901040512:12345-0@lo:400:kworker.0 Request processed in 71us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290291.880382:0:26254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00100000:2.0:1784290291.880383:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3750 00000100:00100000:1.0:1784290291.880389:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290291.880393:0:86797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784290291.880416:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246853b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901041920:0@lo:38:kworker.0 00000100:00100000:2.0:1784290291.880435:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901041536 00000100:00100000:3.0:1784290291.880438:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468538700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901041664:0@lo:400:kworker.0 00000100:00100000:2.0:1784290291.880440:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901041536 00000100:00100000:1.0:1784290291.880445:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290291.880446:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246853b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1870961901041024:0@lo:400:kworker.0 00000100:00100000:3.0:1784290291.880458:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901040512:0@lo:400:kworker.0 00000100:00100000:2.0:1784290291.880467:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901041920 00000100:00100000:2.0:1784290291.880470:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901041920 00000100:00100000:0.0:1784290291.880482:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290291.880496:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901041024 00000100:00080000:1.0:1784290291.880498:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 24 00000100:00100000:2.0:1784290291.880502:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901041024 00000100:00100000:0.0:1784290291.880505:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901041792:0@lo:400:kworker.0 00000100:00080000:1.0:1784290291.880510:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1784290291.880515:0:3616:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1784290291.880518:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 77309411339 gen 3 00000100:00100000:3.0:1784290291.880522:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246853ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1870961901040768:0@lo:400:kworker.0 00000100:00080000:1.0:1784290291.880523:0:3616:0:(recover.c:53:ptlrpc_replay_next()) import ffff9c246dd98000 from lustre-MDT0000_UUID committed 77309411339 last 0 00000100:00080000:1.0:1784290291.880529:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1784290291.880535:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:0.0:1784290291.880536:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290291.880547:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901041280:0@lo:400:kworker.0 00000100:00100000:2.0:1784290291.880548:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1870961901041024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290291.880572:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:0.0:1784290291.880578:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246853bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901041536:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784290291.880588:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290291.880599:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1870961901041024:12345-0@lo:400:kworker.0 Request processed in 53us (118us total) trans 0 rc 0/0 00010000:00080000:0.0:1784290291.880602:0:65989:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2033 last 0 00000100:00100000:2.0:1784290291.880615:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:1.0:1784290291.880627:0:26260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901041792 00000100:00100000:1.0:1784290291.880631:0:26260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901041792 00000100:00100000:3.0:1784290291.880633:0:26261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901041280 00000020:00000080:0.0:1784290291.880636:0:65989:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5953bbf6b30739c7 00000100:00100000:3.0:1784290291.880639:0:26261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901041280 00000100:00100000:2.0:1784290291.880643:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000004:00100000:0.0:1784290291.880645:0:65989:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1784290291.880652:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901041920:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784290291.880666:0:26260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00080000:0.0:1784290291.880668:0:65989:0:(import.c:65:import_set_state_nolock()) ffff9c246ff18000 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1784290291.880673:0:66004:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2033 last 0 00000100:00100000:1.0:1784290291.880678:0:26260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901041792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290291.880691:0:26261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00100000:3.0:1784290291.880701:0:26261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901041280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290291.880710:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246853bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1870961901041536:12345-0@lo:38:kworker.0 Request processed in 130us (325us total) trans 0 rc 0/0 00000020:00000080:2.0:1784290291.880713:0:66004:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5953bbf6b30739ce 00000100:00100000:0.0:1784290291.880719:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000004:00100000:2.0:1784290291.880726:0:66004:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1784290291.880748:0:26260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901041792:12345-0@lo:400:kworker.0 Request processed in 73us (214us total) trans 0 rc 0/0 00000100:00080000:2.0:1784290291.880751:0:66004:0:(import.c:65:import_set_state_nolock()) ffff9c2343902000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784290291.880763:0:26260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00100000:3.0:1784290291.880769:0:26261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901041280:12345-0@lo:400:kworker.0 Request processed in 66us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290291.880780:0:26261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00100000:2.0:1784290291.880795:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468538380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1870961901041920:12345-0@lo:38:kworker.0 Request processed in 144us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290291.880800:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468538000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901041152:0@lo:38:kworker.0 00000100:00100000:2.0:1784290291.880806:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00010000:00080000:1.0:1784290291.880814:0:86822:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1784290291.880819:0:86822:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 98784247813 00000100:00100000:3.0:1784290291.880822:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901041280:0@lo:400:kworker.0 00010000:00080000:0.0:1784290291.880824:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2468538a80 x1870961901040896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00080000:1.0:1784290291.880825:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784290291.880831:0:86822:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 98784247813, next_transno: 98784247813 00010000:00080000:1.0:1784290291.880839:0:86822:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247813) 00000100:00080000:0.0:1784290291.880844:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 24 00000020:00080000:1.0:1784290291.880850:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00000100:00080000:3.0:1784290291.880853:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784290291.880860:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784290291.880861:0:86822:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896206336 t98784247813 from 192.168.202.6@tcp req@ffff9c2445d0ce00 x1870961896206336/t0(98784247813) o36->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:310/0 lens 528/0 e 0 to 0 dl 1784290300 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784290291.880866:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784290291.880867:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246853b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1870961901041024:0@lo:400:kworker.0 00000100:00100000:2.0:1784290291.880892:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901041792:0@lo:400:kworker.0 00010000:00080000:1.0:1784290291.880944:0:87187:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1784290291.880947:0:87187:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1784290291.880951:0:87187:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000004:00080000:3.0:1784290291.881418:0:86822:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 501us 00010000:00010000:3.0:1784290291.886533:0:86822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b30739d5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.886552:0:86822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b30739d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.886568:0:86822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b30739d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.886584:0:86822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b30739dc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.886593:0:86822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b30739dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.886599:0:86822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b30739dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784290291.886626:0:87187:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:0.0:1784290291.886711:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9c2468538a80 x1870961901040896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290316 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290291.886717:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784290291.886720:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784290291.886723:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784290291.886727:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468538a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901040896:0@lo:38:kworker.0 00010000:00080000:0.0:1784290291.886741:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2474cbce00 x1870961901040640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290291.886748:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 24 00010000:00010000:3.0:1784290291.886965:0:86822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b30739d5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.886985:0:86822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b30739d5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.886993:0:86822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b30739d5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.887001:0:86822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7c400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290291.887006:0:86822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b30739d5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.887014:0:86822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b30739d5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.887028:0:86822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2469585b00) 00010000:00010000:3.0:1784290291.887032:0:86822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290291.887037:0:86822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b30739d5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.887044:0:86822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b30739d5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290291.887060:0:86822:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000054aaeeb reply state 00000000db52f92f transno 98784247813 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b30739dc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.887071:0:86822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b30739dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.887079:0:86822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2469585200) 00010000:00010000:3.0:1784290291.887082:0:86822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290291.887085:0:86822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1784290291.887165:0:86822:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1784290291.887185:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784290291.887188:0:86822:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000020:00080000:3.0:1784290291.887192:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784290291.887194:0:86822:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000100:00080000:0.0:1784290291.887443:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9c2474cbce00 x1870961901040640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290316 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290291.887449:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784290291.887451:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784290291.887460:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784290291.887464:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901040640:0@lo:38:kworker.0 00000100:00100000:0.0:1784290291.887491:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901042048:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1784290291.887515:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1784290291.887546:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c246853b480 x1870961901041536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290291.887553:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901042048 00000100:00080000:0.0:1784290291.887555:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 24 00000100:00100000:2.0:1784290291.887559:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901042048 00000100:00100000:2.0:1784290291.887597:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3751 00000100:00100000:2.0:1784290291.887607:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1870961901042048:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1784290291.887620:0:8413:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9c2343891180 x1870961901042048/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:312/0 lens 224/0 e 0 to 0 dl 1784290302 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290291.887638:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1870961901042048:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 34us (122us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784290291.887646:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3751 00000020:00080000:2.0:1784290291.887660:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290291.887663:0:86822:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000001:00080000:1.0:1784290291.888063:0:86790:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247813 is committed 00010000:00010000:3.0:1784290291.888135:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b30739dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.888145:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b30739dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.888153:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b30739dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.888159:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7d200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290291.888163:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b30739dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290291.888168:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:3.0:1784290291.888170:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b30739dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.888180:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2469585200) 00010000:00010000:3.0:1784290291.888183:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290291.888186:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b30739dc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.888193:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b30739dc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290291.888210:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896206976 00000100:00100000:1.0:1784290291.888216:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896206976 00000100:00080000:0.0:1784290291.888224:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9c246853b480 x1870961901041536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290316 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290291.888230:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784290291.888233:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784290291.888236:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784290291.888239:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246853b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901041536:0@lo:38:kworker.0 00010000:00080000:0.0:1784290291.888254:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c246853b100 x1870961901041920/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290291.888274:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1045 00000100:00080000:0.0:1784290291.888275:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 24 00000100:00080000:0.0:1784290291.888282:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784290291.888286:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784290291.888289:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234529d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784290291.888292:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896206976:12345-192.168.202.6@tcp:36:rm.0 00000100:00100000:0.0:1784290291.888294:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246853b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901041920:0@lo:38:kworker.0 00010000:00080000:1.0:1784290291.888310:0:65989:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247814, current: 98784247814, replaying 00000100:00100000:1.0:1784290291.888327:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896206976:12345-192.168.202.6@tcp:36:rm.0 Request processed in 41us (159us total) trans 0 rc 0/-999 00000020:00080000:2.0:1784290291.888334:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00000100:00100000:1.0:1784290291.888337:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1045 00010000:00080000:2.0:1784290291.888363:0:86822:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247814, next_transno: 98784247814 00010000:00080000:2.0:1784290291.888375:0:86822:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247814) 00000020:00080000:2.0:1784290291.888378:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290291.888386:0:86822:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896206976 t98784247814 from 192.168.202.6@tcp req@ffff9c2468890e00 x1870961896206976/t0(98784247814) o36->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:312/0 lens 512/0 e 0 to 0 dl 1784290302 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1784290291.888431:0:86822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30739e3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888441:0:86822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30739e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888450:0:86822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30739e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888461:0:86822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30739ea lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888468:0:86822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30739ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888475:0:86822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30739ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888517:0:86822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b30739f1 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888526:0:86822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b30739f1 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888533:0:86822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b30739f1 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888646:0:86822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b30739f1 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888657:0:86822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b30739f1 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888661:0:86822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b30739f1 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888664:0:86822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290291.888666:0:86822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b30739f1 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888670:0:86822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b30739f1 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888676:0:86822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff9c2449f0dd00) 00010000:00010000:2.0:1784290291.888678:0:86822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784290291.888680:0:86822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b30739f1 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888683:0:86822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b30739f1 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888695:0:86822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30739e3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888699:0:86822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30739e3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888703:0:86822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30739e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888706:0:86822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450abc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290291.888711:0:86822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30739e3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888716:0:86822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30739e3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888721:0:86822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2449f0db00) 00010000:00010000:2.0:1784290291.888722:0:86822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290291.888724:0:86822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30739e3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888727:0:86822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30739e3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784290291.888734:0:86822:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000889e464b reply state 00000000ff026174 transno 98784247814 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30739ea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888739:0:86822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30739ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.888743:0:86822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2449f0d000) 00010000:00010000:2.0:1784290291.888745:0:86822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290291.888746:0:86822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1784290291.888778:0:86822:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1784290291.888786:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290291.888788:0:86822:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000020:00080000:2.0:1784290291.888790:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290291.888792:0:86822:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000100:00100000:3.0:1784290291.889610:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290291.889655:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896207488 00000100:00100000:0.0:1784290291.889661:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896207488 00000100:00100000:0.0:1784290291.889693:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1046 00000100:00100000:0.0:1784290291.889703:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2396:x1870961896207488:12345-192.168.202.6@tcp:101:touch.0 00010000:00080000:0.0:1784290291.889723:0:65988:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247815, current: 98784247815, replaying 00000100:00100000:0.0:1784290291.889739:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2396:x1870961896207488:12345-192.168.202.6@tcp:101:touch.0 Request processed in 38us (129us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784290291.889747:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1046 00000020:00080000:2.0:1784290291.889760:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290291.889765:0:86822:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247815, next_transno: 98784247815 00010000:00080000:2.0:1784290291.889769:0:86822:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247815) 00000020:00080000:2.0:1784290291.889777:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290291.889784:0:86822:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896207488 t98784247815 from 192.168.202.6@tcp req@ffff9c2474cbce00 x1870961896207488/t0(98784247815) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:312/0 lens 752/0 e 0 to 0 dl 1784290302 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1784290291.889801:0:86822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290291.889813:0:86822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe200/0x5953bbf6b30739f8 lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2233 expref: -99 pid: 86822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.889913:0:86822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b30739ff lrc: 3/0,1 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.889920:0:86822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b30739ff lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.889925:0:86822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b30739ff lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.889933:0:86822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3073a06 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.889938:0:86822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3073a06 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.889942:0:86822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3073a06 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784290291.890181:0:86822:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000a811:0x5:0x0], cookie = 0x5953bbf6b3073789 00000004:00080000:2.0:1784290291.890185:0:86822:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x5953bbf6b3073789 in new mfd 00010000:00010000:2.0:1784290291.890192:0:86822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b30739ff lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.890198:0:86822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b30739ff lrc: 2/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.890209:0:86822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b30739ff lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.890214:0:86822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebe800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290291.890216:0:86822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b30739ff lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.890221:0:86822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b30739ff lrc: 4/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.890229:0:86822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c2449f0dc00) 00010000:00010000:2.0:1784290291.890232:0:86822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290291.890234:0:86822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b30739ff lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.890240:0:86822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b30739ff lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784290291.890249:0:86822:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007fd39623 reply state 000000000108e7f8 transno 98784247815 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3073a06 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.890256:0:86822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3073a06 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.890296:0:86822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9c2449f0da00) 00010000:00010000:2.0:1784290291.890298:0:86822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290291.890300:0:86822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784290291.890319:0:86822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe200/0x5953bbf6b30739f8 lrc: 1/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2233 expref: 10 pid: 86822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.890336:0:86822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c2449f0dc00) 00010000:00010000:2.0:1784290291.890338:0:86822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290291.890342:0:86822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe200/0x5953bbf6b30739f8 lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2233 expref: 10 pid: 86822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.890384:0:86822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebe200, rc 0) 00010000:00080000:2.0:1784290291.890419:0:86822:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1784290291.890431:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290291.890434:0:86822:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000020:00080000:2.0:1784290291.890438:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290291.890441:0:86822:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000100:00100000:0.0:1784290291.898710:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290291.898746:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896207744 00000100:00100000:1.0:1784290291.898752:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896207744 00000100:00100000:1.0:1784290291.898784:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1047 00000100:00100000:1.0:1784290291.898791:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:2396:x1870961896207744:12345-192.168.202.6@tcp:36:touch.0 00010000:00080000:1.0:1784290291.898803:0:66008:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247816, current: 98784247816, replaying 00000100:00100000:1.0:1784290291.898819:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:2396:x1870961896207744:12345-192.168.202.6@tcp:36:touch.0 Request processed in 28us (112us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784290291.898826:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1047 00000020:00080000:3.0:1784290291.898845:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784290291.898850:0:86822:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247816, next_transno: 98784247816 00010000:00080000:3.0:1784290291.898859:0:86822:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247816) 00000020:00080000:3.0:1784290291.898861:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784290291.898867:0:86822:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896207744 t98784247816 from 192.168.202.6@tcp req@ffff9c2343892a00 x1870961896207744/t0(98784247816) o36->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:312/0 lens 488/0 e 0 to 0 dl 1784290302 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1784290291.898918:0:86822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b3073a14 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.898927:0:86822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b3073a14 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.898933:0:86822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b3073a14 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290291.898977:0:86822:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d7fda1b7 reply state 000000002cbe863b transno 98784247816 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b3073a14 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.898985:0:86822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b3073a14 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.898989:0:86822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9c2469585200) 00010000:00010000:3.0:1784290291.898991:0:86822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290291.898993:0:86822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1784290291.899038:0:86822:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1784290291.899046:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784290291.899049:0:86822:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247817 00000020:00080000:3.0:1784290291.899052:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784290291.899054:0:86822:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247817 00000100:00100000:1.0:1784290291.899804:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290291.899853:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896208128 00000100:00100000:2.0:1784290291.899859:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896208128 00000100:00100000:2.0:1784290291.899894:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 215 00000100:00100000:2.0:1784290291.899904:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246853b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:2396:x1870961896208128:12345-192.168.202.6@tcp:35:touch.0 00010000:00080000:2.0:1784290291.899916:0:65991:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 98784247817, current: 98784247817, replaying 00000100:00100000:2.0:1784290291.899931:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246853b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:2396:x1870961896208128:12345-192.168.202.6@tcp:35:touch.0 Request processed in 30us (128us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784290291.899939:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 215 00000020:00080000:3.0:1784290291.899956:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784290291.899960:0:86822:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247817, next_transno: 98784247817 00010000:00080000:3.0:1784290291.899962:0:86822:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (98784247817) 00000020:00080000:3.0:1784290291.899970:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784290291.899975:0:86822:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896208128 t98784247817 from 192.168.202.6@tcp req@ffff9c246853b800 x1870961896208128/t0(98784247817) o35->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:312/0 lens 392/0 e 0 to 0 dl 1784290302 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784290291.900068:0:86822:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1784290291.900080:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784290291.900082:0:86822:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247818 00000020:00080000:3.0:1784290291.900084:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784290291.900086:0:86822:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247818 00000100:00100000:0.0:1784290291.901736:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290291.901804:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896212480 00000100:00100000:2.0:1784290291.901810:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896212480 00000100:00100000:2.0:1784290291.901842:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 636 00000100:00100000:2.0:1784290291.901848:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:2396:x1870961896212480:12345-192.168.202.6@tcp:400:ldlm_lock_repla.0 00010000:00080000:2.0:1784290291.901860:0:65990:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9c2343893480 x1870961896212480/t0(0) o400->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:312/0 lens 224/0 e 0 to 0 dl 1784290302 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290291.901879:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:2396:x1870961896212480:12345-192.168.202.6@tcp:400:ldlm_lock_repla.0 Request processed in 33us (147us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784290291.901885:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 636 00000020:00080000:3.0:1784290291.901905:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784290291.901909:0:86822:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 98784247818 00010000:00080000:3.0:1784290291.901911:0:86822:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1784290291.901913:0:86822:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1784290291.901918:0:86822:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1784290291.901920:0:86822:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1784290291.901972:0:86822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 103079215104 00000001:00100000:1.0:1784290291.902864:0:86790:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000001:00100000:1.0:1784290291.902868:0:86790:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1784290291.902881:0:86790:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247817 is committed 00010000:00010000:0.0:1784290291.902917:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30739ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784290291.902928:0:86822:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:0.0:1784290291.902928:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30739ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.902939:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30739ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.902944:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290291.902947:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30739ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.902952:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30739ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1784290291.902960:0:86822:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00010000:0.0:1784290291.902964:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2449f0d000) 00010000:00010000:0.0:1784290291.902968:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00080000:3.0:1784290291.902972:0:86822:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9c2343891180 x1870961901042048/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:312/0 lens 224/0 e 0 to 0 dl 1784290302 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784290291.902973:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30739ea lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.902989:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30739ea lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.903018:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3073a06 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.903024:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3073a06 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.903028:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3073a06 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.903033:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290291.903036:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3073a06 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.903040:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3073a06 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1784290291.903046:0:86822:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.202.6@tcp: req@ffff9c2343893480 x1870961896212480/t0(0) o400->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:312/0 lens 224/0 e 0 to 0 dl 1784290302 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784290291.903050:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9c2449f0da00) 00010000:00010000:0.0:1784290291.903055:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290291.903057:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3073a06 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.903063:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3073a06 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784290291.903065:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1784290291.903078:0:3616:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9c2468539c00 x1870961901042048/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290307 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1784290291.903086:0:86822:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:03, of 2 clients 2 recovered and 0 were evicted. 00010000:00010000:0.0:1784290291.903087:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b3073a14 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784290291.903091:0:3616:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9c2468539c00 x1870961901042048/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290307 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784290291.903110:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b3073a14 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784290291.903111:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00010000:00010000:0.0:1784290291.903124:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b3073a14 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:02000000:1.0:1784290291.903129:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1784290291.903136:0:3616:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000124aa97): req@ffff9c2467dedf80 x1870961901025024/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290287 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784290291.903144:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7d200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290291.903150:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b3073a14 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290291.903154:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468539c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901042048:0@lo:400:ldlm_lock_repla.0 00010000:00010000:0.0:1784290291.903167:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b3073a14 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.903182:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9c2469585200) 00010000:00010000:0.0:1784290291.903185:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290291.903190:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b3073a14 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.903198:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b3073a14 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 86822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290291.903208:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290291.903239:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784290291.903239:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901025024 00000100:00100000:1.0:1784290291.903248:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901025024 00000100:00100000:2.0:1784290291.903249:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468892680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901042176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290291.903294:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290291.903306:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901042176 00000100:00100000:1.0:1784290291.903311:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901042176 00000100:00100000:0.0:1784290291.903335:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3752 00000100:00100000:2.0:1784290291.903365:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3753 00000100:00100000:0.0:1784290291.903370:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3617:x1870961901025024:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290291.903376:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3617:x1870961901042176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1784290291.903395:0:23867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444651008 avail 1298411520 00000004:00000024:0.0:1784290291.903395:0:22091:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444651008 avail 1298411520 00000100:00100000:2.0:1784290291.903454:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3617:x1870961901042176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290291.903462:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3617:x1870961901025024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290291.903469:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3753 00000100:00100000:1.0:1784290291.903472:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468892680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901042176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784290291.903479:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3752 00000100:00100000:1.0:1784290291.903497:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901025024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784290291.904090:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290291.904134:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896211072 00000100:00100000:1.0:1784290291.904140:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896211072 00000100:00100000:1.0:1784290291.904178:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1048 00000100:00100000:1.0:1784290291.904187:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:66528:x1870961896211072:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:1.0:1784290291.904204:0:74876:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444651008 avail 1298411520 00000100:00100000:1.0:1784290291.904255:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:66528:x1870961896211072:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 68us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290291.904286:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1048 00000100:00100000:0.0:1784290291.904980:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290291.905012:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896212608 00000100:00100000:1.0:1784290291.905016:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896212608 00000100:00100000:1.0:1784290291.905052:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1049 00000100:00100000:1.0:1784290291.905057:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:66528:x1870961896212608:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:1.0:1784290291.905069:0:66008:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00080000:2.0:1784290291.905088:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784290291.905100:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:66528:x1870961896212608:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 41us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290291.905107:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1049 00000100:00100000:0.0:1784290291.906177:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290291.906255:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896212736 00000100:00100000:1.0:1784290291.906275:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896212736 00000100:00100000:1.0:1784290291.906303:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4916 00000100:00100000:1.0:1784290291.906309:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2396:x1870961896212736:12345-192.168.202.6@tcp:8:lfs.0 00010000:00080000:1.0:1784290291.906331:0:26258:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp t0 exp 0000000000000000 cur 2033 last 0 00000020:00000080:1.0:1784290291.906376:0:26258:0:(genops.c:1406:class_connect()) connect: client bd808cf4-dd54-45f0-9b2b-1434e8330e5d, cookie 0x5953bbf6b3073a1b 00002000:00100000:1.0:1784290291.906385:0:26258:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bd808cf4-dd54-45f0-9b2b-1434e8330e5d/ffff9c245fd7e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ad ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784290291.906398:0:26258:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784290291.906451:0:26258:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784290291.906472:0:26258:0:(import.c:65:import_set_state_nolock()) ffff9c245fd7d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784290291.906509:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896212736:12345-192.168.202.6@tcp:8:lfs.0 Request processed in 198us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290291.906515:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4916 00000100:00100000:0.0:1784290291.907159:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290291.907194:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896212864 00000100:00100000:1.0:1784290291.907199:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896212864 00000100:00100000:1.0:1784290291.907237:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1132 00000100:00080000:2.0:1784290291.907247:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290291.907253:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:66528:x1870961896212864:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:1.0:1784290291.907277:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290291.907308:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:66528:x1870961896212864:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 58us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290291.907315:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1132 00000001:00100000:2.0:1784290291.907594:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000001:00100000:2.0:1784290291.907599:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000020:00000080:2.0:1784290291.907602:0:8397:0:(genops.c:906:class_export_put()) final put ffff9c247e4b1000/bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000001:00100000:2.0:1784290291.907637:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784290291.907697:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247e4b1000/bd808cf4-dd54-45f0-9b2b-1434e8330e5d for lustre-OST0000 00000020:00000080:1.0:1784290291.907760:0:9947:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c247e4b2800 for lustre-OST0000 00000100:00100000:0.0:1784290291.908030:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290291.908081:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896212992 00000100:00100000:1.0:1784290291.908085:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896212992 00000100:00100000:1.0:1784290291.908106:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4917 00000100:00100000:1.0:1784290291.908110:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2396:x1870961896212992:12345-192.168.202.6@tcp:8:lfs.0 00010000:00080000:1.0:1784290291.908125:0:9000:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp t0 exp 0000000000000000 cur 2033 last 0 00000020:00000080:1.0:1784290291.908142:0:9000:0:(genops.c:1406:class_connect()) connect: client bd808cf4-dd54-45f0-9b2b-1434e8330e5d, cookie 0x5953bbf6b3073a22 00002000:00100000:1.0:1784290291.908147:0:9000:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bd808cf4-dd54-45f0-9b2b-1434e8330e5d/ffff9c245fd7f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ad ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784290291.908157:0:9000:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784290291.908194:0:9000:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784290291.908208:0:9000:0:(import.c:65:import_set_state_nolock()) ffff9c247e4b2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784290291.908242:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896212992:12345-192.168.202.6@tcp:8:lfs.0 Request processed in 130us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290291.908248:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4917 00000100:00100000:0.0:1784290291.908912:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000001:00100000:1.0:1784290291.908947:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000001:00100000:1.0:1784290291.908955:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000100:00100000:2.0:1784290291.908957:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896213120 00000020:00000080:1.0:1784290291.908959:0:9482:0:(genops.c:906:class_export_put()) final put ffff9c247e4b0800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000100:00100000:2.0:1784290291.908963:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896213120 00000001:00100000:1.0:1784290291.908978:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784290291.908984:0:60390:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247e4b0800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d for lustre-OST0001 00000100:00100000:2.0:1784290291.909006:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1133 00000100:00100000:2.0:1784290291.909017:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:66528:x1870961896213120:12345-192.168.202.6@tcp:13:lfs.0 00000020:00000080:0.0:1784290291.909023:0:60390:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c247e4b6800 for lustre-OST0001 00002000:00000024:2.0:1784290291.909029:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784290291.909062:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:66528:x1870961896213120:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 50us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290291.909076:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1133 00000100:00080000:2.0:1784290291.909102:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00000080:2.0:1784290291.917042:0:86822:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae5447a1fe10 00100000:10000000:2.0:1784290291.917055:0:86822:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1784290291.917333:0:86808:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x45c:0x0] 00000004:00080000:1.0:1784290291.917362:0:86810:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x682:0x0] 00000100:00100000:1.0:1784290291.917420:0:86810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468539c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:86810:1870961901042304:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784290291.917421:0:86808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:86808:1870961901042432:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784290291.917501:0:86808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290291.917540:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901042432 00000100:00100000:3.0:1784290291.917546:0:86808:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b2793c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290291.917548:0:86810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290291.917550:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901042432 00000100:00100000:2.0:1784290291.917574:0:86810:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23432cf480 going to sleep for 11 seconds 00000100:00100000:1.0:1784290291.917606:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901042304 00000100:00100000:1.0:1784290291.917612:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901042304 00000100:00100000:0.0:1784290291.917623:0:15642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4918 00000100:00100000:0.0:1784290291.917637:0:15642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:86808:x1870961901042432:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784290291.917647:0:26255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4919 00000100:00100000:3.0:1784290291.917662:0:26255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:86810:x1870961901042304:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1784290291.917664:0:15642:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1761 -> diff = -645 00002000:02000040:0.0:1784290291.917671:0:15642:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1117 to 0x280000401:1761) 00002000:00080000:3.0:1784290291.917685:0:26255:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1761 -> diff = -95 00002000:02000040:3.0:1784290291.917693:0:26255:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1667 to 0x2c0000401:1761) 00002000:00010000:0.0:1784290291.920997:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290291.921005:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ed5723e/0x5953bbf6b3073a29 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921019:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e1:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.921022:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.921027:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ed5723e/0x5953bbf6b3073a29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921040:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ed5723e/0x5953bbf6b3073a29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921047:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ed5723e/0x5953bbf6b3073a29 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921053:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ed5723e/0x5953bbf6b3073a29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921069:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.921122:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.921130:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ed5723e/0x5953bbf6b3073a29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.921139:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923e600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.921144:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ed5723e/0x5953bbf6b3073a29 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.921149:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290291.921152:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ed5723e/0x5953bbf6b3073a29 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921156:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008c60bf2/0x5953bbf6b3073a30 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.921169:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ed5723e/0x5953bbf6b3073a29 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921170:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e0:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.921178:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.921188:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008c60bf2/0x5953bbf6b3073a30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.921189:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ed5723e/0x5953bbf6b3073a29 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921213:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008c60bf2/0x5953bbf6b3073a30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.921237:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.921239:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008c60bf2/0x5953bbf6b3073a30 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.921240:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.921244:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.921250:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008c60bf2/0x5953bbf6b3073a30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921280:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290291.921309:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290291.921316:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008c60bf2/0x5953bbf6b3073a30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.921320:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290291.921331:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923e800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290291.921331:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fef98e90/0x5953bbf6b3073a37 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.921338:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008c60bf2/0x5953bbf6b3073a30 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.921364:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008c60bf2/0x5953bbf6b3073a30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921376:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6df:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.921380:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290291.921382:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008c60bf2/0x5953bbf6b3073a30 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921384:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fef98e90/0x5953bbf6b3073a37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.921399:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008c60bf2/0x5953bbf6b3073a30 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921404:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fef98e90/0x5953bbf6b3073a37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.921414:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.921417:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.921420:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.921429:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fef98e90/0x5953bbf6b3073a37 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921434:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fef98e90/0x5953bbf6b3073a37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921448:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290291.921466:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290291.921471:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fef98e90/0x5953bbf6b3073a37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.921489:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290291.921490:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923e200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290291.921496:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fef98e90/0x5953bbf6b3073a37 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921498:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c759241c/0x5953bbf6b3073a3e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.921517:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fef98e90/0x5953bbf6b3073a37 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921518:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6de:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.921528:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.921536:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c759241c/0x5953bbf6b3073a3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.921539:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fef98e90/0x5953bbf6b3073a37 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921546:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c759241c/0x5953bbf6b3073a3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.921548:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fef98e90/0x5953bbf6b3073a37 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921571:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c759241c/0x5953bbf6b3073a3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.921577:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.921579:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c759241c/0x5953bbf6b3073a3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.921581:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.921585:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.921608:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.921620:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.921633:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c759241c/0x5953bbf6b3073a3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.921640:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923e400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.921644:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c759241c/0x5953bbf6b3073a3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.921644:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290291.921655:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040e2114a/0x5953bbf6b3073a45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.921658:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c759241c/0x5953bbf6b3073a3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921671:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dd:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.921674:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.921679:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040e2114a/0x5953bbf6b3073a45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.921680:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c759241c/0x5953bbf6b3073a3e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.921714:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c759241c/0x5953bbf6b3073a3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921715:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040e2114a/0x5953bbf6b3073a45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921733:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040e2114a/0x5953bbf6b3073a45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.921738:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.921739:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040e2114a/0x5953bbf6b3073a45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.921741:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.921744:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.921756:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.921765:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.921769:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040e2114a/0x5953bbf6b3073a45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.921775:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923f400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.921778:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040e2114a/0x5953bbf6b3073a45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.921785:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290291.921795:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000999eab26/0x5953bbf6b3073a4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.921800:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040e2114a/0x5953bbf6b3073a45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921802:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dc:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:2.0:1784290291.921812:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040e2114a/0x5953bbf6b3073a45 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921813:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.921823:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000999eab26/0x5953bbf6b3073a4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.921825:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040e2114a/0x5953bbf6b3073a45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921841:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000999eab26/0x5953bbf6b3073a4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921851:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000999eab26/0x5953bbf6b3073a4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921859:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000999eab26/0x5953bbf6b3073a4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.921862:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.921865:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.921867:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.921882:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.921886:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.921891:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000999eab26/0x5953bbf6b3073a4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.921896:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923fa00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.921899:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000999eab26/0x5953bbf6b3073a4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.921905:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000999eab26/0x5953bbf6b3073a4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.921914:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000999eab26/0x5953bbf6b3073a4c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.921929:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000999eab26/0x5953bbf6b3073a4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.921929:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290291.921942:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e7c5f2f/0x5953bbf6b3073a53 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.921947:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.921950:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.921950:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6db:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:2.0:1784290291.921953:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.921956:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.921960:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e7c5f2f/0x5953bbf6b3073a53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921967:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e7c5f2f/0x5953bbf6b3073a53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.921972:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e7c5f2f/0x5953bbf6b3073a53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922000:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e7c5f2f/0x5953bbf6b3073a53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922014:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290291.922051:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290291.922056:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e7c5f2f/0x5953bbf6b3073a53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.922059:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290291.922070:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923ec00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290291.922070:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048180fbc/0x5953bbf6b3073a5a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.922077:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e7c5f2f/0x5953bbf6b3073a53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922083:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6da:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:1.0:1784290291.922088:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e7c5f2f/0x5953bbf6b3073a53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922088:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.922092:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048180fbc/0x5953bbf6b3073a5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922107:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048180fbc/0x5953bbf6b3073a5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922115:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048180fbc/0x5953bbf6b3073a5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.922116:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e7c5f2f/0x5953bbf6b3073a53 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922132:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048180fbc/0x5953bbf6b3073a5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.922135:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e7c5f2f/0x5953bbf6b3073a53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.922158:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290291.922158:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290291.922165:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048180fbc/0x5953bbf6b3073a5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.922170:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2474ea4200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290291.922174:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048180fbc/0x5953bbf6b3073a5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.922177:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.922184:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048180fbc/0x5953bbf6b3073a5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.922194:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048180fbc/0x5953bbf6b3073a5a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.922196:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290291.922208:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d8952db/0x5953bbf6b3073a61 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.922209:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048180fbc/0x5953bbf6b3073a5a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.922219:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.922222:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.922224:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d9:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.922227:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290291.922234:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.922234:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d8952db/0x5953bbf6b3073a61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922245:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d8952db/0x5953bbf6b3073a61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922252:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d8952db/0x5953bbf6b3073a61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922257:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d8952db/0x5953bbf6b3073a61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922284:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.922317:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.922322:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d8952db/0x5953bbf6b3073a61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.922328:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2474ea5800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.922332:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d8952db/0x5953bbf6b3073a61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.922333:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290291.922342:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002aaaa358/0x5953bbf6b3073a68 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922348:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d8:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.922351:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290291.922358:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d8952db/0x5953bbf6b3073a61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.922370:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d8952db/0x5953bbf6b3073a61 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922375:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002aaaa358/0x5953bbf6b3073a68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.922378:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d8952db/0x5953bbf6b3073a61 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922397:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002aaaa358/0x5953bbf6b3073a68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.922401:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.922411:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.922415:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.922419:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002aaaa358/0x5953bbf6b3073a68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922426:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002aaaa358/0x5953bbf6b3073a68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922437:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.922451:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.922459:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002aaaa358/0x5953bbf6b3073a68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.922467:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290291.922468:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2474ea5000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290291.922475:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed19fd3/0x5953bbf6b3073a6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.922476:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002aaaa358/0x5953bbf6b3073a68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922490:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d7:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:2.0:1784290291.922494:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002aaaa358/0x5953bbf6b3073a68 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922494:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.922503:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eed19fd3/0x5953bbf6b3073a6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.922510:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002aaaa358/0x5953bbf6b3073a68 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922513:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eed19fd3/0x5953bbf6b3073a6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.922522:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002aaaa358/0x5953bbf6b3073a68 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922526:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eed19fd3/0x5953bbf6b3073a6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922537:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eed19fd3/0x5953bbf6b3073a6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.922540:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.922543:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.922545:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.922559:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.922566:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.922570:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eed19fd3/0x5953bbf6b3073a6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.922576:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2474ea5600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.922579:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed19fd3/0x5953bbf6b3073a6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.922592:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eed19fd3/0x5953bbf6b3073a6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.922594:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290291.922606:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2349320/0x5953bbf6b3073a76 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.922608:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eed19fd3/0x5953bbf6b3073a6f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922616:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d6:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:2.0:1784290291.922619:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eed19fd3/0x5953bbf6b3073a6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922620:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.922629:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2349320/0x5953bbf6b3073a76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.922638:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.922639:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2349320/0x5953bbf6b3073a76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.922642:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.922646:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.922650:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2349320/0x5953bbf6b3073a76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922656:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2349320/0x5953bbf6b3073a76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922667:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.922673:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.922678:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2349320/0x5953bbf6b3073a76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.922685:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2474ea5400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.922688:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2349320/0x5953bbf6b3073a76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.922691:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290291.922693:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2349320/0x5953bbf6b3073a76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922698:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000328d1f56/0x5953bbf6b3073a7d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.922705:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2349320/0x5953bbf6b3073a76 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922706:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d5:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.922714:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.922720:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000328d1f56/0x5953bbf6b3073a7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.922727:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2349320/0x5953bbf6b3073a76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922732:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000328d1f56/0x5953bbf6b3073a7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.922741:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.922741:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000328d1f56/0x5953bbf6b3073a7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.922744:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.922748:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.922753:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000328d1f56/0x5953bbf6b3073a7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922766:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290291.922786:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290291.922794:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000328d1f56/0x5953bbf6b3073a7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.922795:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290291.922804:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf4d97f/0x5953bbf6b3073a84 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.922812:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2474ea4000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290291.922814:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d4:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.922819:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290291.922820:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000328d1f56/0x5953bbf6b3073a7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922823:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bf4d97f/0x5953bbf6b3073a84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922845:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bf4d97f/0x5953bbf6b3073a84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.922848:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000328d1f56/0x5953bbf6b3073a7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922855:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bf4d97f/0x5953bbf6b3073a84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922869:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bf4d97f/0x5953bbf6b3073a84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.922870:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000328d1f56/0x5953bbf6b3073a7d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.922889:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000328d1f56/0x5953bbf6b3073a7d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922892:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.922908:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290291.922912:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.922914:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bf4d97f/0x5953bbf6b3073a84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.922915:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.922921:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.922925:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2474ea4400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.922929:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf4d97f/0x5953bbf6b3073a84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.922930:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290291.922941:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000678f0df9/0x5953bbf6b3073a8b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.922943:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bf4d97f/0x5953bbf6b3073a84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922960:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d3:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.922964:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290291.922965:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bf4d97f/0x5953bbf6b3073a84 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922968:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000678f0df9/0x5953bbf6b3073a8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.922983:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bf4d97f/0x5953bbf6b3073a84 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922987:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000678f0df9/0x5953bbf6b3073a8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.922998:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000678f0df9/0x5953bbf6b3073a8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.923000:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.923004:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.923005:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000678f0df9/0x5953bbf6b3073a8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.923014:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.923023:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290291.923047:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1784290291.923049:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290291.923055:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000678f0df9/0x5953bbf6b3073a8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923055:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000684c7b4d/0x5953bbf6b3073a92 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.923076:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2474ea5a00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290291.923079:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d2:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:1.0:1784290291.923082:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000678f0df9/0x5953bbf6b3073a8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923083:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.923089:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000684c7b4d/0x5953bbf6b3073a92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923104:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000684c7b4d/0x5953bbf6b3073a92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923111:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000684c7b4d/0x5953bbf6b3073a92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923129:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000684c7b4d/0x5953bbf6b3073a92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.923135:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000678f0df9/0x5953bbf6b3073a8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923144:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290291.923153:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000678f0df9/0x5953bbf6b3073a8b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.923157:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.923165:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000684c7b4d/0x5953bbf6b3073a92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.923170:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000678f0df9/0x5953bbf6b3073a8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.923173:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2474ea4800 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:0.0:1784290291.923175:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290291.923180:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000684c7b4d/0x5953bbf6b3073a92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923185:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f835f63/0x5953bbf6b3073a99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.923207:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000684c7b4d/0x5953bbf6b3073a92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.923208:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.923208:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d1:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:1.0:1784290291.923214:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.923217:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290291.923219:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.923226:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f835f63/0x5953bbf6b3073a99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.923228:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000684c7b4d/0x5953bbf6b3073a92 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923239:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f835f63/0x5953bbf6b3073a99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.923240:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000684c7b4d/0x5953bbf6b3073a92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.923275:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.923278:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.923280:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.923281:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f835f63/0x5953bbf6b3073a99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923288:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f835f63/0x5953bbf6b3073a99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923298:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.923304:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.923309:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f835f63/0x5953bbf6b3073a99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.923315:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2474ea5200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.923318:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f835f63/0x5953bbf6b3073a99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.923330:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290291.923334:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f835f63/0x5953bbf6b3073a99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923336:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5dd80ce/0x5953bbf6b3073aa0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.923363:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f835f63/0x5953bbf6b3073a99 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923364:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d0:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.923372:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290291.923380:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f835f63/0x5953bbf6b3073a99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923381:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5dd80ce/0x5953bbf6b3073aa0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923404:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5dd80ce/0x5953bbf6b3073aa0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.923408:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.923410:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5dd80ce/0x5953bbf6b3073aa0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.923412:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.923417:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.923420:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5dd80ce/0x5953bbf6b3073aa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923441:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290291.923463:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290291.923470:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5dd80ce/0x5953bbf6b3073aa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.923474:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290291.923483:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022519acd/0x5953bbf6b3073aa7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.923488:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2474ea5c00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290291.923494:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cf:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:1.0:1784290291.923496:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5dd80ce/0x5953bbf6b3073aa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923498:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.923506:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022519acd/0x5953bbf6b3073aa7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.923520:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5dd80ce/0x5953bbf6b3073aa0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923521:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022519acd/0x5953bbf6b3073aa7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923547:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022519acd/0x5953bbf6b3073aa7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923555:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022519acd/0x5953bbf6b3073aa7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.923557:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5dd80ce/0x5953bbf6b3073aa0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923571:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.923579:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.923586:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022519acd/0x5953bbf6b3073aa7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.923590:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5dd80ce/0x5953bbf6b3073aa0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.923596:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290291.923598:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2474ea4600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.923605:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022519acd/0x5953bbf6b3073aa7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923607:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000191fb252/0x5953bbf6b3073aae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.923624:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.923630:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022519acd/0x5953bbf6b3073aa7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.923630:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.923631:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ce:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:1.0:1784290291.923636:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.923643:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022519acd/0x5953bbf6b3073aa7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923643:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.923652:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000191fb252/0x5953bbf6b3073aae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923663:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000191fb252/0x5953bbf6b3073aae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.923667:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022519acd/0x5953bbf6b3073aa7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923675:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000191fb252/0x5953bbf6b3073aae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923682:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000191fb252/0x5953bbf6b3073aae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.923683:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.923686:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.923689:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.923697:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290291.923713:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290291.923721:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000191fb252/0x5953bbf6b3073aae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.923726:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290291.923731:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2474ea4e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290291.923733:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086c77e66/0x5953bbf6b3073ab5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.923738:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000191fb252/0x5953bbf6b3073aae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923742:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cd:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.923749:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.923757:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086c77e66/0x5953bbf6b3073ab5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.923761:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000191fb252/0x5953bbf6b3073aae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923766:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086c77e66/0x5953bbf6b3073ab5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923780:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086c77e66/0x5953bbf6b3073ab5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.923783:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000191fb252/0x5953bbf6b3073aae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.923812:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000191fb252/0x5953bbf6b3073aae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923813:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086c77e66/0x5953bbf6b3073ab5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923843:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.923851:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.923851:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290291.923858:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086c77e66/0x5953bbf6b3073ab5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.923877:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2474ea5e00 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:0.0:1784290291.923878:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290291.923883:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086c77e66/0x5953bbf6b3073ab5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923884:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeb813e8/0x5953bbf6b3073abc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923906:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cc:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.923909:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290291.923910:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086c77e66/0x5953bbf6b3073ab5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923913:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeb813e8/0x5953bbf6b3073abc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923937:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeb813e8/0x5953bbf6b3073abc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.923942:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086c77e66/0x5953bbf6b3073ab5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923943:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeb813e8/0x5953bbf6b3073abc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923966:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aeb813e8/0x5953bbf6b3073abc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.923968:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086c77e66/0x5953bbf6b3073ab5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.923981:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.923986:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.923991:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aeb813e8/0x5953bbf6b3073abc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.923992:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.923999:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.924000:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2474ea4a00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290291.924005:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.924006:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeb813e8/0x5953bbf6b3073abc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.924010:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290291.924014:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeb813e8/0x5953bbf6b3073abc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924016:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1a4d3f0/0x5953bbf6b3073ac3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.924024:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aeb813e8/0x5953bbf6b3073abc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924032:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cb:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:2.0:1784290291.924034:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeb813e8/0x5953bbf6b3073abc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924036:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.924045:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1a4d3f0/0x5953bbf6b3073ac3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.924052:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.924054:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1a4d3f0/0x5953bbf6b3073ac3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.924061:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.924061:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1a4d3f0/0x5953bbf6b3073ac3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.924065:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.924071:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1a4d3f0/0x5953bbf6b3073ac3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924083:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290291.924097:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290291.924104:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1a4d3f0/0x5953bbf6b3073ac3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.924114:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2474ea4c00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290291.924119:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1a4d3f0/0x5953bbf6b3073ac3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.924121:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290291.924130:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b791a16/0x5953bbf6b3073aca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.924135:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1a4d3f0/0x5953bbf6b3073ac3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924137:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ca:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.924140:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.924143:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b791a16/0x5953bbf6b3073aca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924169:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b791a16/0x5953bbf6b3073aca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.924177:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1a4d3f0/0x5953bbf6b3073ac3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.924204:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1a4d3f0/0x5953bbf6b3073ac3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924206:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b791a16/0x5953bbf6b3073aca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924227:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b791a16/0x5953bbf6b3073aca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.924240:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290291.924246:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b791a16/0x5953bbf6b3073aca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924247:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784290291.924259:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.924270:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.924280:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b791a16/0x5953bbf6b3073aca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.924291:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b791a16/0x5953bbf6b3073aca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.924292:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290291.924299:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000008b5361/0x5953bbf6b3073ad1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924314:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c9:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.924316:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290291.924317:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b791a16/0x5953bbf6b3073aca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924320:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000008b5361/0x5953bbf6b3073ad1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924362:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000008b5361/0x5953bbf6b3073ad1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.924365:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b791a16/0x5953bbf6b3073aca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924373:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000008b5361/0x5953bbf6b3073ad1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924385:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000008b5361/0x5953bbf6b3073ad1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.924393:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.924397:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.924407:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290291.924409:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.924415:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.924417:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000008b5361/0x5953bbf6b3073ad1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.924429:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290291.924435:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000008b5361/0x5953bbf6b3073ad1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.924439:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290291.924448:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3298557/0x5953bbf6b3073ad8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.924451:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000008b5361/0x5953bbf6b3073ad1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924457:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c8:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.924464:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.924472:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3298557/0x5953bbf6b3073ad8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.924478:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000008b5361/0x5953bbf6b3073ad1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924481:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3298557/0x5953bbf6b3073ad8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924504:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3298557/0x5953bbf6b3073ad8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.924505:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000008b5361/0x5953bbf6b3073ad1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924518:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3298557/0x5953bbf6b3073ad8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924535:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784290291.924536:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.924542:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.924544:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3298557/0x5953bbf6b3073ad8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.924554:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27a00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290291.924558:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3298557/0x5953bbf6b3073ad8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.924561:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290291.924570:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000448e7a03/0x5953bbf6b3073adf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.924574:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3298557/0x5953bbf6b3073ad8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924578:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c7:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.924586:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.924589:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000448e7a03/0x5953bbf6b3073adf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924613:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000448e7a03/0x5953bbf6b3073adf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.924620:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3298557/0x5953bbf6b3073ad8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924622:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000448e7a03/0x5953bbf6b3073adf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924644:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000448e7a03/0x5953bbf6b3073adf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.924647:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3298557/0x5953bbf6b3073ad8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924656:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.924661:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.924667:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000448e7a03/0x5953bbf6b3073adf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.924669:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.924675:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.924677:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290291.924682:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.924683:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000448e7a03/0x5953bbf6b3073adf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.924688:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290291.924692:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000448e7a03/0x5953bbf6b3073adf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924694:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b15e2a/0x5953bbf6b3073ae6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924708:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c6:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:2.0:1784290291.924710:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000448e7a03/0x5953bbf6b3073adf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924711:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.924720:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b15e2a/0x5953bbf6b3073ae6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.924725:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000448e7a03/0x5953bbf6b3073adf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924731:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b15e2a/0x5953bbf6b3073ae6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924739:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b15e2a/0x5953bbf6b3073ae6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.924741:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.924744:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.924747:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.924754:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b15e2a/0x5953bbf6b3073ae6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924766:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.924771:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.924776:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b15e2a/0x5953bbf6b3073ae6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.924792:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.924795:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b15e2a/0x5953bbf6b3073ae6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.924795:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290291.924805:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000120e7c7/0x5953bbf6b3073aed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.924808:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b15e2a/0x5953bbf6b3073ae6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924815:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c5:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.924819:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290291.924824:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b15e2a/0x5953bbf6b3073ae6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924824:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000120e7c7/0x5953bbf6b3073aed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.924848:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b15e2a/0x5953bbf6b3073ae6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924854:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000120e7c7/0x5953bbf6b3073aed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.924861:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.924864:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.924865:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.924867:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000120e7c7/0x5953bbf6b3073aed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924877:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000120e7c7/0x5953bbf6b3073aed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924892:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.924898:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.924902:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000120e7c7/0x5953bbf6b3073aed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.924908:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27c00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.924910:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000120e7c7/0x5953bbf6b3073aed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.924916:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000120e7c7/0x5953bbf6b3073aed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.924930:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000120e7c7/0x5953bbf6b3073aed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.924936:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000120e7c7/0x5953bbf6b3073aed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.924938:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290291.924947:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007bb595e/0x5953bbf6b3073af4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.924948:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.924951:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.924952:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.924965:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c4:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.924967:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.924971:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007bb595e/0x5953bbf6b3073af4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924978:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007bb595e/0x5953bbf6b3073af4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924984:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007bb595e/0x5953bbf6b3073af4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.924989:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007bb595e/0x5953bbf6b3073af4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.925000:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.925005:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.925009:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007bb595e/0x5953bbf6b3073af4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925016:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.925019:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007bb595e/0x5953bbf6b3073af4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925024:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007bb595e/0x5953bbf6b3073af4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925033:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007bb595e/0x5953bbf6b3073af4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290291.925034:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290291.925044:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3073afb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925046:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007bb595e/0x5953bbf6b3073af4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.925061:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c3:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.925064:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.925071:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3073afb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.925082:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3073afb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925083:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.925086:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.925089:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.925102:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3073afb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.925108:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3073afb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.925119:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784290291.925146:0:15642:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290291.925149:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290291.925151:0:15642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096010256/0x5953bbf6b3073b02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.925157:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3073afb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.925159:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c2:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.925167:0:15642:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.925175:0:15642:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096010256/0x5953bbf6b3073b02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.925180:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290291.925184:0:15642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096010256/0x5953bbf6b3073b02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.925187:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3073afb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.925196:0:15642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096010256/0x5953bbf6b3073b02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.925210:0:15642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096010256/0x5953bbf6b3073b02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.925211:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3073afb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.925239:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3073afb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.925248:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290291.925248:0:15642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.925250:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290291.925251:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3073afb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925258:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096010256/0x5953bbf6b3073b02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925277:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290291.925278:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dc92fda/0x5953bbf6b3073b09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925282:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096010256/0x5953bbf6b3073b02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925309:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096010256/0x5953bbf6b3073b02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.925313:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e1:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:3.0:1784290291.925325:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290291.925331:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096010256/0x5953bbf6b3073b02 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.925331:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.925333:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dc92fda/0x5953bbf6b3073b09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.925337:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.925360:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096010256/0x5953bbf6b3073b02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.925367:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.925379:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.925383:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.925386:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.925387:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dc92fda/0x5953bbf6b3073b09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.925400:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dc92fda/0x5953bbf6b3073b09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.925411:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007dc92fda/0x5953bbf6b3073b09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.925433:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.925443:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.925450:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007dc92fda/0x5953bbf6b3073b09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925474:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7c400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.925479:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007dc92fda/0x5953bbf6b3073b09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925486:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007dc92fda/0x5953bbf6b3073b09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925498:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007dc92fda/0x5953bbf6b3073b09 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925504:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dc92fda/0x5953bbf6b3073b09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.925518:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290291.925520:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.925524:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.925527:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.925529:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e391be7/0x5953bbf6b3073b10 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.925558:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e0:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:3.0:1784290291.925565:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.925571:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e391be7/0x5953bbf6b3073b10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.925585:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e391be7/0x5953bbf6b3073b10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.925598:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e391be7/0x5953bbf6b3073b10 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.925608:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e391be7/0x5953bbf6b3073b10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.925629:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.925635:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.925639:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e391be7/0x5953bbf6b3073b10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925646:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7c000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.925650:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e391be7/0x5953bbf6b3073b10 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925658:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e391be7/0x5953bbf6b3073b10 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925675:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e391be7/0x5953bbf6b3073b10 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925681:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e391be7/0x5953bbf6b3073b10 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.925689:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290291.925697:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.925698:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a491819/0x5953bbf6b3073b17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925700:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.925705:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.925713:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6df:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:3.0:1784290291.925718:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6df:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.925724:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a491819/0x5953bbf6b3073b17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.925739:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a491819/0x5953bbf6b3073b17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.925767:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a491819/0x5953bbf6b3073b17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.925781:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a491819/0x5953bbf6b3073b17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.925802:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.925807:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.925812:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a491819/0x5953bbf6b3073b17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925818:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7d000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.925822:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a491819/0x5953bbf6b3073b17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925829:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a491819/0x5953bbf6b3073b17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925837:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a491819/0x5953bbf6b3073b17 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925843:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a491819/0x5953bbf6b3073b17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.925855:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290291.925862:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000066ddcb3/0x5953bbf6b3073b1e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.925865:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.925868:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.925872:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6de:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:2.0:1784290291.925873:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.925878:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6de:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.925882:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000066ddcb3/0x5953bbf6b3073b1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.925891:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000066ddcb3/0x5953bbf6b3073b1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.925898:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000066ddcb3/0x5953bbf6b3073b1e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.925903:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000066ddcb3/0x5953bbf6b3073b1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.925929:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290291.925957:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290291.925965:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000066ddcb3/0x5953bbf6b3073b1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.925977:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7da00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290291.925982:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000066ddcb3/0x5953bbf6b3073b1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.925983:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290291.925993:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040fd48b2/0x5953bbf6b3073b25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.926003:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000066ddcb3/0x5953bbf6b3073b1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926005:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dd:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:3.0:1784290291.926012:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.926020:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040fd48b2/0x5953bbf6b3073b25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.926032:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000066ddcb3/0x5953bbf6b3073b1e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926033:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040fd48b2/0x5953bbf6b3073b25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.926061:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000066ddcb3/0x5953bbf6b3073b1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926062:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040fd48b2/0x5953bbf6b3073b25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926085:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040fd48b2/0x5953bbf6b3073b25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.926096:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.926101:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290291.926105:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784290291.926107:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040fd48b2/0x5953bbf6b3073b25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.926119:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.926119:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7c800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290291.926133:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040fd48b2/0x5953bbf6b3073b25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.926146:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040fd48b2/0x5953bbf6b3073b25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.926162:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040fd48b2/0x5953bbf6b3073b25 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.926163:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290291.926173:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022520dfe/0x5953bbf6b3073b2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.926183:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040fd48b2/0x5953bbf6b3073b25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926188:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dc:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:3.0:1784290291.926198:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6dc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.926202:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022520dfe/0x5953bbf6b3073b2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.926203:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.926207:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.926210:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.926218:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022520dfe/0x5953bbf6b3073b2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926226:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022520dfe/0x5953bbf6b3073b2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926234:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022520dfe/0x5953bbf6b3073b2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926249:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.926273:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.926278:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022520dfe/0x5953bbf6b3073b2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.926285:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7c200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.926289:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022520dfe/0x5953bbf6b3073b2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.926295:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022520dfe/0x5953bbf6b3073b2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.926306:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022520dfe/0x5953bbf6b3073b2c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.926312:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022520dfe/0x5953bbf6b3073b2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.926315:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290291.926327:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b31484c9/0x5953bbf6b3073b33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926335:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6db:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:2.0:1784290291.926335:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.926354:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.926358:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.926360:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6db:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.926365:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b31484c9/0x5953bbf6b3073b33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926374:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b31484c9/0x5953bbf6b3073b33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926381:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b31484c9/0x5953bbf6b3073b33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926394:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b31484c9/0x5953bbf6b3073b33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926408:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.926417:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.926423:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b31484c9/0x5953bbf6b3073b33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.926441:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7c600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.926446:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b31484c9/0x5953bbf6b3073b33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.926454:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290291.926458:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b31484c9/0x5953bbf6b3073b33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926460:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfc750fe/0x5953bbf6b3073b3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926484:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6da:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:3.0:1784290291.926486:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6da:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290291.926488:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b31484c9/0x5953bbf6b3073b33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926490:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfc750fe/0x5953bbf6b3073b3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.926504:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b31484c9/0x5953bbf6b3073b33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926512:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfc750fe/0x5953bbf6b3073b3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926521:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfc750fe/0x5953bbf6b3073b3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.926522:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.926526:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.926530:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.926537:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfc750fe/0x5953bbf6b3073b3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926560:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.926567:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.926571:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfc750fe/0x5953bbf6b3073b3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.926577:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7cc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.926580:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfc750fe/0x5953bbf6b3073b3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.926587:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfc750fe/0x5953bbf6b3073b3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.926604:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfc750fe/0x5953bbf6b3073b3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.926612:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfc750fe/0x5953bbf6b3073b3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.926619:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290291.926626:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.926627:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000405e2dd1/0x5953bbf6b3073b41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.926630:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.926632:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.926647:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d9:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:3.0:1784290291.926651:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.926657:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000405e2dd1/0x5953bbf6b3073b41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926672:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000405e2dd1/0x5953bbf6b3073b41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926680:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000405e2dd1/0x5953bbf6b3073b41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926687:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000405e2dd1/0x5953bbf6b3073b41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926702:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.926708:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.926712:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000405e2dd1/0x5953bbf6b3073b41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.926719:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7d600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.926721:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000405e2dd1/0x5953bbf6b3073b41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.926728:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000405e2dd1/0x5953bbf6b3073b41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.926738:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000405e2dd1/0x5953bbf6b3073b41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.926745:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000405e2dd1/0x5953bbf6b3073b41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.926754:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290291.926769:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ec3893/0x5953bbf6b3073b48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.926778:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.926781:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d8:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:2.0:1784290291.926782:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.926787:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.926789:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.926797:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003ec3893/0x5953bbf6b3073b48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926809:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003ec3893/0x5953bbf6b3073b48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926838:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003ec3893/0x5953bbf6b3073b48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926849:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003ec3893/0x5953bbf6b3073b48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926871:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290291.926896:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290291.926903:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003ec3893/0x5953bbf6b3073b48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.926914:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7de00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290291.926920:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ec3893/0x5953bbf6b3073b48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.926931:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290291.926932:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003ec3893/0x5953bbf6b3073b48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926942:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c06e1811/0x5953bbf6b3073b4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.926955:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003ec3893/0x5953bbf6b3073b48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926956:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d7:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:3.0:1784290291.926960:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.926966:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c06e1811/0x5953bbf6b3073b4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.926984:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003ec3893/0x5953bbf6b3073b48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.926991:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c06e1811/0x5953bbf6b3073b4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927007:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c06e1811/0x5953bbf6b3073b4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927019:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c06e1811/0x5953bbf6b3073b4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.927035:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.927040:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.927044:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.927061:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.927076:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.927081:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c06e1811/0x5953bbf6b3073b4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.927088:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7d800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.927091:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c06e1811/0x5953bbf6b3073b4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.927097:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c06e1811/0x5953bbf6b3073b4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.927109:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c06e1811/0x5953bbf6b3073b4f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.927115:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c06e1811/0x5953bbf6b3073b4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.927121:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290291.927129:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.927130:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad4d8b84/0x5953bbf6b3073b56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.927133:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.927137:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.927157:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d6:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:3.0:1784290291.927163:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.927170:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad4d8b84/0x5953bbf6b3073b56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927184:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad4d8b84/0x5953bbf6b3073b56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927196:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad4d8b84/0x5953bbf6b3073b56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927208:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad4d8b84/0x5953bbf6b3073b56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927230:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.927233:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.927238:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad4d8b84/0x5953bbf6b3073b56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.927255:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7d200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.927259:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad4d8b84/0x5953bbf6b3073b56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.927280:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad4d8b84/0x5953bbf6b3073b56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.927291:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad4d8b84/0x5953bbf6b3073b56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.927298:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad4d8b84/0x5953bbf6b3073b56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.927309:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290291.927312:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.927316:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.927318:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.927327:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f1828ae/0x5953bbf6b3073b5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927364:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d5:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:3.0:1784290291.927377:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.927384:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f1828ae/0x5953bbf6b3073b5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927399:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f1828ae/0x5953bbf6b3073b5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927412:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f1828ae/0x5953bbf6b3073b5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927420:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f1828ae/0x5953bbf6b3073b5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927440:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.927450:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.927456:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f1828ae/0x5953bbf6b3073b5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.927467:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429de600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.927471:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f1828ae/0x5953bbf6b3073b5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.927479:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f1828ae/0x5953bbf6b3073b5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.927498:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f1828ae/0x5953bbf6b3073b5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.927502:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290291.927505:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f1828ae/0x5953bbf6b3073b5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927515:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002febafc/0x5953bbf6b3073b64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.927525:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.927528:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.927529:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d4:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:2.0:1784290291.927530:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.927537:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.927544:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002febafc/0x5953bbf6b3073b64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927558:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002febafc/0x5953bbf6b3073b64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927568:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002febafc/0x5953bbf6b3073b64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927588:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002febafc/0x5953bbf6b3073b64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927609:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.927615:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.927619:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002febafc/0x5953bbf6b3073b64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.927626:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429df200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.927630:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002febafc/0x5953bbf6b3073b64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.927638:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002febafc/0x5953bbf6b3073b64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.927648:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002febafc/0x5953bbf6b3073b64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.927654:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002febafc/0x5953bbf6b3073b64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.927671:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290291.927679:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.927680:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b683d3f/0x5953bbf6b3073b6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.927683:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.927687:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.927695:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d3:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:3.0:1784290291.927700:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.927705:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b683d3f/0x5953bbf6b3073b6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927716:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b683d3f/0x5953bbf6b3073b6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927729:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b683d3f/0x5953bbf6b3073b6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927740:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b683d3f/0x5953bbf6b3073b6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927764:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290291.927793:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290291.927801:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b683d3f/0x5953bbf6b3073b6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.927812:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429dec00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290291.927818:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b683d3f/0x5953bbf6b3073b6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.927822:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290291.927836:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000848ca66a/0x5953bbf6b3073b72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.927838:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b683d3f/0x5953bbf6b3073b6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927862:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d2:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:1.0:1784290291.927864:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b683d3f/0x5953bbf6b3073b6b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927870:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.927881:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000848ca66a/0x5953bbf6b3073b72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.927883:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b683d3f/0x5953bbf6b3073b6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.927912:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000848ca66a/0x5953bbf6b3073b72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.927922:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.927925:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000848ca66a/0x5953bbf6b3073b72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.927928:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.927936:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000848ca66a/0x5953bbf6b3073b72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.927939:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.927962:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.927977:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.927982:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000848ca66a/0x5953bbf6b3073b72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.927989:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429de800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.927991:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000848ca66a/0x5953bbf6b3073b72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.927997:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000848ca66a/0x5953bbf6b3073b72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.928009:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000848ca66a/0x5953bbf6b3073b72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.928015:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000848ca66a/0x5953bbf6b3073b72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.928022:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290291.928027:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.928031:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.928032:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001acbc350/0x5953bbf6b3073b79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.928034:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.928046:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d1:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:3.0:1784290291.928051:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.928058:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001acbc350/0x5953bbf6b3073b79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928072:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001acbc350/0x5953bbf6b3073b79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928101:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001acbc350/0x5953bbf6b3073b79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928113:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001acbc350/0x5953bbf6b3073b79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928133:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.928144:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.928149:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001acbc350/0x5953bbf6b3073b79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.928166:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429dfc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.928170:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001acbc350/0x5953bbf6b3073b79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.928178:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001acbc350/0x5953bbf6b3073b79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.928188:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001acbc350/0x5953bbf6b3073b79 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.928192:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290291.928194:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001acbc350/0x5953bbf6b3073b79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928201:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013ce9f07/0x5953bbf6b3073b80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.928210:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.928214:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d0:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:2.0:1784290291.928214:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.928218:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.928223:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6d0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.928230:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013ce9f07/0x5953bbf6b3073b80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928245:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013ce9f07/0x5953bbf6b3073b80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928257:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013ce9f07/0x5953bbf6b3073b80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928284:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013ce9f07/0x5953bbf6b3073b80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928321:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.928327:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.928332:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013ce9f07/0x5953bbf6b3073b80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.928338:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429dfe00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.928354:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013ce9f07/0x5953bbf6b3073b80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.928360:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013ce9f07/0x5953bbf6b3073b80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.928376:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013ce9f07/0x5953bbf6b3073b80 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.928384:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013ce9f07/0x5953bbf6b3073b80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.928403:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.928406:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.928408:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784290291.928417:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290291.928426:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c33398c/0x5953bbf6b3073b87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928438:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cf:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:3.0:1784290291.928443:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.928447:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c33398c/0x5953bbf6b3073b87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928459:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c33398c/0x5953bbf6b3073b87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928470:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c33398c/0x5953bbf6b3073b87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928483:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c33398c/0x5953bbf6b3073b87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928502:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290291.928511:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290291.928516:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c33398c/0x5953bbf6b3073b87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.928524:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429de400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290291.928527:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c33398c/0x5953bbf6b3073b87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.928535:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c33398c/0x5953bbf6b3073b87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.928545:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c33398c/0x5953bbf6b3073b87 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.928551:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c33398c/0x5953bbf6b3073b87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.928560:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290291.928574:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000101c9838/0x5953bbf6b3073b8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290291.928583:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.928584:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ce:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:2.0:1784290291.928586:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290291.928588:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.928597:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.928603:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000101c9838/0x5953bbf6b3073b8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928616:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000101c9838/0x5953bbf6b3073b8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928627:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000101c9838/0x5953bbf6b3073b8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928638:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000101c9838/0x5953bbf6b3073b8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928659:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290291.928686:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290291.928694:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000101c9838/0x5953bbf6b3073b8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.928705:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429df400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290291.928711:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000101c9838/0x5953bbf6b3073b8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.928716:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290291.928723:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000101c9838/0x5953bbf6b3073b8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928725:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002092bb5a/0x5953bbf6b3073b95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928752:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cd:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:3.0:1784290291.928757:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290291.928758:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000101c9838/0x5953bbf6b3073b8e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928764:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002092bb5a/0x5953bbf6b3073b95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1784290291.928770:0:15642:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1116 00010000:00010000:1.0:1784290291.928780:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000101c9838/0x5953bbf6b3073b8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928785:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002092bb5a/0x5953bbf6b3073b95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928802:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002092bb5a/0x5953bbf6b3073b95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.928810:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.928815:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.928819:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.928824:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002092bb5a/0x5953bbf6b3073b95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290291.928838:0:15642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:86808:x1870961901042432:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11203us (11337us total) trans 0 rc 0/0 00010000:00010000:3.0:1784290291.928844:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784290291.928850:0:15642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4918 00010000:00010000:1.0:1784290291.928863:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1784290291.928869:0:86808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:86808:1870961901042432:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1784290291.928871:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002092bb5a/0x5953bbf6b3073b95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.928884:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429dee00 already unused, calling callback (ffffffffc0ec3230) 00000004:00080000:2.0:1784290291.928885:0:86808:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x6e1:0x0] from OST, last_created [0x280000401:0x6e1:0x0]last_used is [0x280000401:0x45c:0x0] 00010000:00010000:1.0:1784290291.928891:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002092bb5a/0x5953bbf6b3073b95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.928896:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290291.928907:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c1afbca/0x5953bbf6b3073b9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928932:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cc:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:3.0:1784290291.928937:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290291.928937:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002092bb5a/0x5953bbf6b3073b95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928946:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c1afbca/0x5953bbf6b3073b9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290291.928953:0:86808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468890700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:86808:1870961901042688:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1784290291.928956:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901042560:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784290291.928963:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002092bb5a/0x5953bbf6b3073b95 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.928978:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c1afbca/0x5953bbf6b3073b9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.928981:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002092bb5a/0x5953bbf6b3073b95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290291.928997:0:86808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290291.929007:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784290291.929008:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c1afbca/0x5953bbf6b3073b9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.929019:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c1afbca/0x5953bbf6b3073b9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290291.929027:0:86808:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95180 going to sleep for 11 seconds 00010000:00010000:1.0:1784290291.929027:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.929033:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290291.929037:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784290291.929039:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c1afbca/0x5953bbf6b3073b9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.929050:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429dfa00 already unused, calling callback (ffffffffc0ec3230) 00000100:00100000:2.0:1784290291.929052:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901042688 00010000:00010000:1.0:1784290291.929056:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c1afbca/0x5953bbf6b3073b9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290291.929057:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901042560 00000100:00100000:2.0:1784290291.929058:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901042688 00000100:00100000:0.0:1784290291.929063:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901042560 00010000:00010000:1.0:1784290291.929073:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c1afbca/0x5953bbf6b3073b9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.929090:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c1afbca/0x5953bbf6b3073b9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.929094:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1784290291.929097:0:26262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4920 00000100:00100000:0.0:1784290291.929102:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00010000:00010000:3.0:1784290291.929109:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecf74d3e/0x5953bbf6b3073ba3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.929112:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c1afbca/0x5953bbf6b3073b9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290291.929113:0:26262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:86808:x1870961901042688:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1784290291.929118:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474ece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901042560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784290291.929139:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00010000:00010000:3.0:1784290291.929146:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cb:0x0].0x0 since=2033s v=(0 0) 00002000:00080000:2.0:1784290291.929149:0:26262:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1762 00010000:00010000:3.0:1784290291.929151:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6cb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.929158:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecf74d3e/0x5953bbf6b3073ba3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.929163:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.929167:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.929173:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.929174:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecf74d3e/0x5953bbf6b3073ba3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290291.929179:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474ece300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901042560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290291.929193:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00010000:00010000:3.0:1784290291.929195:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecf74d3e/0x5953bbf6b3073ba3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.929208:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecf74d3e/0x5953bbf6b3073ba3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290291.929226:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901042560:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784290291.929233:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290291.929256:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290291.929274:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecf74d3e/0x5953bbf6b3073ba3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.929280:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.929287:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f5600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290291.929293:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecf74d3e/0x5953bbf6b3073ba3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.929305:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecf74d3e/0x5953bbf6b3073ba3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.929309:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290291.929323:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084ed3959/0x5953bbf6b3073baa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.929326:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecf74d3e/0x5953bbf6b3073ba3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.929365:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecf74d3e/0x5953bbf6b3073ba3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.929369:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ca:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:3.0:1784290291.929379:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.929386:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084ed3959/0x5953bbf6b3073baa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.929399:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.929401:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084ed3959/0x5953bbf6b3073baa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.929404:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.929410:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.929429:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084ed3959/0x5953bbf6b3073baa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.929438:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084ed3959/0x5953bbf6b3073baa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.929460:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290291.929476:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290291.929482:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084ed3959/0x5953bbf6b3073baa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.929490:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f5400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290291.929493:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084ed3959/0x5953bbf6b3073baa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.929509:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084ed3959/0x5953bbf6b3073baa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.929521:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290291.929521:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084ed3959/0x5953bbf6b3073baa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.929536:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084ed3959/0x5953bbf6b3073baa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.929537:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b5c07c7/0x5953bbf6b3073bb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.929556:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c9:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.929559:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.929561:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.929563:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.929567:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.929569:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b5c07c7/0x5953bbf6b3073bb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.929583:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b5c07c7/0x5953bbf6b3073bb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.929593:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b5c07c7/0x5953bbf6b3073bb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.929602:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b5c07c7/0x5953bbf6b3073bb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.929636:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290291.929655:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290291.929661:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b5c07c7/0x5953bbf6b3073bb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.929678:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f4000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290291.929683:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b5c07c7/0x5953bbf6b3073bb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.929694:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b5c07c7/0x5953bbf6b3073bb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.929699:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290291.929708:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecb5999d/0x5953bbf6b3073bb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.929712:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b5c07c7/0x5953bbf6b3073bb1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.929724:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c8:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:1.0:1784290291.929729:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b5c07c7/0x5953bbf6b3073bb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.929730:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.929743:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecb5999d/0x5953bbf6b3073bb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.929756:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.929757:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecb5999d/0x5953bbf6b3073bb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.929760:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.929765:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.929774:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecb5999d/0x5953bbf6b3073bb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.929783:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecb5999d/0x5953bbf6b3073bb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.929802:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290291.929817:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290291.929823:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecb5999d/0x5953bbf6b3073bb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.929829:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f4400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290291.929833:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecb5999d/0x5953bbf6b3073bb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.929840:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecb5999d/0x5953bbf6b3073bb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.929850:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290291.929856:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0bbfcb1/0x5953bbf6b3073bbf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.929858:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecb5999d/0x5953bbf6b3073bb8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.929869:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c7:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:1.0:1784290291.929872:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecb5999d/0x5953bbf6b3073bb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.929882:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.929886:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0bbfcb1/0x5953bbf6b3073bbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.929891:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.929895:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.929896:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0bbfcb1/0x5953bbf6b3073bbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.929897:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.929906:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0bbfcb1/0x5953bbf6b3073bbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.929912:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0bbfcb1/0x5953bbf6b3073bbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.929925:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290291.929943:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290291.929949:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0bbfcb1/0x5953bbf6b3073bbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.929955:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f5a00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290291.929960:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0bbfcb1/0x5953bbf6b3073bbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.929967:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0bbfcb1/0x5953bbf6b3073bbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.929971:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290291.929977:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b314495f/0x5953bbf6b3073bc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.929981:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0bbfcb1/0x5953bbf6b3073bbf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.929983:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c6:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:3.0:1784290291.929991:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.929995:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b314495f/0x5953bbf6b3073bc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.930017:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b314495f/0x5953bbf6b3073bc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.930018:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0bbfcb1/0x5953bbf6b3073bbf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.930040:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b314495f/0x5953bbf6b3073bc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.930052:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.930054:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b314495f/0x5953bbf6b3073bc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.930056:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.930060:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.930074:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290291.930091:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290291.930097:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b314495f/0x5953bbf6b3073bc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.930103:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f4800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290291.930106:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b314495f/0x5953bbf6b3073bc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.930113:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b314495f/0x5953bbf6b3073bc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.930121:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290291.930123:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b314495f/0x5953bbf6b3073bc6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.930128:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c88587c9/0x5953bbf6b3073bcd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.930132:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b314495f/0x5953bbf6b3073bc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.930139:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c5:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:3.0:1784290291.930143:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.930149:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c88587c9/0x5953bbf6b3073bcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.930162:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c88587c9/0x5953bbf6b3073bcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.930167:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.930179:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.930180:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c88587c9/0x5953bbf6b3073bcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.930183:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.930189:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c88587c9/0x5953bbf6b3073bcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.930205:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784290291.930257:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290291.930274:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005856082b/0x5953bbf6b3073bd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.930287:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c4:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.930288:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290291.930290:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.930295:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c88587c9/0x5953bbf6b3073bcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.930296:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005856082b/0x5953bbf6b3073bd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.930331:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f5200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290291.930332:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005856082b/0x5953bbf6b3073bd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.930337:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c88587c9/0x5953bbf6b3073bcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.930364:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c88587c9/0x5953bbf6b3073bcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.930376:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c88587c9/0x5953bbf6b3073bcd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.930378:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005856082b/0x5953bbf6b3073bd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.930396:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c88587c9/0x5953bbf6b3073bcd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.930399:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005856082b/0x5953bbf6b3073bd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.930419:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.930423:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.930436:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290291.930440:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290291.930445:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005856082b/0x5953bbf6b3073bd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.930446:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290291.930454:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f5c00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290291.930458:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005856082b/0x5953bbf6b3073bd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.930466:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005856082b/0x5953bbf6b3073bd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.930475:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005856082b/0x5953bbf6b3073bd4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.930480:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005856082b/0x5953bbf6b3073bd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.930483:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290291.930490:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000924000f3/0x5953bbf6b3073bdb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.930496:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c3:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:0.0:1784290291.930497:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.930499:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290291.930501:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.930505:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000924000f3/0x5953bbf6b3073bdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290291.930506:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.930516:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000924000f3/0x5953bbf6b3073bdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.930533:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000924000f3/0x5953bbf6b3073bdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.930539:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000924000f3/0x5953bbf6b3073bdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.930557:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290291.930571:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290291.930577:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000924000f3/0x5953bbf6b3073bdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.930584:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f4600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290291.930588:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000924000f3/0x5953bbf6b3073bdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.930594:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000924000f3/0x5953bbf6b3073bdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.930606:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000924000f3/0x5953bbf6b3073bdb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.930612:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000924000f3/0x5953bbf6b3073bdb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290291.930618:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290291.930624:0:26255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef37d206/0x5953bbf6b3073be2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.930626:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.930630:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.930634:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c2:0x0].0x0 since=2033s v=(0 0) 00010000:00010000:1.0:1784290291.930635:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290291.930640:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6c2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290291.930644:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef37d206/0x5953bbf6b3073be2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290291.930652:0:26255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef37d206/0x5953bbf6b3073be2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290291.930660:0:26262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:86808:x1870961901042688:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1549us (1665us total) trans 4294968626 rc 0/0 00010000:00010000:3.0:1784290291.930661:0:26255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef37d206/0x5953bbf6b3073be2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290291.930674:0:26262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4920 00010000:00010000:3.0:1784290291.930677:0:26255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef37d206/0x5953bbf6b3073be2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290291.930686:0:86808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468890700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:86808:1870961901042688:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1784290291.930707:0:86808:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x6e1:0x0]-[0x280000401:0x701:0x0] 00010000:00010000:3.0:1784290291.930711:0:26255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290291.930722:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290291.930729:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef37d206/0x5953bbf6b3073be2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.930748:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f4e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290291.930751:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef37d206/0x5953bbf6b3073be2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.930758:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef37d206/0x5953bbf6b3073be2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.930770:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef37d206/0x5953bbf6b3073be2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.930777:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef37d206/0x5953bbf6b3073be2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290291.930789:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.930790:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290291.930792:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1784290291.930994:0:26255:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1666 00000100:00100000:3.0:1784290291.931033:0:26255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:86810:x1870961901042304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13377us (13488us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290291.931040:0:26255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4919 00000100:00100000:2.0:1784290291.931061:0:86810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468539c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:86810:1870961901042304:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1784290291.931070:0:86810:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x6e1:0x0] from OST, last_created [0x2c0000401:0x6e1:0x0]last_used is [0x2c0000401:0x682:0x0] 00000100:00100000:2.0:1784290291.931107:0:86810:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:86810:1870961901042944:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1784290291.931118:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784290291.931130:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901042816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290291.931134:0:86810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290291.931160:0:86810:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246d46a240 going to sleep for 11 seconds 00000100:00100000:0.0:1784290291.931172:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290291.931177:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901042944 00000100:00100000:3.0:1784290291.931182:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901042944 00000100:00100000:2.0:1784290291.931209:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901042816 00000100:00100000:2.0:1784290291.931214:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901042816 00000100:00100000:3.0:1784290291.931223:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4921 00000100:00100000:3.0:1784290291.931232:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:86810:x1870961901042944:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1784290291.931253:0:8404:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1762 00000100:00100000:2.0:1784290291.931258:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:2.0:1784290291.931290:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901042816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784290291.931304:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 896 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784290291.931370:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901042816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290291.931378:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:0.0:1784290291.931382:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901042816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784290291.932216:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:86810:x1870961901042944:12345-0@lo:5:osp-pre-1-0.0 Request processed in 985us (1082us total) trans 4294968626 rc 0/0 00000100:00100000:3.0:1784290291.932224:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4921 00000100:00100000:2.0:1784290291.932251:0:86810:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:86810:1870961901042944:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1784290291.932258:0:86810:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x6e1:0x0]-[0x2c0000401:0x701:0x0] 00010000:00010000:1.0:1784290292.391406:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784290292.905507:0:75386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1784290293.415477:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290293.927534:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901043072:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784290293.927534:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245f7ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901043200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784290293.927631:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290293.927694:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901043200 00000100:00100000:2.0:1784290293.927704:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901043200 00000100:00100000:0.0:1784290293.927730:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290293.927785:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901043072 00000100:00100000:2.0:1784290293.927790:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901043072 00000100:00100000:0.0:1784290293.927799:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1784290293.927818:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901043200:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290293.927837:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:2.0:1784290293.927853:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901043072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784290293.927854:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1784290293.927888:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290293.927931:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901043200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290293.927943:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:2.0:1784290293.927980:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901043072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290293.927990:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00080000:0.0:1784290293.928007:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784290293.928017:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290293.928028:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245f7ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901043200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290293.928073:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901043072:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1784290294.056753:0:87371:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00000100:00100000:0.0:1784290294.278402:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290294.278440:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290294.278465:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290294.278521:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290294.278538:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896213376 00000100:00100000:1.0:1784290294.278544:0:86800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896213248 00000100:00100000:2.0:1784290294.278562:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896213376 00000100:00100000:3.0:1784290294.278564:0:26254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896213632 00000100:00100000:1.0:1784290294.278580:0:86800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896213248 00000100:00100000:3.0:1784290294.278589:0:26254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896213632 00000100:00100000:0.0:1784290294.278610:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290294.278645:0:86800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:2.0:1784290294.278646:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896213504 00000100:00100000:2.0:1784290294.278651:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896213504 00000100:00100000:3.0:1784290294.278656:0:26254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896213760 00000100:00100000:1.0:1784290294.278671:0:86800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e4d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdffa268-fb6a-4248-991c-0ad16fac303f+10:2398:x1870961896213248:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290294.278673:0:26254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896213760 00000100:00100000:2.0:1784290294.278700:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 637 00000100:00100000:2.0:1784290294.278715:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2397:x1870961896213376:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290294.278718:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 638 00000100:00100000:3.0:1784290294.278722:0:26254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1512 00000100:00100000:3.0:1784290294.278740:0:26254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2397:x1870961896213632:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290294.278744:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896213504:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290294.278756:0:86800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e4d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdffa268-fb6a-4248-991c-0ad16fac303f+10:2398:x1870961896213248:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 99us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290294.278764:0:86800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:2.0:1784290294.278779:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2397:x1870961896213376:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 68us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290294.278808:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 637 00000100:00100000:3.0:1784290294.278809:0:26254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2397:x1870961896213632:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 71us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290294.278819:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896213504:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 83us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290294.278826:0:26254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1512 00000100:00100000:0.0:1784290294.278837:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 638 00000100:00080000:1.0:1784290294.278839:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784290294.278847:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784290294.278853:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784290294.278854:0:26257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1513 00000100:00080000:1.0:1784290294.278859:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784290294.278871:0:26257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2398:x1870961896213760:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290294.278920:0:26257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2398:x1870961896213760:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 53us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290294.278932:0:26257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1513 00010000:00010000:0.0:1784290294.439501:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784290294.670663:0:87419:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1784290295.463653:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290296.012617:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290296.012676:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896213888 00000100:00100000:2.0:1784290296.012687:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896213888 00000100:00100000:2.0:1784290296.012753:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1050 00000100:00080000:1.0:1784290296.012753:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784290296.012766:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:66998:x1870961896213888:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1784290296.012784:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290296.012802:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073be9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2256 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.012856:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b3073bf0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.012868:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b3073bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.012877:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b3073bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784290296.012919:0:66004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784290296.012933:0:66004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784290296.012957:0:66004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b3073bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.012976:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073be9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2256 expref: 8 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.012989:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b3073bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2256 expref: 7 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.012996:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2449f0db00) 00010000:00010000:2.0:1784290296.012998:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784290296.013000:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebee00, rc 0) 00000100:00100000:2.0:1784290296.013049:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:66998:x1870961896213888:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 286us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290296.013054:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1050 00000100:00100000:1.0:1784290296.014690:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290296.014744:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896214016 00000100:00100000:2.0:1784290296.014749:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896214016 00000100:00100000:2.0:1784290296.014781:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1051 00000100:00100000:2.0:1784290296.014787:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246853ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:66998:x1870961896214016:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:2.0:1784290296.014808:0:74876:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444651008 avail 1298411520 00000100:00100000:2.0:1784290296.014841:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246853ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:66998:x1870961896214016:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 54us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290296.014846:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1051 00000100:00100000:0.0:1784290296.015530:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290296.015569:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896214144 00000100:00100000:2.0:1784290296.015574:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896214144 00000100:00100000:2.0:1784290296.015614:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1052 00000100:00100000:2.0:1784290296.015623:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:66998:x1870961896214144:12345-192.168.202.6@tcp:41:lfs.0 00000100:00080000:1.0:1784290296.015624:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:2.0:1784290296.015651:0:65988:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:2.0:1784290296.015694:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:66998:x1870961896214144:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 72us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290296.015703:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1052 00000100:00100000:0.0:1784290296.016734:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290296.016772:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896214272 00000100:00100000:2.0:1784290296.016777:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896214272 00000100:00100000:2.0:1784290296.016817:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1138 00000100:00100000:2.0:1784290296.016825:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:66998:x1870961896214272:12345-192.168.202.6@tcp:13:lfs.0 00000100:00080000:1.0:1784290296.016829:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1784290296.016843:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784290296.016877:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:66998:x1870961896214272:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 53us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290296.016882:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1138 00000100:00100000:1.0:1784290296.017528:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290296.017558:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896214400 00000100:00100000:2.0:1784290296.017562:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896214400 00000100:00080000:1.0:1784290296.017593:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784290296.017601:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1139 00000100:00100000:2.0:1784290296.017609:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:66998:x1870961896214400:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:2.0:1784290296.017623:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784290296.017658:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468538700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:66998:x1870961896214400:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 50us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290296.017666:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1139 00000100:00100000:0.0:1784290296.029473:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290296.029547:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896214528 00000100:00100000:1.0:1784290296.029555:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896214528 00000100:00100000:1.0:1784290296.029600:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1053 00000100:00100000:1.0:1784290296.029610:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:67014:x1870961896214528:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1784290296.029625:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290296.029642:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b3073bf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b225d expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.029687:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236dc00/0x5953bbf6b3073bfe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.029700:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236dc00/0x5953bbf6b3073bfe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.029711:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236dc00/0x5953bbf6b3073bfe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.029736:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d200/0x5953bbf6b3073c05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.029744:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d200/0x5953bbf6b3073c05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.029752:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d200/0x5953bbf6b3073c05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.029830:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b3073c0c lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.029840:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b3073c0c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.029847:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b3073c0c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290296.029877:0:66008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1784290296.029881:0:66008:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784290296.029898:0:66008:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b3073c0c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.029911:0:66008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236dc00/0x5953bbf6b3073bfe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.029918:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236dc00/0x5953bbf6b3073bfe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.029924:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236dc00/0x5953bbf6b3073bfe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.029943:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236dc00/0x5953bbf6b3073bfe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.029949:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236dc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290296.029953:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236dc00/0x5953bbf6b3073bfe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.029963:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236dc00/0x5953bbf6b3073bfe lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.029974:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2449f0db00) 00010000:00010000:1.0:1784290296.029977:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290296.029981:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236dc00/0x5953bbf6b3073bfe lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.029988:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236dc00/0x5953bbf6b3073bfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.030000:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d200/0x5953bbf6b3073c05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.030007:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d200/0x5953bbf6b3073c05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.030013:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d200/0x5953bbf6b3073c05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.030019:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290296.030022:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d200/0x5953bbf6b3073c05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.030038:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d200/0x5953bbf6b3073c05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.030047:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9c246de62e00) 00010000:00010000:1.0:1784290296.030049:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290296.030052:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d200/0x5953bbf6b3073c05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.030059:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d200/0x5953bbf6b3073c05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.030085:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b3073bf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b225d expref: 9 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.030099:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b3073c0c lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b225d expref: 8 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.030106:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c246de62600) 00010000:00010000:1.0:1784290296.030109:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784290296.030112:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236d800, rc 0) 00000100:00100000:1.0:1784290296.030153:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:67014:x1870961896214528:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 545us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290296.030162:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1053 00000100:00100000:0.0:1784290296.031386:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290296.031421:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896214784 00000100:00100000:1.0:1784290296.031428:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896214784 00000100:00100000:1.0:1784290296.031464:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1054 00000100:00100000:1.0:1784290296.031471:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:67014:x1870961896214784:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1784290296.031491:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290296.031501:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3073c13 lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2264 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031545:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c600/0x5953bbf6b3073c1a lrc: 3/1,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031554:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c600/0x5953bbf6b3073c1a lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031562:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c600/0x5953bbf6b3073c1a lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031573:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b3073c21 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031582:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b3073c21 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031590:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b3073c21 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031626:0:65989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c600/0x5953bbf6b3073c1a lrc: 4/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031634:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c600/0x5953bbf6b3073c1a lrc: 4/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031640:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c600/0x5953bbf6b3073c1a lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031646:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c600/0x5953bbf6b3073c1a lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031658:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290296.031662:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c600/0x5953bbf6b3073c1a lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031667:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c600/0x5953bbf6b3073c1a lrc: 5/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031676:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c246de62600) 00010000:00010000:1.0:1784290296.031679:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290296.031682:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c600/0x5953bbf6b3073c1a lrc: 3/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031688:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c600/0x5953bbf6b3073c1a lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031699:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b3073c21 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031707:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b3073c21 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031713:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b3073c21 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031719:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290296.031722:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b3073c21 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031728:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b3073c21 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031747:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9c246de62200) 00010000:00010000:1.0:1784290296.031750:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290296.031753:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b3073c21 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031760:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b3073c21 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031786:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3073c13 lrc: 1/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2264 expref: 9 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031796:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c246de62600) 00010000:00010000:1.0:1784290296.031798:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784290296.031802:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3073c13 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2264 expref: 9 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290296.031810:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236c800, rc 0) 00000100:00100000:1.0:1784290296.031844:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:67014:x1870961896214784:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 374us (459us total) trans 0 rc 301/301 00000100:00100000:1.0:1784290296.031852:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1054 00000100:00100000:2.0:1784290296.032925:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290296.032968:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896215040 00000100:00100000:0.0:1784290296.032974:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896215040 00000100:00100000:0.0:1784290296.033002:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1055 00000100:00100000:0.0:1784290296.033010:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245f7ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:67014:x1870961896215040:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1784290296.033019:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290296.033028:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26e00/0x5953bbf6b3073c28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b226b expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290296.033069:0:65990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1784290296.033146:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26e00/0x5953bbf6b3073c28 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b226b expref: 10 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290296.033154:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2449f0db00) 00010000:00010000:0.0:1784290296.033156:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784290296.033159:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26e00/0x5953bbf6b3073c28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b226b expref: 10 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290296.033167:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26e00, rc 0) 00000100:00100000:0.0:1784290296.033195:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245f7ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:67014:x1870961896215040:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 187us (272us total) trans 103079215105 rc 301/301 00000100:00100000:0.0:1784290296.033201:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1055 00000100:00100000:0.0:1784290296.033968:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290296.034014:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896215168 00000100:00100000:2.0:1784290296.034019:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896215168 00000100:00100000:2.0:1784290296.034046:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1056 00000100:00100000:2.0:1784290296.034051:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:67014:x1870961896215168:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:2.0:1784290296.034088:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b3073c36 lrc: 3/1,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034096:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b3073c36 lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034102:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b3073c36 lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034122:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3073c3d lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034127:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3073c3d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034132:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3073c3d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034162:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073c44 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034167:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073c44 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034171:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073c44 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784290296.034189:0:66004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784290296.034194:0:66004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073c44 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034204:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b3073c36 lrc: 4/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034217:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b3073c36 lrc: 4/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034236:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b3073c36 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034243:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b3073c36 lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034249:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290296.034253:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b3073c36 lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034261:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b3073c36 lrc: 5/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034271:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9c246de62600) 00010000:00010000:2.0:1784290296.034274:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290296.034278:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b3073c36 lrc: 3/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034284:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b3073c36 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034296:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3073c3d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034304:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3073c3d lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034311:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3073c3d lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034324:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebea00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290296.034328:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3073c3d lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034335:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3073c3d lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034371:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9c2449f0dd00) 00010000:00010000:2.0:1784290296.034375:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290296.034379:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3073c3d lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034387:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3073c3d lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034401:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073c44 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034408:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073c44 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034415:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073c44 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034420:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebfa00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290296.034423:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073c44 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034427:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073c44 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034441:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9c2449f0dc00) 00010000:00010000:2.0:1784290296.034443:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290296.034445:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073c44 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290296.034449:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3073c44 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290296.034486:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:67014:x1870961896215168:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 434us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290296.034492:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1056 00000100:00100000:3.0:1784290296.035248:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290296.035295:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896215424 00000100:00100000:1.0:1784290296.035301:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896215424 00000100:00100000:1.0:1784290296.035336:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 216 00000100:00100000:1.0:1784290296.035374:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:67014:x1870961896215424:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:1.0:1784290296.035489:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:67014:x1870961896215424:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 118us (243us total) trans 103079215106 rc 0/0 00000100:00100000:1.0:1784290296.035499:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 216 00010000:00010000:1.0:1784290296.487455:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290296.999497:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468539880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901043456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784290296.999528:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901043584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784290296.999590:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290296.999599:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290296.999615:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901043328:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784290296.999658:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1870961901043968:0@lo:400:kworker.0 00000100:00100000:2.0:1784290296.999663:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290296.999678:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1870961901044096:0@lo:400:kworker.0 00000100:00100000:2.0:1784290296.999693:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1870961901043840:0@lo:400:kworker.0 00000100:00100000:3.0:1784290296.999705:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290296.999726:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901043584 00000100:00100000:0.0:1784290296.999733:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901043584 00000100:00100000:1.0:1784290296.999750:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901043712:0@lo:400:kworker.0 00000100:00100000:2.0:1784290296.999779:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901043456 00000100:00100000:3.0:1784290296.999780:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901044480:0@lo:400:kworker.0 00000100:00100000:2.0:1784290296.999785:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901043456 00000100:00100000:1.0:1784290296.999796:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290296.999824:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290296.999826:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901043328 00000100:00100000:2.0:1784290296.999829:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901043328 00000100:00100000:0.0:1784290296.999847:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:1.0:1784290296.999848:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1870961901044224:0@lo:400:kworker.0 00000100:00100000:3.0:1784290296.999859:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447cc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1870961901044992:0@lo:400:kworker.0 00000100:00100000:0.0:1784290296.999862:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901043584:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290296.999869:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3754 00000100:00100000:2.0:1784290296.999880:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1870961901043456:12345-0@lo:41:osp-pre-0-1.0 00002000:00000024:0.0:1784290296.999886:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290296.999887:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290296.999912:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3755 00000004:00000024:2.0:1784290296.999917:0:23867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444651008 avail 1298411520 00000100:00100000:3.0:1784290296.999926:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245f7ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901043328:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784290296.999926:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901044736:0@lo:400:kworker.0 00000100:00100000:0.0:1784290296.999947:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468539c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901043584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (351us total) trans 0 rc 0/0 00000004:00000024:3.0:1784290296.999963:0:8412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:0.0:1784290296.999966:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:1.0:1784290296.999985:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290296.999986:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1870961901043456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (396us total) trans 0 rc 0/0 00000100:00080000:0.0:1784290296.999993:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784290296.999998:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3754 00000100:00100000:1.0:1784290297.000031:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784290297.000031:0:86797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901043712 00000100:00100000:2.0:1784290297.000035:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901044736 00000100:00100000:0.0:1784290297.000039:0:86797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901043712 00000100:00100000:2.0:1784290297.000041:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901044736 00000100:00100000:3.0:1784290297.000042:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245f7ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901043328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290297.000044:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245f7ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901045120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784290297.000059:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3755 00000100:00100000:2.0:1784290297.000075:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3756 00000100:00100000:1.0:1784290297.000089:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290297.000089:0:86797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784290297.000096:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246853b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901044736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290297.000102:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901043968 00000100:00100000:0.0:1784290297.000104:0:86797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e4d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3618:x1870961901043712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290297.000107:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901043968 00000100:00100000:1.0:1784290297.000141:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901044224 00000100:00100000:1.0:1784290297.000147:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901044224 00000100:00100000:2.0:1784290297.000161:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246853b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901044736:12345-0@lo:400:kworker.0 Request processed in 68us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290297.000167:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:0.0:1784290297.000167:0:86797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e4d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3618:x1870961901043712:12345-0@lo:400:kworker.0 Request processed in 64us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290297.000174:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3756 00000100:00100000:3.0:1784290297.000180:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1870961901043968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290297.000180:0:86797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784290297.000199:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:1.0:1784290297.000230:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246853b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1870961901044224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290297.000235:0:26260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901044480 00000100:00100000:2.0:1784290297.000256:0:26260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901044480 00000100:00100000:3.0:1784290297.000257:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1870961901043968:12345-0@lo:400:kworker.0 Request processed in 64us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290297.000266:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:1.0:1784290297.000297:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246853b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1870961901044224:12345-0@lo:400:kworker.0 Request processed in 86us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290297.000298:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901045120 00000100:00100000:2.0:1784290297.000298:0:26260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:3.0:1784290297.000306:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901045120 00000100:00100000:2.0:1784290297.000312:0:26260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901044480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290297.000313:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:3.0:1784290297.000376:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1784290297.000387:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901045120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784290297.000399:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784290297.000863:0:26260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901044480:12345-0@lo:400:kworker.0 Request processed in 47us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290297.000869:0:26260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00100000:1.0:1784290297.001028:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901043712:0@lo:400:kworker.0 00000100:00100000:0.0:1784290297.001028:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290297.001047:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468538a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901045120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 661us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290297.001058:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1870961901044224:0@lo:400:kworker.0 00000100:00100000:3.0:1784290297.001060:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:0.0:1784290297.001072:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901044352:0@lo:400:kworker.0 00000100:00100000:1.0:1784290297.001099:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901044736:0@lo:400:kworker.0 00000100:00100000:3.0:1784290297.001122:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901043840 00000100:00100000:3.0:1784290297.001129:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901043840 00000100:00100000:0.0:1784290297.001130:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290297.001167:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245f7ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901045120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784290297.001173:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901044864:0@lo:400:kworker.0 00000100:00100000:3.0:1784290297.001177:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:3.0:1784290297.001195:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1870961901043840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290297.001236:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290297.001286:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1870961901043840:12345-0@lo:400:kworker.0 Request processed in 96us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290297.001295:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:0.0:1784290297.001315:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901043328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784290297.001317:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290297.001329:0:26261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901044352 00000100:00100000:3.0:1784290297.001333:0:26261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901044352 00000100:00100000:0.0:1784290297.001341:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1870961901043840:0@lo:400:kworker.0 00000100:00100000:1.0:1784290297.001354:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1870961901044608:0@lo:400:kworker.0 00000100:00100000:1.0:1784290297.001411:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290297.001419:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901044864 00000100:00100000:0.0:1784290297.001425:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901044864 00000100:00100000:3.0:1784290297.001429:0:26261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1515 00000100:00100000:3.0:1784290297.001440:0:26261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901044352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290297.001456:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901043584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784290297.001467:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00100000:0.0:1784290297.001479:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901044864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290297.001496:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901044096 00000100:00100000:3.0:1784290297.001497:0:26261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901044352:12345-0@lo:400:kworker.0 Request processed in 59us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290297.001500:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901044096 00000100:00100000:3.0:1784290297.001511:0:26261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1515 00000100:00100000:0.0:1784290297.001522:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901044864:12345-0@lo:400:kworker.0 Request processed in 46us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290297.001530:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00100000:1.0:1784290297.001538:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901044608 00000100:00100000:1.0:1784290297.001541:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901044608 00000100:00080000:3.0:1784290297.001543:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784290297.001550:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784290297.001554:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784290297.001559:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784290297.001570:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:1.0:1784290297.001578:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1870961901044096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290297.001595:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901044352:0@lo:400:kworker.0 00000100:00100000:3.0:1784290297.001604:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:3.0:1784290297.001616:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1870961901044608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290297.001625:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901044864:0@lo:400:kworker.0 00000100:00100000:1.0:1784290297.001637:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468538000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1870961901044096:12345-0@lo:400:kworker.0 Request processed in 58us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290297.001645:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:3.0:1784290297.001666:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1870961901044608:12345-0@lo:400:kworker.0 Request processed in 51us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290297.001675:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:0.0:1784290297.001689:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290297.001698:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901044992 00000100:00100000:1.0:1784290297.001700:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1870961901044096:0@lo:400:kworker.0 00000100:00100000:3.0:1784290297.001703:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901044992 00000100:00100000:1.0:1784290297.001727:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1870961901044608:0@lo:400:kworker.0 00000100:00100000:0.0:1784290297.001735:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1870961901043968:0@lo:400:kworker.0 00000100:00100000:3.0:1784290297.001736:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:3.0:1784290297.001745:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1870961901044992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290297.001755:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901044480:0@lo:400:kworker.0 00000100:00100000:0.0:1784290297.001777:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468539880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901043456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784290297.001784:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1870961901044992:12345-0@lo:400:kworker.0 Request processed in 40us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290297.001796:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:0.0:1784290297.001810:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447cc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1870961901044992:0@lo:400:kworker.0 00010000:00010000:1.0:1784290297.511891:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784290297.512420:0:86790:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215106 is committed 00000001:00080000:3.0:1784290297.512887:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968626 is committed 00000001:00080000:2.0:1784290297.514172:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968626 is committed 00000001:02000400:0.0:1784290298.134885:0:87613:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 131a: DoM file write lock replay === 08:11:37 (1784290297) 00000100:00100000:1.0:1784290298.202085:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290298.202148:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896215552 00000100:00100000:0.0:1784290298.202162:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896215552 00000100:00080000:3.0:1784290298.202262:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784290298.202273:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1057 00000100:00100000:0.0:1784290298.202292:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:67597:x1870961896215552:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1784290298.202321:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290298.202369:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073c4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2272 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202444:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073c52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202462:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073c52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202477:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073c52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202496:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3073c59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202520:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3073c59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202530:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3073c59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202578:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073c52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202587:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073c52 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202595:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073c52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202602:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290298.202607:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073c52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202616:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073c52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202629:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2449f0db00) 00010000:00010000:0.0:1784290298.202633:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290298.202638:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073c52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202645:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073c52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202658:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3073c59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202674:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3073c59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202681:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3073c59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202687:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27e00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290298.202690:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3073c59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202698:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3073c59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202708:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9c247b1d0b00) 00010000:00010000:0.0:1784290298.202711:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290298.202714:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3073c59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202721:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3073c59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202758:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073c4b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2272 expref: 9 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202770:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2449f0db00) 00010000:00010000:0.0:1784290298.202773:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290298.202778:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073c4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2272 expref: 9 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.202805:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27c00, rc 0) 00000100:00100000:0.0:1784290298.202877:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:67597:x1870961896215552:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 592us (804us total) trans 0 rc 301/301 00000100:00100000:0.0:1784290298.202886:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1057 00000100:00100000:0.0:1784290298.205123:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290298.205235:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896215808 00000100:00100000:1.0:1784290298.205263:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896215808 00000100:00100000:1.0:1784290298.205332:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1058 00000100:00100000:1.0:1784290298.205389:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:67597:x1870961896215808:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1784290298.205407:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290298.205412:0:65989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784290298.205439:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b3073bf0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2256 expref: 8 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.205486:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2449f0db00) 00010000:00010000:1.0:1784290298.205502:0:65989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290298.205526:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3073c60 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2279 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.205612:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073c67 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.205629:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073c67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.205643:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073c67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.205666:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3073c6e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.205678:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3073c6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.205691:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3073c6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.206259:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3073c75 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.206277:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3073c75 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.206290:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3073c75 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290298.206317:0:65989:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x6:0x0]: returning size 0 00010000:00010000:1.0:1784290298.206386:0:65989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073c67 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.206401:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073c67 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.206413:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073c67 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.206424:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073c67 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.206434:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429dee00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290298.206440:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073c67 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.206451:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073c67 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.206469:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62f00) 00010000:00010000:1.0:1784290298.206475:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290298.206481:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073c67 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.206493:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073c67 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784290298.206519:0:65989:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002cccb927 reply state 00000000fef4f3c1 transno 103079215107 ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3073c6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.206557:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3073c6e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.206569:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9c246de62400) 00010000:00010000:1.0:1784290298.206575:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784290298.206579:0:65989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784290298.206616:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3073c60 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2279 expref: 10 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.206657:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3073c75 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2279 expref: 9 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.206670:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c246de62300) 00010000:00010000:1.0:1784290298.206675:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784290298.206679:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24429dfa00, rc 0) 00000100:00100000:1.0:1784290298.206737:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:67597:x1870961896215808:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 1392us (1616us total) trans 103079215107 rc 0/0 00000100:00100000:1.0:1784290298.206750:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1058 00000100:00100000:3.0:1784290298.208642:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290298.208700:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896216064 00000100:00100000:0.0:1784290298.208708:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896216064 00000100:00100000:0.0:1784290298.208765:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1059 00000100:00100000:0.0:1784290298.208779:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:67597:x1870961896216064:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1784290298.208795:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290298.208811:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3073c83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2280 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.208877:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073c8a lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.208891:0:66004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3073c75 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2279 expref: 11 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.208900:0:66004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073c8a lrc: 4/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.208935:0:66004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3073c75 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2279 expref: 11 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.208949:0:66004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3073c75 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2279 expref: 11 pid: 65989 timeout: 2139 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290298.208981:0:66004:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66004:1870961901045248:192.168.202.6@tcp:104: 00000100:00100000:0.0:1784290298.209079:0:66004:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23448fc240 going to sleep for 11 seconds 00000100:00100000:1.0:1784290298.210569:0:66004:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66004:1870961901045248:192.168.202.6@tcp:104: 00000100:00100000:3.0:1784290298.210575:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:1.0:1784290298.210602:0:66004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073c8a lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290298.210622:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896216192 00000100:00100000:3.0:1784290298.210629:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896216192 00010000:00010000:3.0:1784290298.210720:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3073c75 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2279 expref: 12 pid: 65989 timeout: 2139 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290298.210759:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2577 00000100:00100000:3.0:1784290298.210772:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245818e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:2400:x1870961896216192:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784290298.210786:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290298.210793:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3073c75 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2279 expref: 12 pid: 65989 timeout: 2139 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290298.210809:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3073c75 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2279 expref: 12 pid: 65989 timeout: 2139 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290298.210825:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3073c75 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2279 expref: 12 pid: 65989 timeout: 2139 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290298.210840:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c246de62300) 00010000:00010000:3.0:1784290298.210845:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073c8a lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290298.210854:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073c8a lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290298.210869:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073c8a lrc: 4/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290298.210896:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290298.210923:0:66004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073c8a lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.210936:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073c8a lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290298.210937:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245818e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:2400:x1870961896216192:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 166us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290298.210956:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2577 00000004:00200000:1.0:1784290298.210988:0:66004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x6:0x0]: returning size 0 00010000:00010000:1.0:1784290298.211143:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073c8a lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.211153:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073c8a lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.211160:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073c8a lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.211165:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26c00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290298.211169:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073c8a lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.211175:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073c8a lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.211185:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c246de62300) 00010000:00010000:1.0:1784290298.211188:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784290298.211191:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073c8a lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.211197:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073c8a lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.211283:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3073c83 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2280 expref: 11 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.211292:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c247b1d0400) 00010000:00010000:1.0:1784290298.211295:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784290298.211307:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3073c83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2280 expref: 11 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.211321:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26a00, rc 0) 00000100:00100000:1.0:1784290298.211406:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:67597:x1870961896216064:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 2628us (2766us total) trans 103079215108 rc 301/301 00000100:00100000:1.0:1784290298.211415:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1059 00000100:00100000:2.0:1784290298.212928:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290298.212958:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896216448 00000100:00100000:2.0:1784290298.212964:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896216448 00000100:00100000:2.0:1784290298.213007:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 217 00000100:00100000:2.0:1784290298.213021:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245f7eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:67597:x1870961896216448:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1784290298.213220:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245f7eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:67597:x1870961896216448:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 185us (276us total) trans 103079215109 rc 0/0 00000100:00100000:2.0:1784290298.213234:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 217 00000100:00100000:3.0:1784290298.214339:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290298.214473:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896216704 00000100:00100000:3.0:1784290298.214479:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896216704 00000100:00100000:3.0:1784290298.214518:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 218 00000100:00100000:3.0:1784290298.214529:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:67597:x1870961896216704:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1784290298.214699:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:67597:x1870961896216704:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 170us (358us total) trans 103079215110 rc 0/0 00000100:00100000:3.0:1784290298.214709:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 218 00000001:00080000:1.0:1784290298.531160:0:86790:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215110 is committed 00010000:00010000:3.0:1784290298.531186:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3073c6e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290298.531197:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3073c6e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290298.531215:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3073c6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290298.531220:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429de800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290298.531225:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3073c6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290298.531240:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3073c6e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290298.531255:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9c246de62400) 00010000:00010000:3.0:1784290298.531258:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290298.531261:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3073c6e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290298.531266:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3073c6e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.536438:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290298.547686:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290298.547758:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896216832 00000100:00100000:1.0:1784290298.547767:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896216832 00000100:00100000:1.0:1784290298.547819:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1060 00000100:00100000:1.0:1784290298.547828:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:67613:x1870961896216832:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1784290298.547849:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290298.547865:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de400/0x5953bbf6b3073c98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2287 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.547920:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3073c9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.547931:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3073c9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.547939:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3073c9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290298.547974:0:66008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784290298.547977:0:66008:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784290298.547992:0:66008:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3073c9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.548020:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de400/0x5953bbf6b3073c98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2287 expref: 9 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.548033:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3073c9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2287 expref: 8 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.548039:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62800) 00010000:00010000:1.0:1784290298.548042:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784290298.548044:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24429de800, rc 0) 00000100:00100000:1.0:1784290298.548093:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:67613:x1870961896216832:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 267us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290298.548098:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1060 00000100:00100000:3.0:1784290298.549682:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290298.549712:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896216960 00000100:00100000:1.0:1784290298.549717:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896216960 00000100:00100000:1.0:1784290298.549750:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1061 00000100:00100000:1.0:1784290298.549760:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:67613:x1870961896216960:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:1.0:1784290298.549781:0:65990:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444651008 avail 1298411520 00000100:00100000:1.0:1784290298.549817:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:67613:x1870961896216960:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 61us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290298.549824:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1061 00000100:00100000:3.0:1784290298.550471:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290298.550507:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896217088 00000100:00100000:0.0:1784290298.550512:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896217088 00000100:00080000:3.0:1784290298.550541:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784290298.550553:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1062 00000100:00100000:0.0:1784290298.550562:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:67613:x1870961896217088:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:0.0:1784290298.550581:0:65988:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:0.0:1784290298.550627:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:67613:x1870961896217088:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 65us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290298.550635:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1062 00000100:00100000:0.0:1784290298.551571:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290298.551607:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896217216 00000100:00100000:1.0:1784290298.551612:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896217216 00000100:00100000:1.0:1784290298.551650:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1142 00000100:00080000:3.0:1784290298.551653:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290298.551659:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:67613:x1870961896217216:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:1.0:1784290298.551680:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290298.551721:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:67613:x1870961896217216:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 64us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290298.551728:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1142 00000100:00100000:3.0:1784290298.552376:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290298.552412:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896217344 00000100:00100000:0.0:1784290298.552419:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896217344 00000100:00080000:3.0:1784290298.552456:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290298.552474:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1143 00000100:00100000:0.0:1784290298.552485:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:67613:x1870961896217344:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:0.0:1784290298.552507:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290298.552553:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:67613:x1870961896217344:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 69us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290298.552563:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1143 00000100:00100000:3.0:1784290298.568877:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290298.568955:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896217600 00000100:00100000:0.0:1784290298.568963:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896217600 00000100:00100000:0.0:1784290298.569005:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1063 00000100:00100000:0.0:1784290298.569012:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:67620:x1870961896217600:12345-192.168.202.6@tcp:36:mcreate.0 00010000:00010000:0.0:1784290298.569063:0:74876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290298.569085:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3073c9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2287 expref: 8 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.569099:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62800) 00010000:00010000:0.0:1784290298.569106:0:74876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290298.569151:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3073ca6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.569161:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3073ca6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.569168:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3073ca6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.569176:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3073cad lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.569180:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3073cad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.569184:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3073cad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.569561:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3073ca6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.569567:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3073ca6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.569572:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3073ca6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.569584:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290298.569587:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3073ca6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.569593:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3073ca6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.569601:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c247b1d0d00) 00010000:00010000:0.0:1784290298.569604:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290298.569606:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3073ca6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.569611:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3073ca6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290298.569623:0:74876:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008c1b23a7 reply state 00000000303253a6 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3073cad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.569631:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3073cad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290298.569636:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c247b1d0800) 00010000:00010000:0.0:1784290298.569638:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290298.569640:0:74876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784290298.569698:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:67620:x1870961896217600:12345-192.168.202.6@tcp:36:mcreate.0 Request processed in 686us (827us total) trans 103079215111 rc 0/0 00000100:00100000:0.0:1784290298.569704:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1063 00000100:00100000:3.0:1784290298.575583:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290298.575617:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896217728 00000100:00100000:3.0:1784290298.575622:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896217728 00000100:00100000:3.0:1784290298.575660:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1064 00000100:00100000:3.0:1784290298.575668:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:67623:x1870961896217728:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:3.0:1784290298.575684:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290298.575700:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4c00/0x5953bbf6b3073cb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b228e expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290298.575738:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5e00/0x5953bbf6b3073cbb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290298.575754:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5e00/0x5953bbf6b3073cbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290298.575762:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5e00/0x5953bbf6b3073cbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290298.575791:0:65989:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784290298.575795:0:65989:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784290298.575816:0:65989:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5e00/0x5953bbf6b3073cbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290298.575840:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4c00/0x5953bbf6b3073cb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b228e expref: 11 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290298.575862:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5e00/0x5953bbf6b3073cbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b228e expref: 10 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290298.575871:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c244ab48500) 00010000:00010000:3.0:1784290298.575874:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784290298.575877:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2f5e00, rc 0) 00000100:00100000:3.0:1784290298.575913:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:67623:x1870961896217728:12345-192.168.202.6@tcp:101:rm.0 Request processed in 246us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290298.575920:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1064 00000100:00100000:2.0:1784290298.576668:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290298.576694:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896217856 00000100:00100000:1.0:1784290298.576699:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896217856 00000100:00100000:1.0:1784290298.576737:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1065 00000100:00100000:1.0:1784290298.576747:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245f7ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:67623:x1870961896217856:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:1.0:1784290298.576755:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290298.576764:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3073cc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2295 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576791:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073cc9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576798:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576804:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576811:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3073cd0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576816:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3073cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576820:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3073cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576857:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3073cd7 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576869:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3073cd7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576875:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3073cd7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290298.576898:0:66004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x7:0x0]: returning size 0 00000004:00200000:1.0:1784290298.576901:0:66004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784290298.576910:0:66004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3073cd7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576917:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3073cd7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576923:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073cc9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576927:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073cc9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576931:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073cc9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576935:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073cc9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576938:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429dee00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290298.576940:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073cc9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576944:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073cc9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576961:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c244ab48500) 00010000:00010000:1.0:1784290298.576964:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290298.576966:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073cc9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576971:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3073cc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576978:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3073cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576982:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3073cd0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576986:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3073cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576989:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429df200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290298.576991:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3073cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576995:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3073cd0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.576999:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c247b1d0800) 00010000:00010000:1.0:1784290298.577001:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290298.577002:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3073cd0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.577006:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3073cd0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.577027:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3073cc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2295 expref: 12 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.577036:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3073cd7 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2295 expref: 11 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.577041:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9c246de62900) 00010000:00010000:1.0:1784290298.577042:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784290298.577044:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24429dfa00, rc 0) 00000100:00100000:1.0:1784290298.577074:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245f7ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:67623:x1870961896217856:12345-192.168.202.6@tcp:101:rm.0 Request processed in 330us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290298.577078:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1065 00000100:00100000:2.0:1784290298.578120:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290298.578191:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896218112 00000100:00100000:1.0:1784290298.578196:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896218112 00000100:00100000:1.0:1784290298.578238:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1066 00000100:00100000:1.0:1784290298.578245:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:67623:x1870961896218112:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:1.0:1784290298.578267:0:66008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1784290298.578277:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3073cd7 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2295 expref: 11 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578288:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9c246de62900) 00010000:00010000:1.0:1784290298.578295:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5e00/0x5953bbf6b3073cbb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b228e expref: 10 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578301:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c244ab48500) 00010000:00010000:1.0:1784290298.578305:0:66008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290298.578320:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3073cde lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578327:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3073cde lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578333:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3073cde lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578359:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df400/0x5953bbf6b3073ce5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578365:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df400/0x5953bbf6b3073ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578371:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df400/0x5953bbf6b3073ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578403:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de600/0x5953bbf6b3073cec lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578409:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de600/0x5953bbf6b3073cec lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578414:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de600/0x5953bbf6b3073cec lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578523:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dec00/0x5953bbf6b3073cf3 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578530:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dec00/0x5953bbf6b3073cf3 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578536:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dec00/0x5953bbf6b3073cf3 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578547:0:66008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dec00/0x5953bbf6b3073cf3 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578551:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dec00/0x5953bbf6b3073cf3 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578555:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dec00/0x5953bbf6b3073cf3 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578577:0:66008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290298.578587:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de600/0x5953bbf6b3073cec lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578591:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de600/0x5953bbf6b3073cec lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290298.578593:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290298.578597:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de600/0x5953bbf6b3073cec lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290298.578600:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dec00/0x5953bbf6b3073cf3 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578602:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429de600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290298.578607:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de600/0x5953bbf6b3073cec lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290298.578614:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429dec00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290298.578616:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de600/0x5953bbf6b3073cec lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578622:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9c246de62a00) 00010000:00010000:1.0:1784290298.578625:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784290298.578628:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de600/0x5953bbf6b3073cec lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290298.578630:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dec00/0x5953bbf6b3073cf3 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290298.578637:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dec00/0x5953bbf6b3073cf3 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578652:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de600/0x5953bbf6b3073cec lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290298.578658:0:7429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9c246de62a00) 00010000:00010000:2.0:1784290298.578661:0:7429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784290298.578664:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dec00/0x5953bbf6b3073cf3 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578665:0:66008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3073cde lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290298.578673:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dec00/0x5953bbf6b3073cf3 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578675:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3073cde lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578683:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3073cde lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578688:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3073cde lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290298.578689:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290298.578692:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290298.578696:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429dfc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290298.578697:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290298.578702:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3073cde lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578706:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3073cde lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578713:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62000) 00010000:00010000:1.0:1784290298.578714:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290298.578716:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3073cde lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578720:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3073cde lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784290298.578730:0:66008:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e2a8ce5f reply state 00000000e8ae3272 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df400/0x5953bbf6b3073ce5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578743:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df400/0x5953bbf6b3073ce5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290298.578748:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c247b1d0800) 00010000:00010000:1.0:1784290298.578750:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784290298.578752:0:66008:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784290298.578785:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:67623:x1870961896218112:12345-192.168.202.6@tcp:36:rm.0 Request processed in 540us (666us total) trans 103079215112 rc 0/0 00000100:00100000:1.0:1784290298.578790:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1066 00000100:00100000:3.0:1784290299.047509:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901045376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784290299.047580:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290299.047628:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901045376 00000100:00100000:0.0:1784290299.047637:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901045376 00000100:00080000:3.0:1784290299.047684:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290299.047707:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1784290299.047727:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901045376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784290299.047750:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290299.047810:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901045376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290299.047817:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:3.0:1784290299.047853:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901045376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784290299.048428:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784290299.048448:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901045504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784290299.048476:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290299.048512:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901045504 00000100:00100000:1.0:1784290299.048519:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901045504 00000100:00080000:3.0:1784290299.048548:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290299.048561:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:1.0:1784290299.048570:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901045504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784290299.048583:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290299.048626:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901045504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290299.048632:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:3.0:1784290299.048649:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901045504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784290299.397554:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290299.397697:0:86796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896218240 00000100:00100000:0.0:1784290299.397713:0:86796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896218240 00000100:00100000:0.0:1784290299.397792:0:86796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 75 00000100:00100000:0.0:1784290299.397806:0:86796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246df9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+10:2399:x1870961896218240:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290299.397901:0:86796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246df9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+10:2399:x1870961896218240:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 97us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290299.397912:0:86796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 75 00010000:00010000:1.0:1784290299.559645:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290300.583529:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784290301.233164:0:88008:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:3.0:1784290301.252319:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290301.252421:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896218368 00000100:00100000:1.0:1784290301.252433:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896218368 00000100:00080000:3.0:1784290301.252484:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784290301.252533:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1067 00000100:00100000:1.0:1784290301.252546:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:67690:x1870961896218368:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:1.0:1784290301.252571:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290301.252594:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3073cfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b229c expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290301.252680:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3073d01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290301.252695:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3073d01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290301.252711:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3073d01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290301.252771:0:65990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784290301.252775:0:65990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784290301.252808:0:65990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3073d01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290301.252836:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3073cfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b229c expref: 13 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290301.252858:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3073d01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b229c expref: 12 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290301.252868:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62200) 00010000:00010000:1.0:1784290301.252872:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784290301.252876:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24429dfe00, rc 0) 00010000:00000080:1.0:1784290301.252884:0:65990:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c246dfd3b80 x1870961896218368/t0(0) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:322/0 lens 576/688 e 0 to 0 dl 1784290312 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290301.252951:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:67690:x1870961896218368:12345-192.168.202.6@tcp:101:dd.0 Request processed in 406us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290301.252961:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1067 00000100:00100000:2.0:1784290301.254064:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290301.254109:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896218624 00000100:00100000:0.0:1784290301.254116:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896218624 00000100:00100000:0.0:1784290301.254158:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1068 00000100:00100000:0.0:1784290301.254168:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:67690:x1870961896218624:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1784290301.254193:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290301.254197:0:65988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784290301.254214:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3073d01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b229c expref: 12 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254229:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62200) 00010000:00010000:0.0:1784290301.254239:0:65988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290301.254249:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b3073d08 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b22a3 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254364:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073d0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254382:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073d0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254393:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073d0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254410:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3073d16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254419:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3073d16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254427:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3073d16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254484:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073d1d lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254494:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073d1d lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254502:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073d1d lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290301.254589:0:65988:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1784290301.254593:0:65988:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 0 -> 1784290298 00000004:00010000:0.0:1784290301.254596:0:65988:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 0 -> 1784290298 00000004:00010000:0.0:1784290301.254599:0:65988:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 0 -> 1784290298 00000004:00010000:0.0:1784290301.254602:0:65988:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:0.0:1784290301.254606:0:65988:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:0.0:1784290301.254619:0:65988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073d0f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254627:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073d0f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254634:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073d0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254642:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073d0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254650:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26c00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290301.254654:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073d0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254663:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073d0f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254673:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c247b1d0d00) 00010000:00010000:0.0:1784290301.254677:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290301.254681:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073d0f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254689:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3073d0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254702:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3073d16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254708:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3073d16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254715:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3073d16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254728:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26a00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290301.254732:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3073d16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254739:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3073d16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254749:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9c247b1d0f00) 00010000:00010000:0.0:1784290301.254752:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290301.254755:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3073d16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254762:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3073d16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254797:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b3073d08 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 14 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254813:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073d1d lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 13 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.254821:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c247b1d0700) 00010000:00010000:0.0:1784290301.254824:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1784290301.254826:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27c00, rc 0) 00010000:00000080:0.0:1784290301.254832:0:65988:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2447717b80 x1870961896218624/t103079215113(0) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:322/0 lens 752/824 e 0 to 0 dl 1784290312 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290301.254880:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:67690:x1870961896218624:12345-192.168.202.6@tcp:101:dd.0 Request processed in 713us (816us total) trans 103079215113 rc 0/0 00000100:00100000:0.0:1784290301.254900:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1068 00000100:00100000:2.0:1784290301.256094:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290301.256129:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896218752 00000100:00100000:3.0:1784290301.256134:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896218752 00000100:00100000:3.0:1784290301.256167:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1069 00000100:00100000:3.0:1784290301.256188:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:67690:x1870961896218752:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:3.0:1784290301.256199:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290301.256208:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4c00/0x5953bbf6b3073d2b lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b22aa expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.256225:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4a00/0x5953bbf6b3073d32 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.256233:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4a00/0x5953bbf6b3073d32 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.256239:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4a00/0x5953bbf6b3073d32 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.256298:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4c00/0x5953bbf6b3073d2b lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22aa expref: 15 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.256311:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4a00/0x5953bbf6b3073d32 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22aa expref: 14 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.256326:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c247b1d0700) 00010000:00010000:3.0:1784290301.256328:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784290301.256330:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2f4a00, rc 0) 00010000:00000080:3.0:1784290301.256335:0:74876:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2474e8ca80 x1870961896218752/t0(0) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:322/0 lens 568/1272 e 0 to 0 dl 1784290312 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290301.256389:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+14:67690:x1870961896218752:12345-192.168.202.6@tcp:101:dd.0 Request processed in 215us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290301.256395:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1069 00000100:00100000:2.0:1784290301.257239:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290301.257275:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896219008 00000100:00100000:0.0:1784290301.257281:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896219008 00000100:00100000:0.0:1784290301.257313:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1070 00000100:00100000:0.0:1784290301.257321:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+14:67690:x1870961896219008:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:0.0:1784290301.257421:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073d39 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.257432:0:65989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073d1d lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 14 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.257439:0:65989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073d39 lrc: 4/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.257466:0:65989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073d1d lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 14 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.257482:0:65989:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073d1d lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 14 pid: 65988 timeout: 2142 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290301.257498:0:65989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:65989:1870961901045632:192.168.202.6@tcp:104: 00000100:00100000:0.0:1784290301.257603:0:65989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ae3ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1784290301.258258:0:65989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:65989:1870961901045632:192.168.202.6@tcp:104: 00010000:00010000:3.0:1784290301.258277:0:65989:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073d39 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290301.258310:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290301.258403:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896219136 00000100:00100000:1.0:1784290301.258410:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896219136 00010000:00010000:1.0:1784290301.258435:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073d1d lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 15 pid: 65988 timeout: 2142 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290301.258466:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2578 00000100:00100000:1.0:1784290301.258477:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+15:2400:x1870961896219136:12345-192.168.202.6@tcp:102:ldlm_bl.0 00010000:00010000:1.0:1784290301.258491:0:7430:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073d1d lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 15 pid: 65988 timeout: 2142 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290301.258505:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073d1d lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 15 pid: 65988 timeout: 2142 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290301.258516:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073d1d lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 15 pid: 65988 timeout: 2142 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290301.258525:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c247b1d0700) 00010000:00010000:1.0:1784290301.258528:0:7430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:1.0:1784290301.258532:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073d39 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290301.258541:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073d39 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290301.258548:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073d39 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290301.258578:0:7430:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073d1d lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 15 pid: 65988 timeout: 2142 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.258591:0:65989:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073d39 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.258609:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073d39 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290301.258653:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+15:2400:x1870961896219136:12345-192.168.202.6@tcp:102:ldlm_bl.0 Request processed in 178us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290301.258663:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2578 00000004:00010000:3.0:1784290301.258712:0:65989:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1784290301.258717:0:65989:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 1784290298 -> 1784290301 00000004:00010000:3.0:1784290301.258720:0:65989:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 1784290298 -> 1784290298 00000004:00010000:3.0:1784290301.258722:0:65989:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 1784290298 -> 1784290301 00000004:00010000:3.0:1784290301.258723:0:65989:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:3.0:1784290301.258762:0:65989:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d8cd0b8c reply state 00000000d4fd9b35 transno 103079215114 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073d39 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.258781:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073d39 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.258786:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c247b1d0700) 00010000:00010000:3.0:1784290301.258789:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290301.258791:0:65989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1784290301.258819:0:65989:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2474e8df80 x1870961896219008/t103079215114(0) o36->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:322/0 lens 488/456 e 0 to 0 dl 1784290312 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290301.258860:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+16:67690:x1870961896219008:12345-192.168.202.6@tcp:36:dd.0 Request processed in 1539us (1623us total) trans 103079215114 rc 0/0 00000100:00100000:3.0:1784290301.258866:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1070 00000100:00100000:0.0:1784290301.259555:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290301.259592:0:66001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896219264 00000100:00100000:3.0:1784290301.259596:0:66001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896219264 00002000:00010000:3.0:1784290301.259613:0:66001:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000a811:0x6:0x0] 00002000:00100000:3.0:1784290301.259615:0:66001:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9c2467ee7800 with x1870961896219264 00000100:00100000:3.0:1784290301.259637:0:66001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 0 00000100:00100000:3.0:1784290301.259643:0:66001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+16:2399:x1870961896219264:12345-192.168.202.6@tcp:10:dd.0 00000100:00100000:0.0:1784290301.259645:0:66002:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1784290301.259653:0:66002:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_003' 00000004:00010000:3.0:1784290301.259759:0:66001:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:3.0:1784290301.259762:0:66001:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 1784290301 -> 1784290301 00000004:00010000:3.0:1784290301.259764:0:66001:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 1784290298 -> 1784290298 00000004:00010000:3.0:1784290301.259766:0:66001:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 1784290301 -> 1784290301 00000004:00010000:3.0:1784290301.259768:0:66001:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1784290301.259778:0:66001:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2467ee7800 x1870961896219264/t103079215115(0) o10->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:322/0 lens 440/432 e 0 to 0 dl 1784290312 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290301.259811:0:66001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+17:2399:x1870961896219264:12345-192.168.202.6@tcp:10:dd.0 Request processed in 168us (257us total) trans 103079215115 rc 0/0 00000100:00100000:3.0:1784290301.259823:0:66001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 0 00002000:00010000:3.0:1784290301.259826:0:66001:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000a811:0x6:0x0] 00002000:00100000:3.0:1784290301.259828:0:66001:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9c2467ee7800 with x1870961896219264 00000100:00100000:0.0:1784290301.260793:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290301.260822:0:68995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896219520 00000100:00100000:3.0:1784290301.260827:0:68995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896219520 00000100:00100000:3.0:1784290301.260856:0:68995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 219 00000100:00100000:3.0:1784290301.260862:0:68995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c209850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+17:67690:x1870961896219520:12345-192.168.202.6@tcp:35:dd.0 00010000:00000080:3.0:1784290301.260942:0:68995:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c247c209850 x1870961896219520/t103079215116(0) o35->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:322/0 lens 392/456 e 0 to 0 dl 1784290312 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290301.260972:0:68995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c209850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+18:67690:x1870961896219520:12345-192.168.202.6@tcp:35:dd.0 Request processed in 112us (181us total) trans 103079215116 rc 0/0 00000100:00100000:3.0:1784290301.260978:0:68995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 219 00010000:00010000:2.0:1784290301.607454:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784290301.796702:0:88106:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1784290301.796755:0:88106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2482044c00/0x5953bbf6b30738af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30738b6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.796766:0:88106:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2482044c00/0x5953bbf6b30738af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30738b6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.796773:0:88106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2482044c00/0x5953bbf6b30738af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b30738b6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.796778:0:88106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c2482044c00/0x5953bbf6b30738af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b30738b6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.796800:0:88106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784290301.796804:0:88106:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1784290301.796839:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290301.796849:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c2482044c00/0x5953bbf6b30738af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b30738b6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290301.796861:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482044c00 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:2.0:1784290301.796867:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c2482044c00/0x5953bbf6b30738af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b30738b6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290301.796879:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2482044c00/0x5953bbf6b30738af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b30738b6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290301.796897:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2482044c00/0x5953bbf6b30738af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b30738b6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290301.796904:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784290301.796908:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784290301.796911:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:3.0:1784290301.796934:0:88106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784290301.796938:0:88106:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784290301.796942:0:88106:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1784290301.796951:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c2482044c00/0x5953bbf6b30738af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b30738b6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784290301.796956:0:88106:0:(import.c:65:import_set_state_nolock()) ffff9c234529d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1784290301.796963:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784290301.796996:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c2482044c00/0x5953bbf6b30738af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b30738b6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290301.796996:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dfd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901045888:0@lo:39:umount.0 00000100:00100000:3.0:1784290301.797003:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901045760:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290301.797018:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2482044c00/0x5953bbf6b30738af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b30738b6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290301.797035:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290301.797038:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290301.797040:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290301.797078:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290301.797078:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290301.797154:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901045760 00000100:00100000:1.0:1784290301.797160:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901045760 00000100:00100000:1.0:1784290301.797217:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:1.0:1784290301.797226:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3620:x1870961901045760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290301.797238:0:19591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290301.797251:0:19591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c23450ab400/0x5953bbf6b30738b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30738af expref: 24 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290301.797262:0:19591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784290301.797290:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3620:x1870961901045760:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290301.797296:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:1.0:1784290301.797314:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901045888 00000100:00100000:1.0:1784290301.797317:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901045888 00000100:00100000:1.0:1784290301.797371:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:1.0:1784290301.797377:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1870961901045888:12345-0@lo:39:umount.0 00000020:00000080:1.0:1784290301.797397:0:66004:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30739ce 00000100:00100000:0.0:1784290301.797407:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901045760:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1784290301.797411:0:66004:0:(import.c:65:import_set_state_nolock()) ffff9c2343902000 : changing import state from FULL to CLOSED 00010000:00000080:1.0:1784290301.797440:0:66004:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2447cc9c00 x1870961901045888/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:322/0 lens 224/224 e 0 to 0 dl 1784290312 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290301.797480:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3616:x1870961901045888:12345-0@lo:39:umount.0 Request processed in 104us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290301.797485:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000020:00000080:1.0:1784290301.797490:0:66004:0:(genops.c:906:class_export_put()) final put ffff9c2343905800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1784290301.797538:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234529d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784290301.797549:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dfd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901045888:0@lo:39:umount.0 00000020:00000080:0.0:1784290301.797999:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343905800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1784290301.798039:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2343902000 for lustre-MDT0000 00010000:00010000:0.0:1784290301.798047:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784290301.798085:0:88106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784290301.798088:0:88106:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784290301.798091:0:88106:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1784290301.798952:0:88106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2482045600/0x5953bbf6b30737cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30737d6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.798960:0:88106:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2482045600/0x5953bbf6b30737cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30737d6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.798965:0:88106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2482045600/0x5953bbf6b30737cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b30737d6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.798970:0:88106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c2482045600/0x5953bbf6b30737cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b30737d6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.798987:0:88106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290301.798992:0:88106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa000/0x5953bbf6b30738d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30738d9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.798997:0:88106:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa000/0x5953bbf6b30738d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30738d9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.799001:0:88106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa000/0x5953bbf6b30738d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b30738d9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.799012:0:88106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c23450aa000/0x5953bbf6b30738d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b30738d9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290301.799017:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290301.799026:0:88106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290301.799028:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c2482045600/0x5953bbf6b30737cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b30737d6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.799033:0:88106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246923f000/0x5953bbf6b30738a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30738a8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290301.799042:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045600 already unused, calling callback (ffffffffc14a9c20) 00010000:00010000:3.0:1784290301.799044:0:88106:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246923f000/0x5953bbf6b30738a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30738a8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290301.799046:0:19681:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c2482045600/0x5953bbf6b30737cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b30737d6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.799054:0:88106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246923f000/0x5953bbf6b30738a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b30738a8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290301.799058:0:19681:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2482045600/0x5953bbf6b30737cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b30737d6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.799061:0:88106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c246923f000/0x5953bbf6b30738a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b30738a8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.799077:0:88106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:00010000:2.0:1784290301.799077:0:19681:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2482045600/0x5953bbf6b30737cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b30737d6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.799083:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784290301.799085:0:88106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246923fc00/0x5953bbf6b30737c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30737c8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290301.799088:0:19681:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784290301.799091:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c23450aa000/0x5953bbf6b30738d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b30738d9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290301.799094:0:19681:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1784290301.799106:0:88106:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246923fc00/0x5953bbf6b30737c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30737c8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.799108:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa000 already unused, calling callback (ffffffffc14a9c20) 00010000:00010000:2.0:1784290301.799111:0:19681:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c2482045600/0x5953bbf6b30737cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b30737d6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290301.799114:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aa000/0x5953bbf6b30738d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b30738d9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.799119:0:88106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246923fc00/0x5953bbf6b30737c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b30737c8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290301.799133:0:19681:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784290301.799138:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450aa000/0x5953bbf6b30738d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b30738d9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290301.799139:0:88106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c246923fc00/0x5953bbf6b30737c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b30737c8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290301.799151:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c2482045600/0x5953bbf6b30737cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b30737d6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290301.799159:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aa000/0x5953bbf6b30738d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b30738d9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290301.799162:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2482045600/0x5953bbf6b30737cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b30737d6 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290301.799184:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1784290301.799191:0:6476:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1784290301.799196:0:6476:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1784290301.799208:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784290301.799210:0:88106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290301.799212:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c246923f000/0x5953bbf6b30738a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b30738a8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290301.799216:0:88106:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1784290301.799219:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c23450aa000/0x5953bbf6b30738d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b30738d9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290301.799221:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923f000 already unused, calling callback (ffffffffc14a9c20) 10000000:01000000:3.0:1784290301.799222:0:88106:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:00010000:2.0:1784290301.799228:0:19681:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c246923f000/0x5953bbf6b30738a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b30738a8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.799231:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784290301.799239:0:19681:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c246923f000/0x5953bbf6b30738a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b30738a8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.799243:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c23450aa000/0x5953bbf6b30738d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b30738d9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290301.799245:0:19681:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c246923f000/0x5953bbf6b30738a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b30738a8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784290301.799252:0:88106:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1784290301.799258:0:88106:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00010000:00010000:0.0:1784290301.799261:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450aa000/0x5953bbf6b30738d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b30738d9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290301.799264:0:19681:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000020:00000080:3.0:1784290301.799265:0:88106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1784290301.799269:0:88106:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 10000000:01000000:2.0:1784290301.799277:0:19681:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1784290301.799280:0:19681:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1784290301.799294:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290301.799300:0:19681:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c246923f000/0x5953bbf6b30738a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b30738a8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.799300:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c246923fc00/0x5953bbf6b30737c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b30737c8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290301.799302:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901046016:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290301.799323:0:19681:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784290301.799325:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246923fc00 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:0.0:1784290301.799330:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c246923fc00/0x5953bbf6b30737c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b30737c8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290301.799357:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c246923f000/0x5953bbf6b30738a1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b30738a8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290301.799363:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784290301.799367:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c246923f000/0x5953bbf6b30738a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b30738a8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.799371:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c246923fc00/0x5953bbf6b30737c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b30737c8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290301.799379:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1784290301.799379:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c246923fc00/0x5953bbf6b30737c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b30737c8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290301.799384:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784290301.799388:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1784290301.799389:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784290301.799393:0:6476:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1784290301.799395:0:6476:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:1.0:1784290301.799398:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784290301.799407:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901046016 00000100:00100000:1.0:1784290301.799408:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901046144:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290301.799412:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c246923fc00/0x5953bbf6b30737c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b30737c8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290301.799413:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901046016 00010000:00010000:0.0:1784290301.799420:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784290301.799429:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c246923fc00/0x5953bbf6b30737c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b30737c8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290301.799439:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784290301.799441:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c246923fc00/0x5953bbf6b30737c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b30737c8 expref: -99 pid: 86789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290301.799452:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901046144 00010000:00010000:0.0:1784290301.799453:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290301.799458:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901046144 00010000:00010000:0.0:1784290301.799459:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290301.799467:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290301.799468:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290301.799488:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:0.0:1784290301.799495:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901046272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290301.799498:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:2.0:1784290301.799499:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3617:x1870961901046016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290301.799511:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784290301.799512:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3617:x1870961901046144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290301.799522:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c23450aae00/0x5953bbf6b30737d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30737cf expref: 24 pid: 86797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290301.799523:0:19592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784290301.799536:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784290301.799537:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290301.799540:0:19592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2482044a00/0x5953bbf6b30738d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30738d2 expref: 23 pid: 86800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290301.799552:0:19592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784290301.799565:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784290301.799572:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901046400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290301.799587:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:3617:x1870961901046016:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290301.799589:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:3617:x1870961901046144:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290301.799598:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:0.0:1784290301.799600:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290301.799605:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:2.0:1784290301.799619:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901046272 00000100:00100000:2.0:1784290301.799623:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901046272 00000100:00100000:1.0:1784290301.799629:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901046400 00000100:00100000:1.0:1784290301.799633:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901046400 00010000:00010000:0.0:1784290301.799640:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290301.799664:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1784290301.799672:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:2.0:1784290301.799678:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:3619:x1870961901046272:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290301.799685:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c534000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:3619:x1870961901046400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290301.799693:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290301.799695:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290301.799711:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246923ea00/0x5953bbf6b30737c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30737c1 expref: 22 pid: 86800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290301.799712:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236cc00/0x5953bbf6b30738a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30738a1 expref: 22 pid: 86800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.799724:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784290301.799728:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901046144:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290301.799731:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784290301.799748:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901046016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290301.799761:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c534000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:3619:x1870961901046400:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290301.799767:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:2.0:1784290301.799777:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:3619:x1870961901046272:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290301.799785:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:1.0:1784290301.799794:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901046400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290301.799810:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901046272:0@lo:103:ldlm_bl.0 00000004:00000080:3.0:1784290301.800395:0:88106:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:1.0:1784290301.800677:0:86790:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215116 is committed 00010000:00010000:0.0:1784290301.800732:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3073cad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784290301.800742:0:88106:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00010000:00010000:0.0:1784290301.800742:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3073cad lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290301.800751:0:88106:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c24506b5800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1784290301.800753:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3073cad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290301.800760:0:88106:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2474eb9000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1784290301.800764:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27800 already unused, calling callback (ffffffffc1aba4f0) 00000020:00080000:3.0:1784290301.800768:0:88106:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c247e4b4000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1784290301.800770:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3073cad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290301.800775:0:88106:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c246ff67800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784290301.800784:0:88106:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c246ff64800 bd808cf4-dd54-45f0-9b2b-1434e8330e5d 192.168.202.6@tcp 11 (0 0 3) 0 0 0 2: ffff9c244a761000 103079215116 stale:0 00000020:00080000:3.0:1784290301.800797:0:88106:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9c246ff14d40) has exports, disconnecting them 00010000:00010000:0.0:1784290301.800800:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3073cad lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290301.800803:0:88106:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c24506b5800), last request at 1784290291 00000020:00000080:3.0:1784290301.800811:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30739c7 00000100:00080000:3.0:1784290301.800817:0:88106:0:(import.c:65:import_set_state_nolock()) ffff9c246ff18000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1784290301.800821:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c247b1d0800) 00010000:00010000:0.0:1784290301.800825:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290301.800828:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3073cad lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.800833:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3073cad lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290301.800834:0:88106:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c24506b5800): rc 0 00000020:00000080:3.0:1784290301.800840:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c24506b5800/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:2.0:1784290301.800849:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290301.800854:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df400/0x5953bbf6b3073ce5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290301.800855:0:88106:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2474eb9000), last request at 1784290297 00000020:00000080:3.0:1784290301.800862:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30739c0 00010000:00010000:0.0:1784290301.800866:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df400/0x5953bbf6b3073ce5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784290301.800868:0:88106:0:(import.c:65:import_set_state_nolock()) ffff9c245fd78800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1784290301.800872:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c24506b5800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:0.0:1784290301.800877:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df400/0x5953bbf6b3073ce5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290301.800883:0:88106:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2474eb9000): rc 0 00010000:00010000:0.0:1784290301.800884:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429df400 already unused, calling callback (ffffffffc1aba4f0) 00000020:00000080:3.0:1784290301.800887:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c2474eb9000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:0.0:1784290301.800889:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df400/0x5953bbf6b3073ce5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290301.800896:0:88106:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c247e4b4000), last request at 1784290297 00010000:00010000:2.0:1784290301.800896:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290301.800897:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df400/0x5953bbf6b3073ce5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.800906:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c247b1d0800) 00000020:00000080:3.0:1784290301.800909:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30739b9 00010000:00010000:0.0:1784290301.800910:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290301.800915:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df400/0x5953bbf6b3073ce5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784290301.800920:0:88106:0:(import.c:65:import_set_state_nolock()) ffff9c247e4b5000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1784290301.800922:0:9947:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246ff18000 for lustre-MDT0000 00000020:00000080:1.0:1784290301.800931:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2474eb9000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:0.0:1784290301.800931:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df400/0x5953bbf6b3073ce5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290301.800940:0:88106:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c247e4b4000): rc 0 00000020:00000080:3.0:1784290301.800943:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c247e4b4000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1784290301.800951:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784290301.800953:0:88106:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c246ff67800), last request at 1784290286 00010000:00010000:0.0:1784290301.800960:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073d39 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784290301.800964:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073823 00010000:00010000:0.0:1784290301.800966:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073d39 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784290301.800969:0:9947:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c245fd78800 for lustre-MDT0000 00000100:00080000:3.0:1784290301.800975:0:88106:0:(import.c:65:import_set_state_nolock()) ffff9c2343901800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1784290301.800976:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073d39 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784290301.800978:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247e4b4000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:0.0:1784290301.800986:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290301.800989:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073d39 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.800994:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073d39 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.801003:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c247b1d0700) 00010000:00010000:0.0:1784290301.801005:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290301.801008:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073d39 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290301.801010:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290301.801012:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3073d39 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784290301.801016:0:9947:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c247e4b5000 for lustre-MDT0000 00000020:00080000:2.0:1784290301.801031:0:88106:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c246ff67800): rc 0 00000020:00000080:2.0:1784290301.801035:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c246ff67800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:2.0:1784290301.801047:0:88106:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.6@tcp (ffff9c246ff64800), last request at 1784290301 00000020:00000080:2.0:1784290301.801051:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307381c 00000020:00000080:1.0:1784290301.801056:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246ff67800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00010000:2.0:1784290301.801059:0:88106:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c246ff64800: total 1 00000100:00080000:2.0:1784290301.801064:0:88106:0:(import.c:65:import_set_state_nolock()) ffff9c247f8f3800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784290301.801077:0:88106:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.6@tcp (ffff9c246ff64800): rc 0 00000004:00000080:2.0:1784290301.801082:0:88106:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae5441d3fae0 00000020:00000080:1.0:1784290301.801088:0:9947:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2343901800 for lustre-MDT0000 00000020:00010000:0.0:1784290301.801093:0:6477:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c246ff64800: total 0 00000100:00080000:2.0:1784290301.801097:0:88106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784290301.801100:0:88106:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1784290301.801123:0:6477:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c246ff64800, canceled 0 locks, left on hash table 3. 00010000:00010000:0.0:1784290301.801144:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073d1d lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 4 pid: 65988 timeout: 2142 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.801184:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b3073c0c lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b225d expref: 3 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.801201:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4a00/0x5953bbf6b3073d32 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22aa expref: 2 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290301.801213:0:6477:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c246ff64800, canceled 3 locks, left on hash table 0. 00000100:00080000:2.0:1784290301.807827:0:88106:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1784290301.807838:0:88106:0:(import.c:65:import_set_state_nolock()) ffff9c23452c2000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1784290301.807877:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901046528:0@lo:39:umount.0 00000100:00100000:1.0:1784290301.807930:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290301.807974:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901046528 00000100:00100000:1.0:1784290301.807979:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901046528 00000100:00080000:2.0:1784290301.807988:0:88106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784290301.807991:0:88106:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:2.0:1784290301.807999:0:88106:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c2468890700 x1870961901042688/t4294968626(4294968626) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784290307 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290301.808014:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3757 00000100:00100000:1.0:1784290301.808023:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3616:x1870961901046528:12345-0@lo:39:umount.0 00000004:00080000:2.0:1784290301.808028:0:88106:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:1.0:1784290301.808040:0:8412:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307385b 00000100:00080000:1.0:1784290301.808045:0:8412:0:(import.c:65:import_set_state_nolock()) ffff9c2474ebc800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784290301.808060:0:8412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378740 00010000:00010000:3.0:1784290301.808067:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290301.808159:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3616:x1870961901046528:12345-0@lo:39:umount.0 Request processed in 138us (229us total) trans 81604378741 rc 0/0 00000100:00100000:1.0:1784290301.808166:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3757 00000100:00080000:3.0:1784290301.808194:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c23452c2000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784290301.808201:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901046528:0@lo:39:umount.0 00000100:00080000:2.0:1784290301.808774:0:88106:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1784290301.808783:0:88106:0:(import.c:65:import_set_state_nolock()) ffff9c246dcf8800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1784290301.808794:0:88106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784290301.808796:0:88106:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:2.0:1784290301.808801:0:88106:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c2474cbca80 x1870961901042944/t4294968626(4294968626) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784290307 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1784290301.808817:0:88106:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784290301.808818:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901046656:0@lo:9:umount.0 00000100:00100000:3.0:1784290301.808848:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290301.808880:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901046656 00000100:00100000:1.0:1784290301.808885:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901046656 00000100:00080000:3.0:1784290301.808914:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290301.808927:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4922 00000100:00100000:1.0:1784290301.808935:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1870961901046656:12345-0@lo:9:umount.0 00000020:00000080:1.0:1784290301.808955:0:9000:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073877 00000100:00080000:1.0:1784290301.808960:0:9000:0:(import.c:65:import_set_state_nolock()) ffff9c2458bec800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1784290301.808975:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1784290301.808989:0:9000:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968626 00000100:00100000:1.0:1784290301.809069:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3616:x1870961901046656:12345-0@lo:9:umount.0 Request processed in 135us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290301.809076:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4922 00000100:00100000:3.0:1784290301.809082:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968626 gen 3 00000100:00080000:3.0:1784290301.809087:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dcf8800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1784290301.809098:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1784290301.809099:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784290301.809102:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901046656:0@lo:9:umount.0 00000100:00080000:2.0:1784290301.809507:0:88106:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1784290301.809514:0:88106:0:(import.c:65:import_set_state_nolock()) ffff9c2444aa5000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1784290301.809543:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901046784:0@lo:9:umount.0 00000020:00080000:2.0:1784290301.809557:0:88106:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c246ff14d40) has no exports 00000100:00100000:3.0:1784290301.809571:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290301.809600:0:26259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901046784 00000100:00100000:2.0:1784290301.809604:0:26259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901046784 00000100:00080000:3.0:1784290301.809629:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784290301.809644:0:26259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4923 00000100:00100000:2.0:1784290301.809653:0:26259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3616:x1870961901046784:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784290301.809668:0:26259:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307388c 00000100:00080000:2.0:1784290301.809674:0:26259:0:(import.c:65:import_set_state_nolock()) ffff9c2458bef800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784290301.809707:0:26259:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968626 00010000:00010000:1.0:1784290301.809709:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290301.809793:0:26259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+2:3616:x1870961901046784:12345-0@lo:9:umount.0 Request processed in 141us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290301.809800:0:26259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4923 00000100:00100000:3.0:1784290301.809815:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968626 gen 3 00000100:00080000:3.0:1784290301.809819:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2444aa5000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1784290301.809829:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1784290301.809832:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784290301.809835:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901046784:0@lo:9:umount.0 00000020:00080000:2.0:1784290301.809960:0:88106:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c246ff14d40) has no exports 00000100:00100000:1.0:1784290301.958070:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290301.958119:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290301.958128:0:66003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896219648 00000100:00100000:3.0:1784290301.958139:0:66003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896219648 00000100:00100000:1.0:1784290301.958143:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896219776 00000100:00100000:1.0:1784290301.958148:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896219776 00000100:00100000:3.0:1784290301.958194:0:66003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:1.0:1784290301.958198:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1072 00000100:00100000:3.0:1784290301.958208:0:66003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:0+-99:2400:x1870961896219648:12345-192.168.202.6@tcp:4:dd.0 00000100:00100000:1.0:1784290301.958208:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2399:x1870961896219776:12345-192.168.202.6@tcp:16:kworker.0 00000020:00080000:3.0:1784290301.958225:0:66003:0:(tgt_handler.c:807:tgt_request_handle()) operation 4 on unconnected OST from 12345-192.168.202.6@tcp 00000020:00080000:1.0:1784290301.958226:0:66008:0:(tgt_handler.c:807:tgt_request_handle()) operation 16 on unconnected OST from 12345-192.168.202.6@tcp 00000100:00100000:1.0:1784290301.958283:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2399:x1870961896219776:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 77us (163us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784290301.958286:0:66003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:0+-99:2400:x1870961896219648:12345-192.168.202.6@tcp:4:dd.0 Request processed in 79us (225us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784290301.958294:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1072 00000100:00100000:3.0:1784290301.958299:0:66003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1 00000100:00100000:1.0:1784290301.959293:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290301.959328:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896219904 00000100:00100000:3.0:1784290301.959333:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896219904 00000100:00100000:3.0:1784290301.959393:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1073 00000100:00100000:3.0:1784290301.959398:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1870961896219904:12345-192.168.202.6@tcp:38:ptlrpcd_01_01.0 00010000:02000000:3.0:1784290301.959416:0:65990:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.202.6@tcp (stopping) 00000100:00100000:3.0:1784290301.959448:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1870961896219904:12345-192.168.202.6@tcp:38:ptlrpcd_01_01.0 Request processed in 48us (156us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784290301.959454:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1073 00000020:00000080:0.0:1784290301.982640:0:6477:0:(genops.c:906:class_export_put()) final put ffff9c246ff64800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000020:00000080:1.0:1784290301.982710:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246ff64800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d for lustre-MDT0000 00000020:00000080:1.0:1784290301.982768:0:9947:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c247f8f3800 for lustre-MDT0000 00010000:00010000:1.0:1784290301.982778:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290301.982781:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290301.982782:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784290301.994427:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073838 00000020:00000080:2.0:1784290301.994439:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c2474f80000/lustre-QMT0000_UUID 00000020:01000000:2.0:1784290301.994453:0:88106:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1784290301.994473:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2474f80000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1784290301.994496:0:88106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784290301.994511:0:88106:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784290301.994515:0:88106:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9c23440d4d40) has no exports 00000020:00000080:3.0:1784290301.994696:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073831 00000020:00000080:3.0:1784290301.994704:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c246dd91800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784290301.994732:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dd91800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784290301.994764:0:88106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784290301.994771:0:88106:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1784290301.994773:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c246dd92000/lustre-QMT0000_UUID 00000020:00000080:3.0:1784290301.994775:0:88106:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dd92000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1784290301.994782:0:88106:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1784290301.994894:0:88106:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c246d9f4060 - data ffff9c2470a06a20/ffff9c2343b4f000 00000020:01000000:3.0:1784290301.994993:0:88106:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c247f9ac780 - data ffff9c23418e6288/ffff9c2475c8f000 00000100:00080000:0.0:1784290302.021791:0:88106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784290302.021798:0:88106:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784290302.021812:0:88106:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c2474e8f800 x1870961901046528/t81604378741(81604378741) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290311 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290302.021838:0:88106:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1784290302.022782:0:88106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784290302.022786:0:88106:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968626 gen 4 00000004:00080000:0.0:1784290302.022797:0:88106:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784290302.022800:0:88106:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784290302.022948:0:86807:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784290302.022953:0:86807:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x60:0x0] index 1 count 1 00000040:00080000:2.0:1784290302.022962:0:86807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 24 count 2 00000100:00080000:0.0:1784290302.023503:0:88106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784290302.023506:0:88106:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968626 gen 4 00000004:00080000:0.0:1784290302.023516:0:88106:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784290302.023518:0:88106:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1784290302.023664:0:86809:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1784290302.023668:0:86809:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x62:0x0] index 1 count 1 00000040:00080000:2.0:1784290302.023681:0:86809:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 24 count 2 00000020:00000080:0.0:1784290302.024405:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30737f2 00000020:00000080:0.0:1784290302.024412:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c2458c7a800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784290302.024432:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458c7a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784290302.025068:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073807 00000020:00000080:0.0:1784290302.025072:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c246ff62800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784290302.025084:0:88106:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1784290302.025088:0:88106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784290302.025097:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246ff62800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1784290302.025097:0:88106:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784290302.025107:0:88106:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9c246ff10000) has no exports 00000004:01000000:0.0:1784290302.025308:0:88106:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1784290302.025318:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073885 00000020:00000080:0.0:1784290302.025323:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c245fd7a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784290302.025334:0:88106:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784290302.025337:0:88106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784290302.025367:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c245fd7a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784290302.025370:0:88106:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784290302.025374:0:88106:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9c2445c13380) has no exports 00000020:00000080:0.0:1784290302.025379:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307387e 00000020:00000080:0.0:1784290302.025383:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c2444aa2000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784290302.025403:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2444aa2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1784290302.025793:0:88106:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784290302.025796:0:88106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784290302.025798:0:88106:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968626 gen 5 00000004:00080000:0.0:1784290302.025801:0:88106:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784290302.025802:0:88106:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784290302.025824:0:9947:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2444aa5000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784290302.025842:0:88106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784290302.025851:0:88106:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784290302.025853:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c247036d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784290302.025859:0:88106:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247036d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1784290302.025865:0:88106:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784290302.025915:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073869 00000020:00000080:0.0:1784290302.025919:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c247036c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784290302.025927:0:88106:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784290302.025930:0:88106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784290302.025934:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247036c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784290302.025935:0:88106:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784290302.025940:0:88106:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9c23440d3380) has no exports 00000020:00000080:0.0:1784290302.025944:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073862 00000020:00000080:0.0:1784290302.025946:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c246dcfc800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784290302.025960:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dcfc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1784290302.026367:0:88106:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784290302.026370:0:88106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784290302.026372:0:88106:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968626 gen 5 00000004:00080000:0.0:1784290302.026381:0:88106:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784290302.026383:0:88106:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784290302.026402:0:9947:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246dcf8800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784290302.026417:0:88106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784290302.026424:0:88106:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784290302.026426:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c247036e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784290302.026428:0:88106:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247036e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1784290302.026432:0:88106:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1784290302.026468:0:88106:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1784290302.026472:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307384d 00000020:00000080:0.0:1784290302.026475:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c2470369800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784290302.026483:0:88106:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1784290302.026486:0:88106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784290302.026489:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2470369800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1784290302.026491:0:88106:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784290302.026496:0:88106:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9c23440d19c0) has no exports 00000020:00000080:0.0:1784290302.026500:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073846 00000020:00000080:0.0:1784290302.026504:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c247d3d1800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784290302.026518:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247d3d1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1784290302.028918:0:88106:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1784290302.028920:0:88106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784290302.028922:0:88106:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784290302.028926:0:88106:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784290302.028946:0:9947:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c23452c2000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1784290302.028959:0:88106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784290302.028965:0:88106:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784290302.028968:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c247036c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784290302.028970:0:88106:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247036c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1784290302.028976:0:88106:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784290302.029031:0:88106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784290302.029034:0:88106:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784290302.029042:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c244c90c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784290302.029044:0:88106:0:(genops.c:865:class_export_destroy()) destroying export ffff9c244c90c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1784290302.029047:0:88106:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784290302.029098:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307380e 00000020:00000080:0.0:1784290302.029108:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c246ff66000/lustre-MDD0000_UUID 00000020:01000000:0.0:1784290302.029117:0:88106:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1784290302.029120:0:88106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784290302.029125:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246ff66000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1784290302.029125:0:88106:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784290302.029130:0:88106:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9c246ff13380) has no exports 00000020:00000080:0.0:1784290302.029153:0:88106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784290302.029157:0:88106:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1784290302.029159:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c246d58c000/lustre-MDD0000_UUID 00000020:00000080:0.0:1784290302.029160:0:88106:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246d58c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1784290302.029165:0:88106:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1784290302.029207:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073815 00000020:00000080:0.0:1784290302.029211:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c246ff61800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1784290302.029221:0:88106:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c246dce1800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1784290302.029224:0:88106:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c246dce1800 3 00000020:00000080:1.0:1784290302.029227:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246ff61800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1784290302.029228:0:88106:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c246dce1800 from lustre-MDT0000 00000020:00000080:0.0:1784290302.029251:0:88106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784290302.029255:0:88106:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1784290302.029257:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c246ff24000/lustre-MDT0000_UUID 00000020:00000080:0.0:1784290302.029259:0:88106:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246ff24000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1784290302.029265:0:88106:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1784290302.029304:0:88106:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1784290302.029308:0:88106:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1784290302.029312:0:88106:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1784290302.029316:0:88106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784290302.029319:0:88106:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1784290302.029326:0:88106:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c247f8f6000 bdffa268-fb6a-4248-991c-0ad16fac303f 192.168.202.6@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784290302.029331:0:88106:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c24481c7800 2e54cd1c-9dbd-4e31-b60e-998135d46053 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784290302.029335:0:88106:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff9c246ff119c0) has exports, disconnecting them 00000020:00080000:0.0:1784290302.029359:0:88106:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.6@tcp (ffff9c247f8f6000), last request at 1784290289 00000020:00000080:0.0:1784290302.029376:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073996 00000020:00010000:0.0:1784290302.029380:0:88106:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c247f8f6000: total 0 00000100:00080000:0.0:1784290302.029389:0:88106:0:(import.c:65:import_set_state_nolock()) ffff9c247f8f1000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784290302.029400:0:88106:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.6@tcp (ffff9c247f8f6000): rc 0 00000020:00080000:0.0:1784290302.029404:0:88106:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c24481c7800), last request at 1784290286 00000020:00010000:2.0:1784290302.029417:0:6476:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c247f8f6000: total 0 00000020:00000080:0.0:1784290302.029475:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30737b3 00000020:00010000:0.0:1784290302.029480:0:88106:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c24481c7800: total 0 00010000:00010000:2.0:1784290302.029482:0:6476:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c247f8f6000, canceled 0 locks, left on hash table 4. 00000100:00080000:0.0:1784290302.029483:0:88106:0:(import.c:65:import_set_state_nolock()) ffff9c246dce5000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784290302.029498:0:88106:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c24481c7800): rc 0 00000020:00080000:0.0:1784290302.029502:0:88106:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9c246ff119c0) has no exports 00000020:00010000:1.0:1784290302.029505:0:7429:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c24481c7800: total 0 00010000:00010000:2.0:1784290302.029523:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246923f200/0x5953bbf6b30739ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2248 expref: 5 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290302.029551:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246923f800/0x5953bbf6b30739a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2241 expref: 4 pid: 86797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290302.029562:0:7429:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c24481c7800, canceled 0 locks, left on hash table 13. 00000100:00100000:0.0:1784290302.029569:0:86797:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c234645a800:86797] 2 exiting: rc = 0 00010000:00010000:2.0:1784290302.029574:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236d000/0x5953bbf6b30739b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b224f expref: 3 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290302.029584:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2482045000/0x5953bbf6b307393b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073934 expref: 14 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290302.029601:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2469a7ca00/0x5953bbf6b307399d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b223a expref: 2 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290302.029607:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c23450ab600/0x5953bbf6b3073949 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073942 expref: 13 pid: 86800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290302.029621:0:6476:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c247f8f6000, canceled 4 locks, left on hash table 0. 00010000:00010000:1.0:1784290302.029631:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2482045400/0x5953bbf6b30738e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30738e0 expref: 12 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290302.029650:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246923e000/0x5953bbf6b3073965 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b307395e expref: 11 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290302.029664:0:86795:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c2452472000:86795] 0 exiting: rc = 1 00010000:00010000:1.0:1784290302.029675:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c23450abe00/0x5953bbf6b30738f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30738ee expref: 10 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784290302.029676:0:6476:0:(genops.c:906:class_export_put()) final put ffff9c247f8f6000/bdffa268-fb6a-4248-991c-0ad16fac303f 00010000:00010000:2.0:1784290302.029701:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290302.029706:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290302.029711:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290302.029713:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246923f600/0x5953bbf6b3073957 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073950 expref: 9 pid: 86797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784290302.029724:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247f8f6000/bdffa268-fb6a-4248-991c-0ad16fac303f for MGS 00010000:00010000:1.0:1784290302.029738:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c23450aa600/0x5953bbf6b3073911 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b307390a expref: 8 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290302.029742:0:86796:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c234645be00:86796] 1 exiting: rc = 0 00010000:00010000:1.0:1784290302.029760:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236d600/0x5953bbf6b3073973 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b307396c expref: 7 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784290302.029776:0:9947:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c247f8f1000 for MGS 00010000:00010000:1.0:1784290302.029782:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c23450aa800/0x5953bbf6b3073903 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30738fc expref: 6 pid: 86797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290302.029799:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246923fe00/0x5953bbf6b3073981 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b307397a expref: 5 pid: 86800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290302.029814:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2469a7ce00/0x5953bbf6b307398f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073988 expref: 4 pid: 86795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290302.029827:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c23450ab000/0x5953bbf6b307391f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073918 expref: 3 pid: 86797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290302.029839:0:86800:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9c2467f9ae00:86800] 3 exiting: rc = 0 00010000:00010000:1.0:1784290302.029844:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c23450aba00/0x5953bbf6b307392d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073926 expref: 2 pid: 86796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290302.029854:0:7429:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c24481c7800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1784290302.029886:0:7429:0:(genops.c:906:class_export_put()) final put ffff9c24481c7800/2e54cd1c-9dbd-4e31-b60e-998135d46053 00010000:00010000:1.0:1784290302.029902:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290302.029902:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1784290302.029908:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290302.029913:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290302.029918:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1784290302.029920:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c24481c7800/2e54cd1c-9dbd-4e31-b60e-998135d46053 for MGS 00000100:00100000:0.0:1784290302.029935:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.029943:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.029956:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1784290302.029961:0:9947:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246dce5000 for MGS 00000100:00100000:0.0:1784290302.029967:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.029976:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.029982:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.029989:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.029993:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.029997:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030003:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030009:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030015:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030020:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030025:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030030:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030035:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030041:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030047:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030053:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030060:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030073:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030080:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030085:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030091:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030098:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030103:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030109:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030114:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030120:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030131:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030141:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030152:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030156:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030182:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030190:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030196:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030202:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030208:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030216:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030222:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030227:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030232:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030239:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030245:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030252:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030257:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030262:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030268:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030277:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030286:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030296:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030307:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030315:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030323:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030331:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030367:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030376:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030385:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030397:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030410:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030418:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784290302.030425:0:88106:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1784290302.030961:0:88106:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c247f9ac4e0 - data ffff9c23418e6510/ffff9c2475c8f800 00000020:01000000:0.0:1784290302.031093:0:88106:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c246d004120 - data ffff9c23418a7af8/ffff9c244a79fc00 00000020:00000080:0.0:1784290302.031623:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30737ac 00000020:00000080:0.0:1784290302.031628:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c24481c0800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1784290302.031639:0:88106:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c246dce1800 from MGS, refs=2 00000020:01000004:0.0:1784290302.031641:0:88106:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c246dce1800 2 00000020:01000004:0.0:1784290302.031648:0:88106:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c246dce1800 from MGS 00000020:00000080:1.0:1784290302.031652:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c24481c0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784290302.031664:0:88106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784290302.031669:0:88106:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1784290302.031672:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c24481c7000/MGS 00000020:00000080:0.0:1784290302.031674:0:88106:0:(genops.c:865:class_export_destroy()) destroying export ffff9c24481c7000/MGS for MGS 00000020:01000000:0.0:1784290302.031679:0:88106:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1784290302.031726:0:88106:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1784290302.031728:0:88106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784290302.031733:0:88106:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784290302.031737:0:88106:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c247e400000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784290302.031740:0:88106:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9c23440d0000) has exports, disconnecting them 00000020:00080000:0.0:1784290302.031744:0:88106:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c247e400000), last request at 1784290286 00000020:00000080:0.0:1784290302.031747:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30738c4 00000020:00080000:0.0:1784290302.031755:0:88106:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c247e400000): rc 0 00000020:00000080:0.0:1784290302.031759:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c247e400000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784290302.031780:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247e400000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1784290302.034138:0:88106:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1784290302.034141:0:88106:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784290302.034143:0:88106:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784290302.034152:0:88106:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784290302.034181:0:9947:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c234529d800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784290302.034299:0:88106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784290302.034307:0:88106:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1784290302.034311:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c244c90f800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1784290302.034314:0:88106:0:(genops.c:865:class_export_destroy()) destroying export ffff9c244c90f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1784290302.034320:0:88106:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1784290302.034373:0:88106:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c246dce1800 1 00000020:00000080:0.0:1784290302.034377:0:88106:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307379e 00000020:00000080:0.0:1784290302.034381:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c24481c2000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1784290302.034390:0:88106:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1784290302.034394:0:88106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784290302.034397:0:88106:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784290302.034400:0:88106:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9c246ff6cd40) has no exports 00000020:00000080:1.0:1784290302.034401:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c24481c2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784290302.050834:0:88106:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290302.050839:0:88106:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1784290302.050841:0:88106:0:(genops.c:906:class_export_put()) final put ffff9c246dce2800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784290302.050844:0:88106:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dce2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1784290302.050849:0:88106:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1784290302.050918:0:88106:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c246dce7800 00000020:02000400:1.0:1784290302.050954:0:88106:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1784290302.119489:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1870961901047040:0@lo:400:kworker.0 00000100:00100000:2.0:1784290302.119542:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901047168:0@lo:400:kworker.0 00000100:00100000:0.0:1784290302.119582:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1870961901047424:0@lo:400:kworker.0 00000100:00100000:1.0:1784290302.119592:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290302.119601:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1870961901047296:0@lo:400:kworker.0 00000100:00100000:1.0:1784290302.119643:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901046912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784290302.119643:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290302.119664:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901047040 00000100:00100000:2.0:1784290302.119671:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901047040 00000100:00100000:0.0:1784290302.119694:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1870961901047936:0@lo:400:kworker.0 00000100:00100000:1.0:1784290302.119707:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290302.119730:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901047424 00000100:00100000:2.0:1784290302.119733:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901047424 00000100:00100000:0.0:1784290302.119739:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290302.119743:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c535880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901047552:0@lo:400:kworker.0 00000100:00100000:2.0:1784290302.119781:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901047936 00000100:00100000:2.0:1784290302.119784:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901047936 00000100:00100000:1.0:1784290302.119795:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290302.119812:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:2.0:1784290302.119821:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:0.0:1784290302.119828:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1870961901047424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290302.119830:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3617:x1870961901047040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290302.119831:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000020:00080000:2.0:1784290302.119842:0:66004:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784290302.119846:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901047680:0@lo:400:kworker.0 00000100:00100000:2.0:1784290302.119896:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3617:x1870961901047040:12345-0@lo:400:kworker.0 Request processed in 64us (304us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784290302.119901:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290302.119907:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c537100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1870961901047424:12345-0@lo:400:kworker.0 Request processed in 80us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290302.119912:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:0.0:1784290302.119922:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:2.0:1784290302.119936:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:2.0:1784290302.119943:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3620:x1870961901047936:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784290302.119948:0:66004:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:1.0:1784290302.119952:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784290302.119956:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784290302.119961:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784290302.119965:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290302.119970:0:3617:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2033 00000100:00100000:0.0:1784290302.119974:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c535500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1870961901047424:0@lo:400:kworker.0 00000100:00080000:1.0:1784290302.119979:0:3617:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290302.119982:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c534a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3620:x1870961901047936:12345-0@lo:400:kworker.0 Request processed in 36us (244us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784290302.119991:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00080000:0.0:1784290302.119998:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784290302.120003:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:1.0:1784290302.120007:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2468539180 x1870961901048064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:02000400:0.0:1784290302.120022:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1784290302.120023:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901046912 00000100:00100000:2.0:1784290302.120028:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901046912 00000100:00080000:0.0:1784290302.120040:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784290302.120047:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2033 00000100:00080000:0.0:1784290302.120053:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290302.120055:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c536680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1870961901047040:0@lo:400:kworker.0 00000100:00100000:2.0:1784290302.120056:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901047552 00000100:00100000:2.0:1784290302.120061:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901047552 00000100:00100000:0.0:1784290302.120079:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c247c537480 x1870961901048192/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290302.120086:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3758 00000100:00100000:2.0:1784290302.120096:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3617:x1870961901046912:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784290302.120103:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3759 00000100:00100000:0.0:1784290302.120106:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c534380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1870961901047936:0@lo:400:kworker.0 00000020:00080000:2.0:1784290302.120107:0:8413:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784290302.120115:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246853b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3617:x1870961901047552:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784290302.120122:0:22091:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784290302.120141:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3617:x1870961901046912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 45us (434us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784290302.120147:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3758 00000100:00100000:0.0:1784290302.120160:0:26253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901047680 00000100:00100000:0.0:1784290302.120164:0:26253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901047680 00000100:00100000:1.0:1784290302.120181:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246853b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3617:x1870961901047552:12345-0@lo:400:kworker.0 Request processed in 51us (372us total) trans 0 rc -107/-107 00000100:00080000:2.0:1784290302.120189:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784290302.120190:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3759 00000100:00080000:2.0:1784290302.120194:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290302.120229:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901048064:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1784290302.120234:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1517 00000100:00100000:0.0:1784290302.120244:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468539880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901047680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290302.120259:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784290302.120299:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784290302.120302:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784290302.120306:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1784290302.120310:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1784290302.120311:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901047808:0@lo:400:kworker.0 00000100:00080000:1.0:1784290302.120315:0:3617:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2033 00000100:00100000:0.0:1784290302.120321:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468539880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901047680:12345-0@lo:400:kworker.0 Request processed in 77us (426us total) trans 0 rc 0/0 00000100:00080000:1.0:1784290302.120324:0:3617:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290302.120333:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1517 00000100:00100000:2.0:1784290302.120372:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290302.120379:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2468890700 x1870961901048320/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784290302.120394:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c535880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901047552:0@lo:400:kworker.0 00000100:00100000:0.0:1784290302.120395:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290302.120401:0:26255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901047808 00000100:00100000:3.0:1784290302.120407:0:26255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901047808 00000100:02020000:1.0:1784290302.120414:0:3617:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1784290302.120418:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1784290302.120424:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784290302.120425:0:3617:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9c246dd98000 already not connected (conn 32, was 31): CONNECTING 00000100:00100000:2.0:1784290302.120459:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901048192:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1784290302.120464:0:26255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1518 00000100:00100000:1.0:1784290302.120465:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c535f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901047680:0@lo:400:kworker.0 00000100:00100000:3.0:1784290302.120477:0:26255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901047808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290302.120485:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290302.120511:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901048320:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1784290302.120512:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901047296 00000100:00100000:1.0:1784290302.120522:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901047296 00000100:00100000:3.0:1784290302.120533:0:26255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901047808:12345-0@lo:400:kworker.0 Request processed in 60us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290302.120542:0:26255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1518 00000100:00100000:2.0:1784290302.120543:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290302.120553:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901047168 00000100:00100000:1.0:1784290302.120557:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901047168 00000100:00100000:0.0:1784290302.120565:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901047808:0@lo:400:kworker.0 00000100:00100000:2.0:1784290302.120592:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901048064 00000100:00100000:1.0:1784290302.120593:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901048192 00000100:00100000:2.0:1784290302.120599:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901048064 00000100:00100000:1.0:1784290302.120599:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901048192 00000100:00100000:0.0:1784290302.120604:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:0.0:1784290302.120613:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901047168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290302.120633:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:1.0:1784290302.120643:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:2.0:1784290302.120644:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1870961901047296:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1784290302.120654:0:65990:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784290302.120659:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c534380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901047168:12345-0@lo:400:kworker.0 Request processed in 43us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290302.120661:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901048064:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1784290302.120669:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00010000:00020000:1.0:1784290302.120684:0:74876:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290302.120689:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1784290302.120695:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3619:x1870961901047296:12345-0@lo:400:kworker.0 Request processed in 54us (437us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784290302.120698:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1870961901048192:12345-0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1784290302.120717:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00010000:00020000:0.0:1784290302.120727:0:65988:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1784290302.120740:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784290302.120746:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784290302.120748:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901048064:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 91us (324us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290302.120755:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901048320 00000100:00100000:2.0:1784290302.120759:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901048320 00000100:00100000:1.0:1784290302.120760:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:0.0:1784290302.120773:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1870961901048192:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 75us (287us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290302.120786:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3760 00000100:00100000:2.0:1784290302.120795:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901048320:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1784290302.120799:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:1.0:1784290302.120806:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c536a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901047168:0@lo:400:kworker.0 00010000:00020000:2.0:1784290302.120808:0:8413:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784290302.120836:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901048320:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 41us (297us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290302.120843:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3760 00000100:00080000:0.0:1784290302.120851:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784290302.120856:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784290302.120860:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784290302.120865:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784290302.120870:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2033 00000100:00080000:2.0:1784290302.120872:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290302.120878:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00080000:0.0:1784290302.120878:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290302.120884:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468890700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901048320:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1784290302.120902:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1784290302.120902:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c247c535c00 x1870961901048448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784290302.120907:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784290302.120914:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901048064:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1784290302.120925:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290302.120929:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290302.120933:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c537800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1870961901047296:0@lo:400:kworker.0 00000100:00100000:2.0:1784290302.120934:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c537480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901048192:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1784290302.120968:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901048448:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1784290302.120989:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290302.121026:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901048448 00000100:00100000:0.0:1784290302.121032:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901048448 00000100:00100000:0.0:1784290302.121059:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:0.0:1784290302.121066:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901048448:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1784290302.121079:0:65990:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290302.121123:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901048448:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 57us (131us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290302.121131:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00080000:2.0:1784290302.121134:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290302.121139:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784290302.121143:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901048448:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1784290302.632129:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290303.655537:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290304.167609:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901048576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290304.167682:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290304.167721:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245f7eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901048704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784290304.167740:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901048576 00000100:00100000:1.0:1784290304.167747:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290304.167752:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901048576 00000100:00100000:0.0:1784290304.167797:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901048704 00000100:00100000:0.0:1784290304.167806:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901048704 00000100:00100000:2.0:1784290304.167829:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00080000:3.0:1784290304.167842:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784290304.167845:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901048576:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1784290304.167853:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290304.167866:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00002000:00000024:2.0:1784290304.167881:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290304.167882:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468890700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901048704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784290304.167909:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784290304.167961:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901048576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290304.167974:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468890700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901048704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290304.167981:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:1.0:1784290304.167996:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:0.0:1784290304.168005:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901048576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784290304.168029:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245f7eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901048704:0@lo:13:osp-pre-1-1.0 00000400:00000100:1.0:1784290304.518008:0:3610:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.6@tcp portal 26 match 1870961896220032 offset 0 length 224: 4 00000100:00100000:1.0:1784290304.518067:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290304.518111:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290304.518229:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896220160 00000100:00100000:1.0:1784290304.518229:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290304.518247:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896220160 00000100:00100000:3.0:1784290304.518276:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896220416 00000100:00100000:1.0:1784290304.518287:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290304.518289:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896220416 00000100:00100000:2.0:1784290304.518316:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896220288 00000100:00100000:2.0:1784290304.518326:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896220288 00000100:00100000:0.0:1784290304.518433:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1080 00000100:00100000:3.0:1784290304.518436:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896220544 00000100:00100000:3.0:1784290304.518443:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896220544 00000100:00100000:1.0:1784290304.518454:0:26254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1519 00000100:00100000:0.0:1784290304.518469:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2396:x1870961896220160:12345-192.168.202.6@tcp:38:kworker.0 00000100:00100000:1.0:1784290304.518482:0:26254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2400:x1870961896220416:12345-192.168.202.6@tcp:400:kworker.0 00010000:00020000:0.0:1784290304.518509:0:74876:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784290304.518514:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1520 00000100:00100000:2.0:1784290304.518514:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 647 00000100:00100000:3.0:1784290304.518554:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2399:x1870961896220544:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290304.518555:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2399:x1870961896220288:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290304.518582:0:26254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2400:x1870961896220416:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 113us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290304.518602:0:26254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1519 00000100:00100000:0.0:1784290304.518604:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2396:x1870961896220160:12345-192.168.202.6@tcp:38:kworker.0 Request processed in 130us (524us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784290304.518620:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2399:x1870961896220544:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 82us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290304.518632:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1080 00000100:00100000:3.0:1784290304.518642:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1520 00000100:00100000:2.0:1784290304.518655:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2399:x1870961896220288:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 116us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290304.518676:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 647 00000100:00080000:0.0:1784290304.518729:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784290304.518738:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784290304.518744:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784290304.679511:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290305.703495:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290306.727537:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784290307.239491:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290307.239496:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290307.239500:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290307.239508:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2043 00000100:00080000:2.0:1784290307.239513:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784290307.239522:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290307.239523:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901048832:0@lo:400:kworker.0 00000100:00100000:2.0:1784290307.239544:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2474e8e300 x1870961901048960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:0.0:1784290307.239597:0:3618:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870961901048832 offset 0 length 224: 4 00000100:00080000:2.0:1784290307.239609:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290307.239614:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290307.239617:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1784290307.239623:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901048960:0@lo:38:kworker.0 00000100:00080000:2.0:1784290307.239625:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2043 00000100:00080000:2.0:1784290307.239634:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784290307.239643:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290307.239646:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1870961901049088:0@lo:400:kworker.0 00000100:00100000:2.0:1784290307.239665:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2474e8ed80 x1870961901049216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784290307.239696:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1784290307.239698:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784290307.239705:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290307.239708:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290307.239713:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2043 00000100:00080000:2.0:1784290307.239733:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1784290307.239735:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1870961901049344:0@lo:400:kworker.0 00000100:00080000:2.0:1784290307.239742:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290307.239753:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901049216:0@lo:38:kworker.0 00000100:00100000:1.0:1784290307.239759:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290307.239767:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2474e8d880 x1870961901049472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290307.239827:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784290307.239833:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1784290307.239836:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901049600:0@lo:400:kworker.0 00000100:00080000:2.0:1784290307.239840:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290307.239845:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290307.239850:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2043 00000100:00080000:2.0:1784290307.239854:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1784290307.239857:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901048960 00000100:00080000:2.0:1784290307.239858:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290307.239868:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901048960 00000100:00100000:2.0:1784290307.239881:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2468539180 x1870961901049856/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784290307.239899:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290307.239918:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901049088 00000100:00100000:3.0:1784290307.239919:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901049344 00000100:00100000:2.0:1784290307.239928:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901049728:0@lo:400:kworker.0 00000100:00100000:0.0:1784290307.239929:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901049088 00000100:00100000:3.0:1784290307.239930:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901049344 00000100:00100000:1.0:1784290307.239956:0:26257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901049600 00000100:00100000:1.0:1784290307.239964:0:26257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901049600 00000100:00100000:2.0:1784290307.239995:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290307.240001:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:0.0:1784290307.240016:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:3.0:1784290307.240021:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1870961901049344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290307.240048:0:26257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901049728 00000100:00100000:0.0:1784290307.240051:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1870961901049088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290307.240053:0:26257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901049728 00000100:00100000:2.0:1784290307.240077:0:26260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1521 00000100:00100000:2.0:1784290307.240086:0:26260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901049600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290307.240097:0:26257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1522 00000100:00100000:1.0:1784290307.240108:0:26257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901049728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290307.240145:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c537800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1870961901049344:12345-0@lo:400:kworker.0 Request processed in 133us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290307.240164:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1870961901049088:12345-0@lo:400:kworker.0 Request processed in 126us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290307.240166:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:2.0:1784290307.240174:0:26260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901049600:12345-0@lo:400:kworker.0 Request processed in 87us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290307.240180:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:2.0:1784290307.240184:0:26260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1521 00000100:00100000:1.0:1784290307.240188:0:26257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901049728:12345-0@lo:400:kworker.0 Request processed in 83us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290307.240199:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:1.0:1784290307.240200:0:26257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1522 00000100:00100000:3.0:1784290307.240212:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245f7eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901048960:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784290307.240229:0:65989:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1784290307.240229:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784290307.240234:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784290307.240237:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784290307.240242:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784290307.240271:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901049472:0@lo:38:kworker.0 00000100:00100000:3.0:1784290307.240279:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245f7eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901048960:12345-0@lo:38:kworker.0 Request processed in 68us (583us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290307.240280:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1870961901049088:0@lo:400:kworker.0 00000100:00100000:3.0:1784290307.240294:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:2.0:1784290307.240305:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290307.240316:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901049216 00000100:00100000:3.0:1784290307.240320:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901049216 00000100:00100000:0.0:1784290307.240333:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1870961901049344:0@lo:400:kworker.0 00000100:00100000:2.0:1784290307.240337:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901049856:0@lo:38:kworker.0 00000100:00100000:3.0:1784290307.240375:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:3.0:1784290307.240382:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901049216:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784290307.240391:0:65989:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784290307.240396:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290307.240427:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901049600:0@lo:400:kworker.0 00000100:00100000:3.0:1784290307.240440:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901049216:12345-0@lo:38:kworker.0 Request processed in 55us (208us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784290307.240448:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00080000:2.0:1784290307.240455:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290307.240462:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784290307.240465:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901049856 00000100:00100000:2.0:1784290307.240467:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901049216:0@lo:38:kworker.0 00000100:00100000:3.0:1784290307.240470:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901049856 00000100:00100000:0.0:1784290307.240490:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901049472 00000100:00100000:1.0:1784290307.240491:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901049728:0@lo:400:kworker.0 00000100:00080000:2.0:1784290307.240494:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1784290307.240495:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901049472 00000100:00100000:3.0:1784290307.240499:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00080000:2.0:1784290307.240504:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784290307.240508:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901049856:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784290307.240513:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901048960:0@lo:38:kworker.0 00010000:00020000:3.0:1784290307.240520:0:65989:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290307.240532:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3761 00000100:00100000:0.0:1784290307.240541:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901049472:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784290307.240552:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c24d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901049856:12345-0@lo:38:kworker.0 Request processed in 45us (159us total) trans 0 rc -19/-19 00010000:00020000:0.0:1784290307.240554:0:23867:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784290307.240583:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00080000:2.0:1784290307.240596:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290307.240603:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784290307.240608:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468539180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901049856:0@lo:38:kworker.0 00000100:00100000:0.0:1784290307.240635:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c24f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901049472:12345-0@lo:38:kworker.0 Request processed in 91us (329us total) trans 0 rc -19/-19 00000100:00080000:2.0:1784290307.240646:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290307.240653:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290307.240658:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3761 00000100:00100000:2.0:1784290307.240663:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901049472:0@lo:38:kworker.0 00010000:00010000:3.0:1784290307.751683:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784290307.752405:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784290307.752410:0:9482:0:(genops.c:906:class_export_put()) final put ffff9c2458bef000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784290307.752476:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458bef000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1784290307.752523:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2458bef800 for lustre-OST0001 00000001:00100000:1.0:1784290307.752549:0:75386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1784290307.752560:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1784290307.752560:0:75386:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378741 is committed 00000020:00000080:1.0:1784290307.752566:0:75386:0:(genops.c:906:class_export_put()) final put ffff9c2474ebd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784290307.752567:0:8397:0:(genops.c:906:class_export_put()) final put ffff9c2458bea800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784290307.752609:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458bea800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1784290307.752632:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2474ebd800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1784290307.752677:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2458bec800 for lustre-OST0000 00000020:00000080:0.0:1784290307.752680:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2474ebc800 for lustre-MDT0001 00010000:00010000:1.0:1784290308.775506:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290309.287628:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c24fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901050112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784290309.287729:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290309.287790:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345b31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901049984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784290309.287814:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901050112 00000100:00100000:0.0:1784290309.287824:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290309.287833:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901050112 00000100:00080000:0.0:1784290309.287881:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784290309.287930:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901049984 00000100:00100000:2.0:1784290309.287937:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901049984 00000100:00100000:3.0:1784290309.287961:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:3.0:1784290309.287984:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c535500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901050112:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290309.288006:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00080000:0.0:1784290309.288015:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784290309.288030:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901049984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784290309.288037:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1784290309.288063:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290309.288191:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c535500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901050112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 209us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290309.288193:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c534e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901049984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 169us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290309.288220:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1784290309.288231:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:0.0:1784290309.288240:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c24fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901050112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784290309.288272:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345b31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901049984:0@lo:13:osp-pre-1-1.0 00000400:00000100:1.0:1784290309.637755:0:3611:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.6@tcp portal 26 match 1870961896220672 offset 0 length 224: 4 00000100:00100000:1.0:1784290309.637800:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290309.637834:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290309.637866:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896220928 00000100:00100000:1.0:1784290309.637873:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290309.637877:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896220928 00000100:00100000:2.0:1784290309.637909:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896220800 00000100:00100000:1.0:1784290309.637918:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290309.637929:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896220800 00000100:00100000:3.0:1784290309.637941:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896221056 00000100:00100000:3.0:1784290309.637948:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896221056 00000100:00100000:1.0:1784290309.637971:0:8999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896221184 00000100:00100000:0.0:1784290309.637975:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 650 00000100:00100000:1.0:1784290309.637979:0:8999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896221184 00000100:00100000:2.0:1784290309.637984:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1084 00000100:00100000:0.0:1784290309.637990:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2399:x1870961896220928:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290309.637995:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1870961896220800:12345-192.168.202.6@tcp:38:kworker.0 00000100:00100000:3.0:1784290309.638021:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1523 00010000:00020000:2.0:1784290309.638035:0:65988:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784290309.638038:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2400:x1870961896221056:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290309.638064:0:8999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1524 00000100:00100000:1.0:1784290309.638079:0:8999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2399:x1870961896221184:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290309.638113:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1870961896220800:12345-192.168.202.6@tcp:38:kworker.0 Request processed in 100us (260us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290309.638117:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2399:x1870961896220928:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 112us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290309.638120:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2400:x1870961896221056:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 66us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290309.638134:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1084 00000100:00100000:3.0:1784290309.638139:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1523 00000100:00100000:0.0:1784290309.638147:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 650 00000100:00100000:1.0:1784290309.638156:0:8999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2399:x1870961896221184:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 75us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290309.638169:0:8999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1524 00000100:00080000:0.0:1784290309.638177:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784290309.638183:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784290309.638187:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1784290309.799546:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290310.823592:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290311.847559:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784290312.359572:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784290312.359577:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784290312.359581:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784290312.359588:0:9947:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2048 00000100:00080000:3.0:1784290312.359594:0:9947:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784290312.359602:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290312.359617:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345b31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901050240:0@lo:400:kworker.0 00000100:00100000:3.0:1784290312.359625:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246dee4e00 x1870961901050368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784290312.359666:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000400:00000100:1.0:1784290312.359667:0:3620:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870961901050240 offset 0 length 224: 4 00000100:00080000:3.0:1784290312.359688:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784290312.359691:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784290312.359696:0:9947:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2048 00000100:00080000:3.0:1784290312.359699:0:9947:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784290312.359706:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290312.359711:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901050496:0@lo:400:kworker.0 00000100:00100000:3.0:1784290312.359722:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246dee7100 x1870961901050624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290312.359726:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901050368:0@lo:38:kworker.0 00000100:00080000:3.0:1784290312.359760:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784290312.359764:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784290312.359766:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1784290312.359772:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1870961901050752:0@lo:400:kworker.0 00000100:00080000:3.0:1784290312.359773:0:9947:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2048 00000100:00080000:3.0:1784290312.359778:0:9947:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784290312.359784:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290312.359797:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246dee6300 x1870961901050880/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290312.359808:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784290312.359853:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1784290312.359857:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1784290312.359858:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901051008:0@lo:400:kworker.0 00000100:00080000:3.0:1784290312.359861:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1784290312.359864:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901050624:0@lo:38:kworker.0 00000100:00100000:0.0:1784290312.359876:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784290312.359883:0:9947:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2048 00000100:00080000:3.0:1784290312.359889:0:9947:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784290312.359892:0:9947:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290312.359908:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246dee5180 x1870961901051264/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784290312.359945:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290312.359950:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290312.359955:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901051136:0@lo:400:kworker.0 00000100:00100000:0.0:1784290312.359985:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901050368 00000100:00100000:0.0:1784290312.359995:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901050368 00000100:00100000:2.0:1784290312.360001:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901050880:0@lo:38:kworker.0 00000100:00100000:3.0:1784290312.360009:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290312.360010:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901051008 00000100:00100000:1.0:1784290312.360017:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901051008 00000100:00100000:2.0:1784290312.360050:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290312.360052:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901050496 00000100:00100000:0.0:1784290312.360058:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901050496 00000100:00100000:1.0:1784290312.360107:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901051136 00000100:00100000:2.0:1784290312.360113:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901051264:0@lo:38:kworker.0 00000100:00100000:1.0:1784290312.360114:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901051136 00000100:00100000:3.0:1784290312.360116:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901050624 00000100:00100000:3.0:1784290312.360122:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901050624 00000100:00100000:0.0:1784290312.360138:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:2.0:1784290312.360146:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290312.360156:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901050496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290312.360164:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1525 00000100:00100000:3.0:1784290312.360166:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901051264 00000100:00100000:3.0:1784290312.360170:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901051264 00000100:00100000:1.0:1784290312.360182:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901051008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290312.360187:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901050880 00000100:00100000:3.0:1784290312.360191:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:2.0:1784290312.360194:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901050880 00000100:00100000:3.0:1784290312.360200:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1870961901050368:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784290312.360218:0:65988:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784290312.360226:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3762 00000100:00100000:2.0:1784290312.360231:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901050880:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784290312.360243:0:22091:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290312.360308:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c534700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901050496:12345-0@lo:400:kworker.0 Request processed in 143us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290312.360310:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901051008:12345-0@lo:400:kworker.0 Request processed in 121us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290312.360311:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c24c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1870961901050368:12345-0@lo:38:kworker.0 Request processed in 91us (491us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290312.360311:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901050880:12345-0@lo:38:kworker.0 Request processed in 75us (263us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290312.360371:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:2.0:1784290312.360379:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3762 00000100:00100000:3.0:1784290312.360384:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1784290312.360390:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1525 00000100:00100000:0.0:1784290312.360414:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:0.0:1784290312.360425:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901050624:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784290312.360435:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:1.0:1784290312.360437:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1526 00000100:00100000:3.0:1784290312.360456:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1870961901051264:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784290312.360464:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901051136:12345-0@lo:400:kworker.0 00010000:00020000:0.0:1784290312.360467:0:65989:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:3.0:1784290312.360473:0:65988:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1784290312.360485:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290312.360490:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784290312.360493:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901050880:0@lo:38:kworker.0 00000100:00080000:2.0:1784290312.360505:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290312.360509:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784290312.360513:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901050368:0@lo:38:kworker.0 00000100:00080000:2.0:1784290312.360563:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290312.360572:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290312.360580:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c24ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901050624:12345-0@lo:38:kworker.0 Request processed in 144us (629us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290312.360581:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901051264:0@lo:38:kworker.0 00000100:00100000:3.0:1784290312.360582:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c24f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1870961901051264:12345-0@lo:38:kworker.0 Request processed in 124us (434us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784290312.360585:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901051136:12345-0@lo:400:kworker.0 Request processed in 126us (575us total) trans 0 rc 0/0 00000100:00080000:2.0:1784290312.360605:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290312.360616:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784290312.360626:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901050624:0@lo:38:kworker.0 00000100:00100000:0.0:1784290312.360632:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1784290312.360633:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1526 00000100:00100000:3.0:1784290312.360643:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00080000:0.0:1784290312.360699:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784290312.360707:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784290312.360716:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290312.360736:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901051008:0@lo:400:kworker.0 00000100:00100000:2.0:1784290312.360744:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290312.360747:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901050496:0@lo:400:kworker.0 00000100:00100000:1.0:1784290312.360791:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901050752 00000100:00100000:1.0:1784290312.360796:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901050752 00000100:00100000:0.0:1784290312.360817:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901051136:0@lo:400:kworker.0 00000100:00080000:2.0:1784290312.360834:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784290312.360864:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:1.0:1784290312.360875:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1870961901050752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290312.360921:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1870961901050752:12345-0@lo:400:kworker.0 Request processed in 48us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290312.360927:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:2.0:1784290312.360958:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1870961901050752:0@lo:400:kworker.0 00010000:00010000:3.0:1784290312.871643:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290313.895496:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290314.408457:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901051392:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784290314.408461:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901051520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290314.408531:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290314.408583:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901051392 00000100:00100000:3.0:1784290314.408584:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290314.408593:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901051392 00000100:00100000:1.0:1784290314.408607:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901051520 00000100:00100000:1.0:1784290314.408612:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901051520 00000100:00080000:3.0:1784290314.408635:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784290314.408641:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290314.408655:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:1.0:1784290314.408673:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:0.0:1784290314.408678:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901051392:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290314.408688:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901051520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784290314.408705:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1784290314.408707:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290314.408771:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901051392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290314.408774:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901051520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290314.408782:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:1.0:1784290314.408796:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:3.0:1784290314.408810:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901051392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290314.408843:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901051520:0@lo:13:osp-pre-0-1.0 00000400:00000100:1.0:1784290314.758393:0:3612:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.6@tcp portal 26 match 1870961896221312 offset 0 length 224: 4 00000100:00100000:1.0:1784290314.758435:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290314.758463:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290314.758499:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896221440 00000100:00100000:1.0:1784290314.758500:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290314.758519:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896221440 00000100:00100000:0.0:1784290314.758522:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896221568 00000100:00100000:0.0:1784290314.758536:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896221568 00000100:00100000:1.0:1784290314.758537:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00080000:1.0:1784290314.758587:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784290314.758610:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1088 00000100:00100000:3.0:1784290314.758624:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1870961896221440:12345-192.168.202.6@tcp:38:kworker.0 00010000:00020000:3.0:1784290314.758654:0:65988:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290314.758660:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 653 00000100:00100000:0.0:1784290314.758681:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2399:x1870961896221568:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290314.758741:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1870961896221440:12345-192.168.202.6@tcp:38:kworker.0 Request processed in 120us (305us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784290314.758749:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1088 00000100:00100000:0.0:1784290314.758772:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2399:x1870961896221568:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 91us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290314.758787:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 653 00000100:00100000:3.0:1784290314.758821:0:26253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896221696 00000100:00100000:3.0:1784290314.758830:0:26253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896221696 00000100:00100000:0.0:1784290314.758837:0:26263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896221824 00000100:00100000:0.0:1784290314.758845:0:26263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896221824 00000100:00080000:1.0:1784290314.758871:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784290314.758877:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784290314.758958:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1527 00000100:00100000:3.0:1784290314.758979:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2400:x1870961896221696:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290314.758980:0:26255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1528 00000100:00100000:1.0:1784290314.759004:0:26255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2399:x1870961896221824:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290314.759063:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2400:x1870961896221696:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 81us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290314.759094:0:26255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2399:x1870961896221824:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 78us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290314.759104:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1527 00000100:00100000:1.0:1784290314.759117:0:26255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1528 00010000:00010000:0.0:1784290314.920433:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290315.943519:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784290316.589556:0:88724:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784290316.589560:0:88724:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1784290316.589562:0:88724:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1784290316.589647:0:88724:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9c24444ab000 00000020:01000004:2.0:1784290316.589659:0:88724:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1784290316.589672:0:88724:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1784290316.589683:0:88724:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c2445c14d40) 00000020:00000080:2.0:1784290316.589698:0:88724:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1784290316.637776:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1784290316.638325:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1784290316.640387:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1784290316.641335:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1784290316.641470:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1784290316.641598:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1784290316.641761:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1784290316.641919:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1784290316.642053:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1784290316.642188:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1784290316.642310:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1784290316.642447:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1784290316.642582:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1784290316.642721:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1784290316.642880:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1784290316.643048:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1784290316.643171:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1784290316.643293:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1784290316.643427:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1784290316.643582:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1784290316.643705:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1784290316.643833:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1784290316.643987:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1784290316.644159:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1784290316.644280:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1784290316.644402:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1784290316.644554:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1784290316.644706:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1784290316.644825:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1784290316.644952:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1784290316.645078:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1784290316.645236:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1784290316.645358:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1784290316.645480:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1784290316.645631:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1784290316.646130:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1784290316.646257:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1784290316.646458:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1784290316.646576:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1784290316.646744:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1784290316.646859:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1784290316.646980:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1784290316.647100:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1784290316.647225:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1784290316.647368:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1784290316.647502:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1784290316.647635:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1784290316.647999:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1784290316.648228:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1784290316.648360:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1784290316.648632:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1784290316.648767:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1784290316.648883:0:88724:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:1.0:1784290316.649155:0:88724:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1784290316.649294:0:88724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1784290316.649299:0:88724:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784290316.649307:0:88724:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3073d47 00000020:01000004:1.0:1784290316.649312:0:88724:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1784290316.649321:0:88724:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1784290316.649325:0:88724:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c24444ab000 from MGS 00000020:01000004:1.0:1784290316.649328:0:88724:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1784290316.649334:0:88724:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c246ff6cd40) 00000020:00000080:1.0:1784290316.649367:0:88724:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:1.0:1784290316.649410:0:88724:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c24444ab000 from MGS, refs=2 00080000:01000000:1.0:1784290316.649413:0:88724:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784290316.649419:0:88724:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3073d55 00010000:00010000:1.0:1784290316.649521:0:88724:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1784290316.651272:0:88724:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1784290316.651684:0:88728:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1784290316.651707:0:88724:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1784290316.651751:0:88724:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784290316.652109:0:88724:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1784290316.652519:0:88724:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784290316.652702:0:88724:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1784290316.652709:0:88724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1784290316.653129:0:88724:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1784290316.653136:0:88724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1784290316.653322:0:88724:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1784290316.653329:0:88724:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1784290316.653646:0:88724:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1784290316.653659:0:88724:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1784290316.653661:0:88724:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.106@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1784290316.653663:0:88724:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.106@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:1.0:1784290316.653668:0:88724:0:(import.c:65:import_set_state_nolock()) ffff9c2447cad800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1784290316.653672:0:88724:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1784290316.653675:0:88724:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.106@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1784290316.653676:0:88724:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1784290316.653684:0:88724:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2474e8c380 x1870961901048832/t0(0) o400->MGC192.168.202.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784290323 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290316.653702:0:88724:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2345b31180 x1870961901050240/t0(0) o400->MGC192.168.202.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784290328 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1784290316.653714:0:88724:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1784290316.653717:0:88724:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1784290316.653718:0:88724:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1784290316.653720:0:88724:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:0.0:1784290316.653739:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901048832:0@lo:400:kworker.0 00000100:00100000:2.0:1784290316.653760:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345b31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901050240:0@lo:400:kworker.0 10000000:01000000:1.0:1784290316.653779:0:88724:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1784290316.653793:0:88724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b307397a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073981 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290316.653802:0:88724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b307397a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073981 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290316.653807:0:88724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784290316.653818:0:88724:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290316.653826:0:88724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b307397a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073981 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.653843:0:88724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30738e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b30738e7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290316.653855:0:88724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30738e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b30738e7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290316.653859:0:88724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290316.653867:0:88724:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290316.653870:0:88724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30738e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b30738e7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.653877:0:88724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c234236de00/0x5953bbf6b30738fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073903 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290316.653882:0:88724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c234236de00/0x5953bbf6b30738fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073903 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290316.653887:0:88724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290316.653891:0:88724:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290316.653894:0:88724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c234236de00/0x5953bbf6b30738fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073903 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.653902:0:88724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c234236ce00/0x5953bbf6b3073926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b307392d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290316.653907:0:88724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c234236ce00/0x5953bbf6b3073926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b307392d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290316.653911:0:88724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290316.653918:0:88724:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290316.653920:0:88724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c234236ce00/0x5953bbf6b3073926 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b307392d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.653937:0:88724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450ab200/0x5953bbf6b3073934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b307393b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290316.653942:0:88724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450ab200/0x5953bbf6b3073934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b307393b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290316.653946:0:88724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290316.653952:0:88724:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290316.653955:0:88724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450ab200/0x5953bbf6b3073934 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b307393b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.653963:0:88724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2469a7dc00/0x5953bbf6b3073950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073957 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290316.653968:0:88724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2469a7dc00/0x5953bbf6b3073950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073957 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290316.653971:0:88724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290316.653976:0:88724:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290316.653980:0:88724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2469a7dc00/0x5953bbf6b3073950 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073957 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.653987:0:88724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2469a7d400/0x5953bbf6b307395e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073965 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290316.653992:0:88724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2469a7d400/0x5953bbf6b307395e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073965 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290316.653995:0:88724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290316.654006:0:88724:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290316.654010:0:88724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2469a7d400/0x5953bbf6b307395e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073965 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.654018:0:88724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c234236da00/0x5953bbf6b3073988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b307398f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290316.654023:0:88724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c234236da00/0x5953bbf6b3073988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b307398f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290316.654027:0:88724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290316.654042:0:88724:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290316.654045:0:88724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c234236da00/0x5953bbf6b3073988 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b307398f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.654060:0:88724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2482044200/0x5953bbf6b30738ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b30738f5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290316.654065:0:88724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2482044200/0x5953bbf6b30738ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b30738f5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290316.654069:0:88724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290316.654075:0:88724:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290316.654079:0:88724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2482044200/0x5953bbf6b30738ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b30738f5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.654094:0:88724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b307390a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073911 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290316.654099:0:88724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b307390a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073911 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290316.654111:0:88724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290316.654120:0:88724:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290316.654125:0:88724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b307390a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073911 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.654144:0:88724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c234236c400/0x5953bbf6b3073918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b307391f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290316.654149:0:88724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c234236c400/0x5953bbf6b3073918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b307391f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290316.654153:0:88724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784290316.654158:0:88724:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290316.654161:0:88724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c234236c400/0x5953bbf6b3073918 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b307391f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.654169:0:88724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2482045800/0x5953bbf6b3073942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073949 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290316.654174:0:88724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2482045800/0x5953bbf6b3073942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073949 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290316.654178:0:88724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784290316.654183:0:88724:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290316.654186:0:88724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2482045800/0x5953bbf6b3073942 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073949 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.654195:0:88724:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450aac00/0x5953bbf6b307396c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073973 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290316.654208:0:88724:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aac00/0x5953bbf6b307396c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073973 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290316.654211:0:88724:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784290316.654217:0:88724:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290316.654221:0:88724:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450aac00/0x5953bbf6b307396c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073973 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784290316.654244:0:88724:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c2447cad800 already not connected (conn 48, was 0): DISCONN 00000100:00080000:1.0:1784290316.654248:0:88724:0:(import.c:65:import_set_state_nolock()) ffff9c2447cad800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290316.654251:0:88724:0:(import.c:510:import_select_connection()) MGC192.168.202.106@tcp: connect to NID 0@lo last attempt 2027 00000100:00080000:1.0:1784290316.654256:0:88724:0:(import.c:624:import_select_connection()) MGC192.168.202.106@tcp: import ffff9c2447cad800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290316.654277:0:88724:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a540700 x1870961901051648/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784290316.654294:0:88724:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1784290316.654316:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e54cd1c-9dbd-4e31-b60e-998135d46053:3616:1870961901051648:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1784290316.654403:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290316.654430:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901051648 00000100:00100000:0.0:1784290316.654437:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901051648 00000100:00100000:0.0:1784290316.654467:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784290316.654473:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3616:x1870961901051648:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1784290316.654499:0:88729:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo t0 exp 0000000000000000 cur 2057 last 0 00000020:00000080:0.0:1784290316.654522:0:88729:0:(genops.c:1406:class_connect()) connect: client 2e54cd1c-9dbd-4e31-b60e-998135d46053, cookie 0x5953bbf6b3073d5c 00000100:00080000:0.0:1784290316.654641:0:88729:0:(import.c:65:import_set_state_nolock()) ffff9c2344b52800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290316.654696:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:3616:x1870961901051648:12345-0@lo:250:mount.lustre.0 Request processed in 223us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290316.654702:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784290316.654723:0:3616:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.106@tcp: committing for last_committed 0 gen 25 00000100:00080000:2.0:1784290316.654731:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.106@tcp: connect to target with instance 0 00000100:00080000:2.0:1784290316.654737:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1784290316.654739:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1784290316.654742:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2447cad800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1784290316.654744:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1784290316.654765:0:3616:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1784290316.654777:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e54cd1c-9dbd-4e31-b60e-998135d46053:3616:1870961901051648:0@lo:250:mount.lustre.0 00000100:00080000:1.0:1784290316.654786:0:88724:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1784290316.654794:0:88724:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000000:0.0:1784290316.654794:0:83795:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.202.106@tcp 10000000:01000000:0.0:1784290316.654809:0:83795:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1784290316.654812:0:83795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1784290316.654814:0:83795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784290316.654815:0:88724:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 00000020:01000004:0.0:1784290316.654816:0:83795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784290316.654820:0:83795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 10000000:01000000:1.0:1784290316.654822:0:88724:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000020:01000004:0.0:1784290316.654823:0:83795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784290316.654826:0:83795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784290316.654828:0:83795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784290316.654830:0:83795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784290316.654831:0:83795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1784290316.654862:0:83795:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1784290316.654867:0:83795:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000040:01000000:1.0:1784290316.654868:0:88724:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784290316.654869:0:83795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1784290316.654873:0:83795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784290316.654875:0:83795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784290316.654876:0:83795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784290316.654877:0:83795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784290316.654879:0:83795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784290316.654879:0:83795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784290316.654880:0:83795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784290316.654881:0:83795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1784290316.654890:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901051776:0@lo:253:kworker.0 00000020:01000004:1.0:1784290316.654895:0:88724:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.106@tcp, index=0000, flags=0x20005 00000020:01000000:0.0:1784290316.654895:0:83795:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000020:01000004:1.0:1784290316.654901:0:88724:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 10000000:01000000:0.0:1784290316.654903:0:83795:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1784290316.654904:0:88724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784290316.654908:0:83795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784290316.654909:0:88724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290316.654913:0:88724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784290316.654913:0:83795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784290316.654917:0:83795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290316.654918:0:88724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290316.654922:0:88724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784290316.654922:0:83795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290316.654927:0:88724:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784290316.654927:0:83795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290316.654929:0:88724:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784290316.654930:0:88724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784290316.654936:0:83795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290316.654938:0:88724:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00100000:2.0:1784290316.654940:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1784290316.654940:0:83795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 10000000:01000000:1.0:1784290316.654942:0:88724:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1784290316.654943:0:83795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290316.654947:0:88724:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784290316.654947:0:83795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000004:1.0:1784290316.654951:0:88724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784290316.654953:0:88724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290316.654954:0:88724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290316.654956:0:88724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290316.654957:0:88724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290316.654958:0:88724:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784290316.654959:0:88724:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784290316.654960:0:88724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290316.654963:0:88724:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00100000:2.0:1784290316.654968:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784290316.654976:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901051904:0@lo:253:kworker.0 10000000:01000000:1.0:1784290316.654978:0:88724:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000020:01000000:0.0:1784290316.654979:0:83795:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1784290316.654995:0:88724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a542680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901052160:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784290316.654996:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901052032:0@lo:253:kworker.0 00000100:00100000:2.0:1784290316.655008:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290316.655008:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901051776 00000100:00100000:0.0:1784290316.655014:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901051776 00000100:00100000:1.0:1784290316.655055:0:88724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290316.655073:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901051904 00000100:00100000:2.0:1784290316.655074:0:88731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901052160 00000100:00100000:1.0:1784290316.655074:0:88724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24412ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1784290316.655079:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290316.655079:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901051904 00000100:00100000:2.0:1784290316.655082:0:88731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901052160 00000100:00100000:0.0:1784290316.655102:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901052032 00000100:00100000:0.0:1784290316.655107:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901052032 00000100:00100000:2.0:1784290316.655115:0:88731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784290316.655126:0:88731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:3619:x1870961901051776:12345-0@lo:253:kworker.0 00000100:00100000:0.0:1784290316.655130:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784290316.655142:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:3619:x1870961901051904:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1784290316.655147:0:88731:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784290316.655164:0:88729:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:0.0:1784290316.655289:0:88733:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1784290316.655332:0:88731:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 108 20000000:01000000:1.0:1784290316.656335:0:88734:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1784290316.656356:0:88734:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1784290316.656360:0:88734:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1784290316.656362:0:88734:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1784290316.656478:0:88734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1784290316.656576:0:88731:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784290316.656599:0:88731:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784290316.657269:0:88731:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784290316.657279:0:88731:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1784290316.657289:0:88733:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 20000000:01000000:0.0:1784290316.657290:0:88729:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 10000000:01000000:1.0:1784290316.657295:0:88733:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784290316.657310:0:88733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c24429dee00/0x5953bbf6b3073d63 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.657321:0:88733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c24429dee00/0x5953bbf6b3073d63 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784290316.657328:0:88733:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000033632s 00010000:00010000:1.0:1784290316.657331:0:88733:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c24429dee00/0x5953bbf6b3073d63 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.657336:0:88733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c24429dee00/0x5953bbf6b3073d63 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.657431:0:88733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c24429dee00/0x5953bbf6b3073d63 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.657438:0:88733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c24429dee00/0x5953bbf6b3073d63 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290316.657446:0:88731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:3619:x1870961901051776:12345-0@lo:253:kworker.0 Request processed in 2320us (2507us total) trans 0 rc 0/0 00010000:00010000:1.0:1784290316.657446:0:88733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429dee00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290316.657453:0:88733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c24429dee00/0x5953bbf6b3073d63 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784290316.657461:0:3619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00010000:00010000:1.0:1784290316.657461:0:88733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c24429dee00/0x5953bbf6b3073d63 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290316.657466:0:88731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:2.0:1784290316.657468:0:3619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784290316.657472:0:3619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784290316.657476:0:3619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784290316.657478:0:3619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784290316.657480:0:3619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00010000:00010000:1.0:1784290316.657481:0:88733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c24429dee00/0x5953bbf6b3073d63 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784290316.657482:0:3619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00010000:00010000:1.0:1784290316.657489:0:88733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c24429dee00/0x5953bbf6b3073d63 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784290316.657494:0:3619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00010000:00010000:1.0:1784290316.657496:0:88733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c24429dee00/0x5953bbf6b3073d63 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784290316.657498:0:3619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1784290316.657506:0:88731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784290316.657507:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c535180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901051776:0@lo:253:kworker.0 00000100:00100000:3.0:1784290316.657520:0:88731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234444ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:88724:x1870961901052160:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784290316.657557:0:88731:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784290316.657560:0:88731:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784290316.657562:0:88731:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1784290316.657567:0:88731:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1784290316.658515:0:88729:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784290316.658524:0:88729:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1784290316.658534:0:88733:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784290316.658538:0:88733:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784290316.658547:0:88733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c24429df200/0x5953bbf6b3073d6a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.658554:0:88733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c24429df200/0x5953bbf6b3073d6a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290316.658563:0:88731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234444ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:88724:x1870961901052160:12345-0@lo:253:mount.lustre.0 Request processed in 1043us (3504us total) trans 0 rc 0/0 20000000:01000000:1.0:1784290316.658565:0:88733:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000033632s 00000100:00100000:3.0:1784290316.658574:0:88731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1784290316.658576:0:88733:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c24429df200/0x5953bbf6b3073d6a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.658583:0:88733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c24429df200/0x5953bbf6b3073d6a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.658589:0:88733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c24429df200/0x5953bbf6b3073d6a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.658594:0:88733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c24429df200/0x5953bbf6b3073d6a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.658598:0:88733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429df200 already unused, calling callback (ffffffffc0ec3230) 00000100:00100000:2.0:1784290316.658600:0:88724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a542680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901052160:0@lo:253:mount.lustre.0 00010000:00010000:1.0:1784290316.658602:0:88733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c24429df200/0x5953bbf6b3073d6a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290316.658611:0:88731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1784290316.658615:0:88733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c24429df200/0x5953bbf6b3073d6a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290316.658620:0:88724:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00010000:00010000:1.0:1784290316.658624:0:88733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c24429df200/0x5953bbf6b3073d6a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784290316.658626:0:88724:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000100:00100000:3.0:1784290316.658627:0:88731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:3617:x1870961901052032:12345-0@lo:253:kworker.0 00000020:01000004:2.0:1784290316.658631:0:88724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784290316.658637:0:88724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784290316.658640:0:88724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00010000:00010000:1.0:1784290316.658640:0:88733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c24429df200/0x5953bbf6b3073d6a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784290316.658645:0:88724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:1.0:1784290316.658648:0:88733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c24429df200/0x5953bbf6b3073d6a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784290316.658650:0:88724:0:(tgt_mount.c:1180:server_mti_print()) flags: 20000000:01000000:3.0:1784290316.658651:0:88731:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000020:01000004:2.0:1784290316.658654:0:88724:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784290316.658659:0:88724:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 20000000:01000000:3.0:1784290316.658662:0:88731:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:01000004:2.0:1784290316.658663:0:88724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784290316.658667:0:88724:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784290316.658688:0:88724:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c24444ab000 from lustre-MDT0000 00000100:00100000:0.0:1784290316.658697:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:3619:x1870961901051904:12345-0@lo:253:kworker.0 Request processed in 3557us (3693us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290316.658706:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:01000000:2.0:1784290316.658715:0:88724:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 00000020:01000004:1.0:1784290316.658718:0:3619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 10000000:01000000:2.0:1784290316.658721:0:88724:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 00000020:01000004:1.0:1784290316.658723:0:3619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784290316.658727:0:3619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290316.658729:0:3619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290316.658731:0:3619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 10000000:01000000:2.0:1784290316.658732:0:88724:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c24444ab000 10000000:01000000:2.0:1784290316.658738:0:88724:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00000020:01000004:1.0:1784290316.658740:0:3619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290316.658744:0:3619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784290316.658747:0:3619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 10000000:01000000:2.0:1784290316.658748:0:88724:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c24444ab000 00000020:01000004:1.0:1784290316.658749:0:3619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784290316.658756:0:88724:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 00000100:00100000:1.0:1784290316.658757:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c536d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901051904:0@lo:253:kworker.0 10000000:01000000:2.0:1784290316.658765:0:88724:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9c24444ab000 from 1 10000000:01000000:2.0:1784290316.658770:0:88724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784290316.658794:0:88724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf400/0x5953bbf6b3073d71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290316.658804:0:88724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf400/0x5953bbf6b3073d71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290316.658814:0:88724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf400/0x5953bbf6b3073d71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290316.658829:0:88724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c24d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901052288:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784290316.658868:0:88724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290316.658900:0:88724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a016d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784290316.658908:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901052288 00000100:00100000:0.0:1784290316.658912:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901052288 00000100:00100000:0.0:1784290316.658935:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784290316.658940:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234444a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:88724:x1870961901052288:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784290316.658948:0:88732:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290316.658958:0:88732:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246dd26600/0x5953bbf6b3073d78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073d71 expref: -99 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.658971:0:88732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd26600/0x5953bbf6b3073d78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073d71 expref: 7 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.658987:0:88732:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246dd26600/0x5953bbf6b3073d78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073d71 expref: 7 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.658992:0:88732:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26600, rc 0) 00000100:00100000:0.0:1784290316.659018:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234444a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:88724:x1870961901052288:12345-0@lo:101:mount.lustre.0 Request processed in 78us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290316.659024:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784290316.659059:0:88724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c24d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901052288:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784290316.659076:0:88724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf400/0x5953bbf6b3073d71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073d78 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290316.659086:0:88724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf400/0x5953bbf6b3073d71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073d78 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290316.659101:0:88724:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784290316.659115:0:88724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf400/0x5953bbf6b3073d71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073d78 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290316.659124:0:88724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf400/0x5953bbf6b3073d71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073d78 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290316.659133:0:88724:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784290316.659138:0:88724:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784290316.659143:0:88724:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c24444ab000 10000000:01000000:2.0:1784290316.659146:0:88724:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1784290316.659149:0:88724:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1784290316.659151:0:88724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784290316.659168:0:88724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b3073d7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290316.659176:0:88724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b3073d7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290316.659184:0:88724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b3073d7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290316.659206:0:88724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c24d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901052416:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784290316.659235:0:88724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290316.659258:0:88724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a016d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784290316.659277:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901052416 00000100:00100000:0.0:1784290316.659281:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901052416 00000100:00100000:0.0:1784290316.659301:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784290316.659307:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234444b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:88724:x1870961901052416:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784290316.659312:0:88729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290316.659318:0:88729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246dd27800/0x5953bbf6b3073d86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073d7f expref: -99 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.659328:0:88729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd27800/0x5953bbf6b3073d86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073d7f expref: 8 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.659333:0:88729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246dd27800/0x5953bbf6b3073d86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073d7f expref: 8 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.659363:0:88729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27800, rc 0) 00000100:00100000:0.0:1784290316.659396:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234444b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:88724:x1870961901052416:12345-0@lo:101:mount.lustre.0 Request processed in 90us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290316.659401:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784290316.659421:0:88724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c24d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901052416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784290316.659437:0:88724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b3073d7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073d86 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290316.659448:0:88724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b3073d7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073d86 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290316.659495:0:88724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c24d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901052544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784290316.659524:0:88724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290316.659558:0:88724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a016d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784290316.659564:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901052544 00000100:00100000:0.0:1784290316.659569:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901052544 00000100:00100000:0.0:1784290316.659600:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784290316.659606:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:88724:x1870961901052544:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784290316.659677:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:88724:x1870961901052544:12345-0@lo:501:mount.lustre.0 Request processed in 72us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290316.659684:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784290316.659701:0:88724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c24d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901052544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784290316.659738:0:88724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c24d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901052672:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784290316.659776:0:88724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290316.659796:0:88724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a016d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784290316.659806:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901052672 00000100:00100000:0.0:1784290316.659810:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901052672 00000100:00100000:0.0:1784290316.659827:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784290316.659834:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:88724:x1870961901052672:12345-0@lo:503:mount.lustre.0 20000000:01000000:3.0:1784290316.659939:0:88731:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784290316.659948:0:88731:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1784290316.659958:0:88733:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784290316.659962:0:88733:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784290316.659971:0:88733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c24429dfa00/0x5953bbf6b3073d8d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.659979:0:88733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c24429dfa00/0x5953bbf6b3073d8d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784290316.659984:0:88733:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000033632s 00010000:00010000:1.0:1784290316.659987:0:88733:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c24429dfa00/0x5953bbf6b3073d8d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.659992:0:88733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c24429dfa00/0x5953bbf6b3073d8d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.659996:0:88733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c24429dfa00/0x5953bbf6b3073d8d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.660001:0:88733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c24429dfa00/0x5953bbf6b3073d8d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.660006:0:88733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429dfa00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290316.660009:0:88733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c24429dfa00/0x5953bbf6b3073d8d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.660013:0:88733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c24429dfa00/0x5953bbf6b3073d8d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.660043:0:88733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c24429dfa00/0x5953bbf6b3073d8d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.660050:0:88733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c24429dfa00/0x5953bbf6b3073d8d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.660055:0:88733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c24429dfa00/0x5953bbf6b3073d8d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290316.660113:0:88731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:3617:x1870961901052032:12345-0@lo:253:kworker.0 Request processed in 1491us (5037us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290316.660123:0:88731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:0.0:1784290316.660138:0:3617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1784290316.660142:0:3617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784290316.660144:0:3617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784290316.660146:0:3617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784290316.660147:0:3617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784290316.660149:0:3617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784290316.660151:0:3617:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784290316.660153:0:3617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784290316.660155:0:3617:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1784290316.660160:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901052032:0@lo:253:kworker.0 00000100:00100000:2.0:1784290316.660193:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:88724:x1870961901052672:12345-0@lo:503:mount.lustre.0 Request processed in 357us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290316.660204:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784290316.660216:0:88724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c24d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901052672:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784290316.660475:0:88735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:88735:1870961901052800:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290316.660511:0:88735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290316.660541:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901052800 00000100:00100000:3.0:1784290316.660543:0:88735:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23432cfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784290316.660547:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901052800 00000100:00100000:2.0:1784290316.660584:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784290316.660593:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234444b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:88735:x1870961901052800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290316.660933:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234444b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:88735:x1870961901052800:12345-0@lo:502:llog_process_th.0 Request processed in 340us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290316.660942:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784290316.660961:0:88735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:88735:1870961901052800:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784290316.660989:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784290316.660998:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290316.661000:0:88735:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784290316.661006:0:88735:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1784290316.661010:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784290316.661019:0:88735:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c23440d4d40) 00000020:00000080:3.0:1784290316.661055:0:88735:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1784290316.661062:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1784290316.661160:0:88735:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:3.0:1784290316.661166:0:88735:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3073d9b 00000020:00000080:3.0:1784290316.661368:0:88735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784290316.661374:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290316.661379:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290316.661381:0:88735:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784290316.661384:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784290316.661388:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290316.661389:0:88735:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1784290316.661393:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784290316.661400:0:88735:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c23440d0000) 00000020:00000080:3.0:1784290316.661413:0:88735:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1784290316.661417:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1784290316.661419:0:88735:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1784290316.661422:0:88735:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1784290316.661429:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784290316.661472:0:88735:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c24444ab000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1784290316.661484:0:88735:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c23440d19c0) 00000020:00000080:3.0:1784290316.661495:0:88735:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1784290316.661541:0:88735:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1784290316.661547:0:88735:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3073db0 00000020:00000080:3.0:1784290316.661643:0:88735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1784290316.661650:0:88735:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1784290316.661655:0:88735:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5953bbf6b3073db7 00080000:01000000:3.0:1784290316.661659:0:88735:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1784290316.661662:0:88735:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3073dbe 00010000:00010000:3.0:1784290316.704228:0:88735:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1784290316.704362:0:88735:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: bd808cf4-dd54-45f0-9b2b-1434e8330e5d idx: 0 lr: 98784247817 srv lr: 103079215104 lx: 0 gen 22 00000001:00080000:3.0:1784290316.704399:0:88735:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 103079215104 lx: 0 gen 21 00000001:00000004:3.0:1784290316.704420:0:88735:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 103079215104 00000001:00080000:3.0:1784290316.704506:0:88735:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1784290316.704553:0:88735:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2341e0f000: xid 1870961896216448, transno 103079215109, client gen 22, slot idx 0 00000001:00080000:3.0:1784290316.704560:0:88735:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2341e0fcc0: xid 1870961896216704, transno 103079215110, client gen 22, slot idx 1 00000020:00000080:3.0:1784290316.704963:0:88735:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c23440d3380) 00000020:00000080:3.0:1784290316.704984:0:88735:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1784290316.705073:0:88735:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784290316.705081:0:88735:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3073dda 00000020:00000080:3.0:1784290316.705497:0:88735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1784290316.707417:0:88735:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5953bbf6b3073de1 00000020:00000080:0.0:1784290316.707632:0:88735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1784290316.707643:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784290316.707649:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290316.707651:0:88735:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1784290316.707653:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784290316.707655:0:88735:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1784290316.707656:0:88735:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784290316.707657:0:88735:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784290316.707659:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784290316.707662:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290316.707663:0:88735:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784290316.707665:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784290316.707669:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290316.707676:0:88735:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1784290316.707681:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1784290316.707724:0:88735:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1784290316.707742:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784290316.707745:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290316.707746:0:88735:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1784290316.707748:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784290316.707751:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290316.707752:0:88735:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1784290316.707756:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784290316.707760:0:88735:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:00000080:0.0:1784290316.707784:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784290316.707792:0:88735:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c247d26b380) 00000020:00000080:0.0:1784290316.707802:0:88735:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1784290316.707806:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784290316.707848:0:88735:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1784290316.707851:0:88735:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:0.0:1784290316.707856:0:88735:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3073def 00010000:00080000:0.0:1784290316.707883:0:88735:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2474ee5800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:0.0:1784290316.709284:0:88735:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1784290316.709806:0:88735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784290316.709811:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1784290316.709828:0:88735:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784290316.709839:0:88735:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3073df6 00000100:00080000:0.0:1784290316.709846:0:88735:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784290316.709850:0:88735:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c2474ee5800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290316.709879:0:88735:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c247c535c00 x1870961901052928/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784290316.709900:0:88735:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1784290316.709938:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901052928:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1784290316.709938:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:01000000:0.0:1784290316.709946:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:1.0:1784290316.709949:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290316.709953:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000020:00000080:0.0:1784290316.709956:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290316.709959:0:88735:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000100:00080000:1.0:1784290316.709963:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2053 00000020:01000000:0.0:1784290316.709964:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784290316.709970:0:88735:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000100:00080000:1.0:1784290316.709972:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000020:01000000:0.0:1784290316.709972:0:88735:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784290316.709975:0:88735:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784290316.709978:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784290316.709981:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00080000:1.0:1784290316.709983:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000020:00000080:0.0:1784290316.709984:0:88735:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784290316.709989:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784290316.709993:0:88735:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1784290316.709997:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290316.709999:0:88735:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000100:00100000:2.0:1784290316.710005:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1784290316.710007:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000100:00100000:1.0:1784290316.710008:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a542d80 x1870961901053056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:0.0:1784290316.710014:0:88735:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:01000000:0.0:1784290316.710050:0:88735:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784290316.710055:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000100:00100000:3.0:1784290316.710061:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901052928 00000020:00000080:0.0:1784290316.710065:0:88735:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c247d268000) 00000100:00100000:3.0:1784290316.710071:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901052928 00000100:00080000:1.0:1784290316.710072:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1784290316.710077:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901053056:0@lo:38:kworker.0 00000100:00080000:1.0:1784290316.710079:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290316.710083:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784290316.710085:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901053184:0@lo:400:kworker.0 00000100:00080000:1.0:1784290316.710090:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2053 00000100:00080000:1.0:1784290316.710094:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784290316.710098:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290316.710114:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a540700 x1870961901053312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784290316.710118:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3763 00000100:00100000:2.0:1784290316.710124:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290316.710134:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c24d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901052928:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784290316.710161:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901053312:0@lo:38:kworker.0 00000020:00000080:0.0:1784290316.710163:0:88735:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000100:00080000:1.0:1784290316.710171:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000080:0.0:1784290316.710171:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00010000:00080000:3.0:1784290316.710175:0:23867:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2057 last 0 00000100:00080000:1.0:1784290316.710177:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290316.710189:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1784290316.710194:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784290316.710196:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2053 00000100:00080000:1.0:1784290316.710199:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784290316.710203:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290316.710218:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c247f976d80 x1870961901053568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:3.0:1784290316.710232:0:23867:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3073e04 00000100:00100000:2.0:1784290316.710238:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901053056 00000100:00100000:2.0:1784290316.710244:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901053056 00000004:00100000:3.0:1784290316.710250:0:23867:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000004:00080000:0.0:1784290316.710261:0:88735:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00000100:00080000:1.0:1784290316.710262:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290316.710266:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290316.710268:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1784290316.710269:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901053312 00000100:00080000:1.0:1784290316.710273:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2053 00000100:00100000:2.0:1784290316.710274:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901053312 00000100:00080000:1.0:1784290316.710277:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:0.0:1784290316.710278:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901053824:0@lo:400:kworker.0 00000100:00080000:1.0:1784290316.710284:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290316.710298:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:1.0:1784290316.710300:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2343893800 x1870961901053952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290316.710309:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c24fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901053056:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290316.710317:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290316.710335:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2446e77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901053440:0@lo:400:kworker.0 00000100:00080000:3.0:1784290316.710368:0:23867:0:(import.c:65:import_set_state_nolock()) ffff9c246ff62800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290316.710385:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901053824 00000100:00100000:0.0:1784290316.710389:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901053824 00000100:00100000:2.0:1784290316.710396:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c24fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901053056:12345-0@lo:38:kworker.0 Request processed in 88us (275us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784290316.710407:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:1.0:1784290316.710413:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290316.710435:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c24d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3616:x1870961901052928:12345-0@lo:38:llog_process_th.0 Request processed in 301us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290316.710436:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1529 00000100:00100000:2.0:1784290316.710440:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901053440 00000100:00100000:1.0:1784290316.710444:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784290316.710447:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901053440 00000100:00100000:0.0:1784290316.710451:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901053824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290316.710454:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3763 00000100:00100000:1.0:1784290316.710456:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901053696:0@lo:400:kworker.0 00000100:00100000:1.0:1784290316.710495:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290316.710503:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:0.0:1784290316.710511:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c537480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901053824:12345-0@lo:400:kworker.0 Request processed in 64us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290316.710519:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:2.0:1784290316.710520:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901053440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290316.710534:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901053312:12345-0@lo:38:kworker.0 00000100:00080000:1.0:1784290316.710537:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784290316.710540:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1529 00000100:00080000:1.0:1784290316.710545:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00080000:01000000:1.0:1784290316.710555:0:88735:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000100:00100000:0.0:1784290316.710559:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901053696 00000100:00100000:0.0:1784290316.710564:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901053696 00000020:00000080:1.0:1784290316.710570:0:88735:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3073e0b 00000100:00100000:2.0:1784290316.710584:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901053440:12345-0@lo:400:kworker.0 Request processed in 70us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290316.710593:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:3.0:1784290316.710599:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345b31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901053312:12345-0@lo:38:kworker.0 Request processed in 65us (407us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784290316.710605:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1530 00010000:00080000:1.0:1784290316.710611:0:88735:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c246dce3800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.106@tcp at head 00000100:00100000:3.0:1784290316.710615:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:0.0:1784290316.710619:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901053696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290316.710659:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901053696:12345-0@lo:400:kworker.0 Request processed in 45us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290316.710667:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1530 00000100:00100000:2.0:1784290316.710673:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784290316.710690:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784290316.710714:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901053184 00000100:00100000:3.0:1784290316.710721:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901053184 00000100:00100000:0.0:1784290316.710723:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901053824:0@lo:400:kworker.0 00000100:00080000:0.0:1784290316.710753:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784290316.710766:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901053696:0@lo:400:kworker.0 00000100:00100000:0.0:1784290316.710781:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901053568:0@lo:38:kworker.0 00000100:00100000:2.0:1784290316.710786:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2446e77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901053440:0@lo:400:kworker.0 00000100:00100000:3.0:1784290316.710789:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:3.0:1784290316.710804:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901053184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290316.710816:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784290316.710817:0:88735:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1784290316.710837:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901053568 00000100:00100000:0.0:1784290316.710837:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343893800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901053952:0@lo:38:kworker.0 00000100:00100000:2.0:1784290316.710844:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901053568 00000100:00100000:3.0:1784290316.710871:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901053184:12345-0@lo:400:kworker.0 Request processed in 70us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290316.710878:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290316.710885:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:2.0:1784290316.710885:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3764 00000100:00100000:2.0:1784290316.710897:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c536a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901053568:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1784290316.710907:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1784290316.710910:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901053952 00000100:00080000:0.0:1784290316.710914:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784290316.710917:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901053952 00000100:00100000:0.0:1784290316.710920:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901053312:0@lo:38:kworker.0 00000100:00080000:0.0:1784290316.710931:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290316.710935:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784290316.710939:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901053056:0@lo:38:kworker.0 00000100:00100000:3.0:1784290316.710955:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1784290316.710956:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c536a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901053568:12345-0@lo:38:kworker.0 Request processed in 54us (137us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784290316.710958:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784290316.710966:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00100000:3.0:1784290316.710968:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901053952:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784290316.710970:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3764 00000100:00080000:0.0:1784290316.710974:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1784290316.710985:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1784290316.710988:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2474ee5800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784290316.711001:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c535c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901052928:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784290316.711021:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901053184:0@lo:400:kworker.0 00000100:00100000:3.0:1784290316.711044:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c535f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901053952:12345-0@lo:38:kworker.0 Request processed in 61us (150us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784290316.711054:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00080000:0.0:1784290316.711059:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1784290316.711064:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901054080:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1784290316.711066:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784290316.711073:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901053568:0@lo:38:kworker.0 00000100:00080000:0.0:1784290316.711084:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290316.711086:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784290316.711088:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343893800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901053952:0@lo:38:kworker.0 00000100:00100000:2.0:1784290316.711097:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290316.711132:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901054080 00000100:00100000:3.0:1784290316.711138:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901054080 00000100:00100000:3.0:1784290316.711172:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3765 00000100:00100000:3.0:1784290316.711182:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901054080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784290316.711203:0:8413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:3.0:1784290316.711246:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901054080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290316.711255:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3765 00000100:00100000:2.0:1784290316.711279:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343890a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901054080:0@lo:41:osp-pre-1-0.0 00000040:01000000:1.0:1784290316.711302:0:88735:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784290316.711317:0:88735:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784290316.711464:0:88735:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:1.0:1784290316.711842:0:88735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784290316.711861:0:88735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].25, 64 off9792 00000040:00080000:1.0:1784290316.714090:0:88735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x64:0x0].1, 64 off8256 00000040:00080000:2.0:1784290316.714399:0:88741:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:2.0:1784290316.714406:0:88741:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1784290316.714546:0:88741:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000040:00080000:2.0:1784290316.714571:0:88741:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1784290316.714729:0:88741:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:2.0:1784290316.714735:0:88741:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1784290316.714794:0:88735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784290316.714802:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784290316.714830:0:88735:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784290316.714841:0:88735:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3073e12 00000100:00080000:3.0:1784290316.714847:0:88735:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784290316.714851:0:88735:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c246dce3800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290316.714867:0:88735:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246dee7800 x1870961901054208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784290316.714898:0:88735:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1784290316.714947:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290316.714952:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290316.714955:0:88735:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1784290316.714958:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784290316.714961:0:88735:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1784290316.714965:0:88735:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000100:00100000:0.0:1784290316.714965:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901054208:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1784290316.714969:0:88735:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784290316.714973:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784290316.714977:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290316.714979:0:88735:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784290316.714982:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784290316.714986:0:88735:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1784290316.714990:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290316.714992:0:88735:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1784290316.714998:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784290316.715004:0:88735:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000100:00100000:0.0:1784290316.715005:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1784290316.715023:0:88735:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784290316.715027:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784290316.715053:0:88735:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c24581b4d40) 00000100:00100000:1.0:1784290316.715058:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901054208 00000100:00100000:1.0:1784290316.715063:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901054208 00000020:00000080:3.0:1784290316.715070:0:88735:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1784290316.715078:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1784290316.715090:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4924 00000100:00100000:1.0:1784290316.715095:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c535c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3616:x1870961901054208:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1784290316.715110:0:26258:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2057 last 0 00000020:00000080:1.0:1784290316.715135:0:26258:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3073e20 00000004:00080000:3.0:1784290316.715143:0:88735:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00002000:00100000:1.0:1784290316.715144:0:26258:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c2342ef3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ad ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1784290316.715151:0:26258:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00080000:01000000:3.0:1784290316.715153:0:88735:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00002000:00100000:1.0:1784290316.715153:0:26258:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000080:3.0:1784290316.715163:0:88735:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3073e27 00010000:00080000:3.0:1784290316.715188:0:88735:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2474ee7800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.106@tcp at head 00002000:00080000:1.0:1784290316.715194:0:26258:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784290316.715209:0:26258:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784290316.715245:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c535c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3616:x1870961901054208:12345-0@lo:8:llog_process_th.0 Request processed in 148us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290316.715251:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4924 00000100:00100000:0.0:1784290316.715273:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784290316.715279:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784290316.715284:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784290316.715287:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784290316.715289:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dce3800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784290316.715305:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784290316.715309:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901054208:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1784290316.715317:0:88741:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784290316.715373:0:88741:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2057955030899ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784290316.715378:0:88741:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1784290316.715396:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901054336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784290316.715428:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290316.715462:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901054336 00000100:00100000:2.0:1784290316.715468:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901054336 00010000:00010000:3.0:1784290316.715472:0:88735:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000100:00080000:0.0:1784290316.715491:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784290316.715524:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:2.0:1784290316.715537:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c535880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901054336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784290316.715558:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000040:01000000:3.0:1784290316.715565:0:88735:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784290316.715577:0:88735:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1784290316.715610:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c535880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901054336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290316.715622:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901054336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784290316.715629:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000040:00080000:3.0:1784290316.715639:0:88735:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000004:00080000:1.0:1784290316.716130:0:88725:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:3.0:1784290316.716193:0:88735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784290316.716226:0:88735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].25, 64 off9792 00000040:00080000:3.0:1784290316.716483:0:88735:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x66:0x0].1, 64 off8256 00000040:00080000:3.0:1784290316.716739:0:88743:0:(llog.c:805:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:3.0:1784290316.716743:0:88743:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1784290316.716841:0:88743:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000040:00080000:3.0:1784290316.716855:0:88743:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1784290316.716953:0:88743:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:3.0:1784290316.716958:0:88743:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1784290316.717126:0:88735:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784290316.717134:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784290316.717161:0:88735:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784290316.717174:0:88735:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3073e2e 00000100:00080000:2.0:1784290316.717179:0:88735:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784290316.717183:0:88735:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c2474ee7800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290316.717199:0:88735:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a4fb100 x1870961901054464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784290316.717221:0:88735:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1784290316.717246:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901054464:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1784290316.717279:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1784290316.717280:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1784290316.717286:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290316.717291:0:88735:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1784290316.717296:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784290316.717301:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290316.717303:0:88735:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784290316.717307:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784290316.717310:0:88735:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784290316.717315:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784290316.717318:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1784290316.717319:0:26261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901054464 00000020:00000080:2.0:1784290316.717321:0:88735:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000100:00100000:1.0:1784290316.717324:0:26261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901054464 00000020:01000000:2.0:1784290316.717326:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784290316.717329:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290316.717332:0:88735:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784290316.717363:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784290316.717376:0:26261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4925 00000100:00100000:1.0:1784290316.717383:0:26261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3616:x1870961901054464:12345-0@lo:8:llog_process_th.0 00000100:00100000:2.0:1784290316.717393:0:88735:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:88735:1870961901054592:0@lo:502:llog_process_th.0 00010000:00080000:1.0:1784290316.717400:0:26261:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2057 last 0 00000020:00000080:1.0:1784290316.717414:0:26261:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3073e35 00002000:00100000:1.0:1784290316.717421:0:26261:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c246dcfb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ad ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1784290316.717425:0:26261:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1784290316.717427:0:26261:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1784290316.717447:0:88735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1784290316.717460:0:26261:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784290316.717473:0:26261:0:(import.c:65:import_set_state_nolock()) ffff9c246dcfe000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290316.717493:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901054592 00000100:00100000:2.0:1784290316.717494:0:88735:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290316.717499:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901054592 00000100:00100000:1.0:1784290316.717515:0:26261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c536680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3616:x1870961901054464:12345-0@lo:8:llog_process_th.0 Request processed in 131us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290316.717521:0:26261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4925 00000100:00100000:0.0:1784290316.717534:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784290316.717542:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234444b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:88735:x1870961901054592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290316.717618:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234444b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:88735:x1870961901054592:12345-0@lo:502:llog_process_th.0 Request processed in 77us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290316.717624:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784290316.717655:0:88735:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:88735:1870961901054592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290316.717669:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784290316.717674:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784290316.717679:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784290316.717682:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784290316.717684:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2474ee7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000020:01000000:2.0:1784290316.717691:0:88735:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784290316.717696:0:88735:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290316.717698:0:88735:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000004:00080000:0.0:1784290316.717700:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000040:00080000:2.0:1784290316.717703:0:88735:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:0.0:1784290316.717706:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901054464:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1784290316.717721:0:88743:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1784290316.717748:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901054720:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1784290316.717753:0:88743:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2057957410826ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784290316.717760:0:88743:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:2.0:1784290316.717787:0:88724:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 00000100:00100000:3.0:1784290316.717795:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290316.717825:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901054720 10000000:01000000:2.0:1784290316.717826:0:88724:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:1.0:1784290316.717831:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901054720 00010000:00010000:2.0:1784290316.717849:0:88724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b3073d7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073d86 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290316.717863:0:88724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b3073d7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073d86 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290316.717873:0:88724:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9c24444ab000 from 1 00000100:00100000:1.0:1784290316.717874:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 10000000:01000000:2.0:1784290316.717880:0:88724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:1.0:1784290316.717886:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901054720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784290316.717901:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00010000:00010000:2.0:1784290316.717913:0:88724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b3073e3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290316.717924:0:88724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b3073e3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290316.717935:0:88724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b3073e3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290316.717944:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901054720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (151us total) trans 0 rc 0/0 00000100:00080000:0.0:1784290316.717948:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784290316.717957:0:88724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901054848:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784290316.717959:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:3.0:1784290316.717963:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901054720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290316.717997:0:88724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290316.718021:0:88724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290316.718026:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901054848 00000100:00100000:0.0:1784290316.718048:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901054848 00000100:00100000:0.0:1784290316.718074:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784290316.718080:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:88724:x1870961901054848:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784290316.718088:0:88732:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290316.718141:0:88732:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b3073e43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073e3c expref: -99 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.718161:0:88732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b3073e43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073e3c expref: 9 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.718170:0:88732:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b3073e43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073e3c expref: 9 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.718194:0:88732:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26e00, rc 0) 00000100:00100000:0.0:1784290316.718224:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:88724:x1870961901054848:12345-0@lo:101:mount.lustre.0 Request processed in 145us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290316.718231:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784290316.718266:0:88724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901054848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784290316.718281:0:88724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b3073e3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073e43 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290316.718304:0:88724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b3073e3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073e43 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784290316.718441:0:88725:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1784290316.718894:0:88724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901054976:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1784290316.718929:0:88724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290316.718955:0:88724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290316.719003:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901054976 00000100:00100000:0.0:1784290316.719008:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901054976 00000100:00100000:0.0:1784290316.719047:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784290316.719053:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:88724:x1870961901054976:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1784290316.719066:0:88729:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1784290316.719079:0:88729:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784290316.719083:0:88729:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784290316.719085:0:88729:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784290316.719087:0:88729:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 111 00000100:00100000:0.0:1784290316.719156:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344448050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:88724:x1870961901054976:12345-0@lo:256:mount.lustre.0 Request processed in 102us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290316.719162:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784290316.719169:0:88724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901054976:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1784290316.719952:0:88724:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784290316.719971:0:88724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b3073e3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073e43 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290316.719982:0:88724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b3073e3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073e43 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290316.719991:0:88724:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c24444ab000 from 1 10000000:01000000:2.0:1784290316.719993:0:88724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784290316.720010:0:88724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073e4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290316.720019:0:88724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073e4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290316.720027:0:88724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073e4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290316.720061:0:88724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901055104:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784290316.720092:0:88724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290316.720127:0:88724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290316.720148:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901055104 00000100:00100000:0.0:1784290316.720154:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901055104 00000100:00100000:0.0:1784290316.720180:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784290316.720185:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:88724:x1870961901055104:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784290316.720191:0:88732:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290316.720200:0:88732:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246dd26400/0x5953bbf6b3073e51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073e4a expref: -99 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.720212:0:88732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd26400/0x5953bbf6b3073e51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073e4a expref: 10 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.720229:0:88732:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246dd26400/0x5953bbf6b3073e51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073e4a expref: 10 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.720234:0:88732:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26400, rc 0) 00000100:00100000:0.0:1784290316.720264:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:88724:x1870961901055104:12345-0@lo:101:mount.lustre.0 Request processed in 79us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290316.720270:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784290316.720290:0:88724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901055104:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784290316.720305:0:88724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073e4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073e51 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290316.720315:0:88724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073e4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073e51 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290316.720386:0:88724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901055232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784290316.720415:0:88724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290316.720448:0:88724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290316.720451:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901055232 00000100:00100000:0.0:1784290316.720455:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901055232 00000100:00100000:0.0:1784290316.720477:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784290316.720481:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:88724:x1870961901055232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784290316.720550:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:88724:x1870961901055232:12345-0@lo:501:mount.lustre.0 Request processed in 68us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290316.720556:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784290316.720576:0:88724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901055232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784290316.720607:0:88724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901055360:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784290316.720648:0:88724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290316.720670:0:88724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290316.720670:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901055360 00000100:00100000:0.0:1784290316.720676:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901055360 00000100:00100000:0.0:1784290316.720705:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784290316.720712:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:88724:x1870961901055360:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784290316.720791:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:88724:x1870961901055360:12345-0@lo:503:mount.lustre.0 Request processed in 79us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290316.720798:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784290316.720812:0:88724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901055360:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784290316.721005:0:88745:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:88745:1870961901055488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290316.721056:0:88745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290316.721076:0:88745:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290316.721091:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901055488 00000100:00100000:0.0:1784290316.721095:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901055488 00000100:00100000:0.0:1784290316.721117:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784290316.721121:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:88745:x1870961901055488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290316.721305:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:88745:x1870961901055488:12345-0@lo:502:llog_process_th.0 Request processed in 183us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290316.721315:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784290316.721363:0:88745:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:88745:1870961901055488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784290316.721388:0:88745:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784290316.721394:0:88745:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290316.721396:0:88745:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784290316.721402:0:88745:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c24444ab000 00000020:00000080:2.0:1784290316.721405:0:88745:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784290316.721413:0:88745:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784290316.721421:0:88745:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290316.721423:0:88745:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784290316.721426:0:88745:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784290316.721429:0:88745:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290316.721430:0:88745:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784290316.721434:0:88745:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c24444ab000 00000020:00000080:2.0:1784290316.721436:0:88745:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784290316.721501:0:88745:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:88745:1870961901055616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290316.721538:0:88745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290316.721571:0:88745:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290316.721581:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901055616 00000100:00100000:3.0:1784290316.721587:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901055616 00000100:00100000:3.0:1784290316.721620:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784290316.721628:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:88745:x1870961901055616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290316.721718:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:88745:x1870961901055616:12345-0@lo:502:llog_process_th.0 Request processed in 90us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290316.721727:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784290316.721747:0:88745:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:88745:1870961901055616:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784290316.721775:0:88745:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784290316.721780:0:88745:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290316.721782:0:88745:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784290316.721785:0:88745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784290316.721847:0:88724:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1784290316.721867:0:88724:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784290316.721879:0:88724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073e4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073e51 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.721894:0:88724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073e4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073e51 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290316.721949:0:88724:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784290316.721952:0:88724:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c24444ab000 10000000:01000000:1.0:1784290316.721955:0:88724:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c24444ab000 10000000:01000000:1.0:1784290316.721961:0:88724:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784290316.721966:0:88724:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c24444ab000 from 1 10000000:01000000:1.0:1784290316.721968:0:88724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784290316.721990:0:88724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24429dfa00/0x5953bbf6b3073e58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.721996:0:88724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24429dfa00/0x5953bbf6b3073e58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.722002:0:88724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24429dfa00/0x5953bbf6b3073e58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290316.722014:0:88724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901055744:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784290316.722060:0:88724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290316.722077:0:88724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290316.722098:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901055744 00000100:00100000:2.0:1784290316.722104:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901055744 00000100:00100000:2.0:1784290316.722136:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784290316.722146:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:88724:x1870961901055744:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784290316.722155:0:88729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290316.722168:0:88729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebf600/0x5953bbf6b3073e5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073e58 expref: -99 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290316.722186:0:88729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebf600/0x5953bbf6b3073e5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073e58 expref: 11 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290316.722197:0:88729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebf600/0x5953bbf6b3073e5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073e58 expref: 11 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290316.722205:0:88729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebf600, rc 0) 00000100:00100000:2.0:1784290316.722260:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:88724:x1870961901055744:12345-0@lo:101:mount.lustre.0 Request processed in 115us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290316.722269:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784290316.722272:0:88724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901055744:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784290316.722286:0:88724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24429dfa00/0x5953bbf6b3073e58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073e5f expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290316.722293:0:88724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24429dfa00/0x5953bbf6b3073e58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073e5f expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290316.722368:0:88724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901055872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784290316.722399:0:88724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290316.722429:0:88724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290316.722432:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901055872 00000100:00100000:2.0:1784290316.722439:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901055872 00000100:00100000:2.0:1784290316.722476:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784290316.722486:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:88724:x1870961901055872:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784290316.722579:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:88724:x1870961901055872:12345-0@lo:501:mount.lustre.0 Request processed in 94us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290316.722589:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784290316.722595:0:88724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901055872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784290316.722621:0:88724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901056000:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784290316.722652:0:88724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290316.722666:0:88724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290316.722678:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901056000 00000100:00100000:2.0:1784290316.722684:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901056000 00000100:00100000:2.0:1784290316.722719:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784290316.722729:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:88724:x1870961901056000:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784290316.722818:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:88724:x1870961901056000:12345-0@lo:503:mount.lustre.0 Request processed in 91us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290316.722824:0:88724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901056000:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784290316.722831:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784290316.723006:0:88747:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:88747:1870961901056128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290316.723048:0:88747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290316.723062:0:88747:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1784290316.723075:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901056128 00000100:00100000:2.0:1784290316.723081:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901056128 00000100:00100000:2.0:1784290316.723111:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784290316.723121:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:88747:x1870961901056128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290316.723215:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:88747:x1870961901056128:12345-0@lo:502:llog_process_th.0 Request processed in 95us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290316.723218:0:88747:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:88747:1870961901056128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290316.723233:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000020:01000004:1.0:1784290316.723269:0:88747:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1784290316.723276:0:88747:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c246ff68000) 00000020:00000080:1.0:1784290316.723288:0:88747:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1784290316.723410:0:88747:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c24444ab000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784290316.723414:0:88747:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c24444ab000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784290316.723416:0:88747:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c24444ab000 4 00010000:00080000:1.0:1784290316.723433:0:88747:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c246ff1c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:1.0:1784290316.725180:0:88747:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1784290316.725253:0:88747:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1784290316.725285:0:88747:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784290316.725292:0:88747:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5953bbf6b3073e6d 00000100:00080000:1.0:1784290316.725297:0:88747:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784290316.725307:0:88747:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c246ff1c000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290316.725323:0:88747:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2343891c00 x1870961901056256/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784290316.725361:0:88747:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784290316.725377:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901056256:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784290316.725410:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290316.725439:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901056256 00000100:00100000:1.0:1784290316.725444:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901056256 00000100:00100000:1.0:1784290316.725473:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:1.0:1784290316.725479:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901056256:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784290316.725524:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c536d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901056256:12345-0@lo:38:llog_process_th.0 Request processed in 46us (113us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784290316.725529:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00100000:0.0:1784290316.725539:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784290316.725545:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246ff1c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290316.725548:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784290316.725551:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901056256:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784290316.725635:0:88747:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:88747:1870961901056384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290316.725685:0:88747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290316.725706:0:88747:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1784290316.725719:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901056384 00000100:00100000:0.0:1784290316.725723:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901056384 00000100:00100000:0.0:1784290316.725751:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784290316.725758:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:88747:x1870961901056384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290316.725837:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:88747:x1870961901056384:12345-0@lo:502:llog_process_th.0 Request processed in 79us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290316.725842:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784290316.725879:0:88747:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:88747:1870961901056384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290316.725915:0:88747:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c535180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:88747:1870961901056512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290316.725945:0:88747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290316.725962:0:88747:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dab4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784290316.725983:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901056512 00000100:00100000:3.0:1784290316.725989:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901056512 00000100:00100000:3.0:1784290316.726022:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784290316.726043:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:88747:x1870961901056512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290316.726138:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:88747:x1870961901056512:12345-0@lo:502:llog_process_th.0 Request processed in 105us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290316.726144:0:88747:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c535180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:88747:1870961901056512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290316.726150:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000040:00080000:0.0:1784290316.726170:0:88747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1784290316.726230:0:88724:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1784290316.726256:0:88724:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290316.726279:0:88724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24429dfa00/0x5953bbf6b3073e58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073e5f expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290316.726288:0:88724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24429dfa00/0x5953bbf6b3073e58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073e5f expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784290316.726330:0:88724:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1784290316.726333:0:88724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784290316.726335:0:88724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784290316.726337:0:88724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784290316.726385:0:88724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784290316.726387:0:88724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784290316.726389:0:88724:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784290316.726390:0:88724:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784290316.726392:0:88724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784290316.726394:0:88724:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784290316.726397:0:88724:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1784290316.726400:0:88724:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784290316.726401:0:88724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784290316.726403:0:88724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784290316.726404:0:88724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784290316.726406:0:88724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784290316.726407:0:88724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784290316.726409:0:88724:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784290316.726410:0:88724:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784290316.726412:0:88724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784290316.726414:0:88724:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1784290316.726427:0:88724:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784290316.726438:0:88724:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901056640:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784290316.726475:0:88724:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290316.726507:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901056640 00000100:00100000:0.0:1784290316.726511:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901056640 00000100:00100000:3.0:1784290316.726512:0:88724:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2447cccc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784290316.726542:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784290316.726550:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:88724:x1870961901056640:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784290316.726573:0:88729:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784290316.726582:0:88729:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784290316.727994:0:88729:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784290316.728010:0:88729:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1784290316.728029:0:88733:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784290316.728044:0:88733:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784290316.728055:0:88733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c246dd26000/0x5953bbf6b3073e74 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.728066:0:88733:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b3073e43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073e3c expref: 11 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.728073:0:88733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c246dd26000/0x5953bbf6b3073e74 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.728095:0:88733:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b3073e43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3073e3c expref: 11 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.728105:0:88733:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b3073e43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3073e3c expref: 11 pid: 88732 timeout: 2157 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290316.728113:0:88733:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c535180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:88733:1870961901056768:0@lo:104: 00000100:00100000:0.0:1784290316.728140:0:88733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290316.728172:0:88733:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dab4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784290316.728191:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901056768 00000100:00100000:3.0:1784290316.728197:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901056768 00000100:00100000:0.0:1784290316.728223:0:88724:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:88724:1870961901056640:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784290316.728227:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:88724:x1870961901056640:12345-0@lo:253:mount.lustre.0 Request processed in 1674us (1748us total) trans 0 rc 0/0 10000000:01000000:0.0:1784290316.728236:0:88724:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000100:00100000:3.0:1784290316.728241:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000020:01000004:0.0:1784290316.728241:0:88724:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784290316.728245:0:88724:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784290316.728249:0:88724:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784290316.728251:0:88724:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784290316.728253:0:88724:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784290316.728254:0:88724:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784290316.728257:0:88724:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000100:00100000:2.0:1784290316.728259:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784290316.728260:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a542680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:88733:x1870961901056768:12345-0@lo:104: 00000020:01000004:0.0:1784290316.728267:0:88724:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784290316.728269:0:88724:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784290316.728270:0:88724:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784290316.728282:0:88724:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1784290316.728286:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b3073e3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3073e43 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290316.728369:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784290316.728377:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a542680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:88733:x1870961901056768:12345-0@lo:104: Request processed in 122us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290316.728384:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00010000:00010000:0.0:1784290316.728631:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290316.728636:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b3073e3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3073e43 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.728643:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebfe00 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:0.0:1784290316.728646:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b3073e3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3073e43 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.728653:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b3073e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3073e43 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290316.728659:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b3073e3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3073e43 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290316.728662:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784290316.728687:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b3073e3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3073e43 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.728692:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784290316.728709:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b3073e3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3073e43 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.728714:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2345ebfe00/0x5953bbf6b3073e3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3073e43 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290316.728718:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1784290316.728726:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290316.728729:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290316.728731:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290316.728733:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901056896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290316.728765:0:88733:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c535180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:88733:1870961901056768:0@lo:104: 00010000:00010000:0.0:1784290316.728780:0:88733:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c246dd26000/0x5953bbf6b3073e74 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290316.728784:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290316.728814:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901056896 00000100:00100000:0.0:1784290316.728818:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901056896 00010000:00010000:0.0:1784290316.728832:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b3073e43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3073e3c expref: 11 pid: 88732 timeout: 2157 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290316.728854:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:0.0:1784290316.728860:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245818d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:3618:x1870961901056896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290316.728868:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290316.728872:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b3073e43 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3073e3c expref: 11 pid: 88732 timeout: 2157 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.728880:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b3073e43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3073e3c expref: 11 pid: 88732 timeout: 2157 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.728890:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b3073e43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3073e3c expref: 11 pid: 88732 timeout: 2157 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.728899:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c246dd26000/0x5953bbf6b3073e74 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.728904:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd26000/0x5953bbf6b3073e74 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784290316.728912:0:6475:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000868501s 00010000:00010000:0.0:1784290316.728915:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c246dd26000/0x5953bbf6b3073e74 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.728929:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c246dd26000/0x5953bbf6b3073e74 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.728935:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c246dd26000/0x5953bbf6b3073e74 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.728939:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c246dd26000/0x5953bbf6b3073e74 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.728942:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290316.728945:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c246dd26000/0x5953bbf6b3073e74 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.728951:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c246dd26000/0x5953bbf6b3073e74 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.728964:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c246dd26000/0x5953bbf6b3073e74 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290316.728972:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290316.728984:0:88733:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c246dd26000/0x5953bbf6b3073e74 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290316.728994:0:88733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c246dd26000/0x5953bbf6b3073e74 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290316.729000:0:88733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd26000/0x5953bbf6b3073e74 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290316.729006:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245818d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:3618:x1870961901056896:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290316.729015:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00100000:3.0:1784290316.729052:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901056896:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1784290316.731415:0:88724:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444064 00000040:01000000:0.0:1784290316.731540:0:88724:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1784290316.731542:0:88753:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444064 00000020:00080000:2.0:1784290316.731547:0:88753:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444064 00000040:01000000:0.0:1784290316.731711:0:88754:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1784290316.731719:0:88724:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1784290316.731903:0:88754:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1784290316.732086:0:88724:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1784290316.732114:0:88724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784290316.734423:0:88755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343890a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88755:1870961901057024:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784290316.734451:0:88755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290316.734470:0:88755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0a000 going to sleep for 11 seconds 00000100:00100000:3.0:1784290316.734475:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901057024 00000100:00100000:3.0:1784290316.734480:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901057024 00000100:00100000:3.0:1784290316.734505:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3766 00000100:00100000:3.0:1784290316.734510:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88755:x1870961901057024:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784290316.734565:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88755:x1870961901057024:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 53us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290316.734571:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3766 00000100:00100000:1.0:1784290316.734578:0:88755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343890a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88755:1870961901057024:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1784290316.734597:0:88755:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1784290316.734614:0:88755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343890a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88755:1870961901057152:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784290316.734635:0:88755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290316.734651:0:88755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0a000 going to sleep for 11 seconds 00000100:00100000:3.0:1784290316.734665:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901057152 00000100:00100000:3.0:1784290316.734669:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901057152 00000100:00100000:3.0:1784290316.734686:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3767 00000100:00100000:3.0:1784290316.734690:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88755:x1870961901057152:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784290316.734773:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88755:x1870961901057152:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 80us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290316.734777:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3767 00000100:00100000:1.0:1784290316.734782:0:88755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343890a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88755:1870961901057152:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784290316.734819:0:88755:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343890a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88755:1870961901057280:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784290316.734837:0:88755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290316.734859:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901057280 00000100:00100000:1.0:1784290316.734860:0:88755:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0a000 going to sleep for 11 seconds 00000100:00100000:3.0:1784290316.734870:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901057280 00000100:00100000:3.0:1784290316.734889:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3768 00000100:00100000:3.0:1784290316.734893:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88755:x1870961901057280:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784290316.734937:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88755:x1870961901057280:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 43us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290316.734942:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3768 00000100:00100000:1.0:1784290316.734950:0:88755:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343890a80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88755:1870961901057280:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1784290316.734978:0:88755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1784290316.737550:0:88724:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1784290316.737568:0:88724:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1784290316.737596:0:88724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784290316.752039:0:88724:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1784290316.762008:0:88724:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1784290316.762046:0:88724:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1784290316.762102:0:88724:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1784290316.762468:0:88724:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4c:0x0] (8/32) registered 00010000:00080000:0.0:1784290316.763499:0:88724:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 103079215110 00010000:00080000:3.0:1784290316.763929:0:88756:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 88756 00010000:02000000:3.0:1784290316.763940:0:88756:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1784290316.763942:0:88756:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1784290316.763945:0:88756:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1784290316.763997:0:88724:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784290316.764008:0:88724:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784290316.764041:0:88724:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1784290316.764052:0:88724:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000040:00080000:2.0:1784290316.764881:0:88754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784290316.764935:0:88754:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1784290316.765021:0:88755:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400090a3:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784290316.765063:0:88755:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1784290316.765066:0:88755:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:2.0:1784290316.765097:0:88756:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:00000004:1.0:1784290316.766126:0:88724:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784290316.766701:0:88724:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784290316.967426:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784290317.863432:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784290317.863438:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9c24444ab000 from 112 10000000:01000000:3.0:1784290317.863442:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784290317.863482:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4c00/0x5953bbf6b3073e7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.863493:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4c00/0x5953bbf6b3073e7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.863503:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4c00/0x5953bbf6b3073e7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290317.863526:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901057408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.863586:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290317.863626:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20780 going to sleep for 11 seconds 00000100:00100000:2.0:1784290317.863675:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901057408 00000100:00100000:2.0:1784290317.863685:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901057408 00000100:00100000:2.0:1784290317.863741:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784290317.863751:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:6485:x1870961901057408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290317.863764:0:88732:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290317.863777:0:88732:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebfc00/0x5953bbf6b3073e82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073e7b expref: -99 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.863799:0:88732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebfc00/0x5953bbf6b3073e82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073e7b expref: 11 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.863838:0:88732:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebfc00/0x5953bbf6b3073e82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073e7b expref: 11 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.863847:0:88732:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebfc00, rc 0) 00000100:00100000:2.0:1784290317.863897:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901057408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290317.863905:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784290317.863924:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901057408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290317.863958:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4c00/0x5953bbf6b3073e7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073e82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.863973:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4c00/0x5953bbf6b3073e7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073e82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290317.864046:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901057536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.864094:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290317.864108:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20780 going to sleep for 11 seconds 00000100:00100000:2.0:1784290317.864151:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901057536 00000100:00100000:2.0:1784290317.864155:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901057536 00000100:00100000:2.0:1784290317.864182:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784290317.864189:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901057536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784290317.864201:0:88729:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784290317.864217:0:88729:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784290317.864220:0:88729:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 112 00000100:00100000:3.0:1784290317.864375:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901057536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784290317.864381:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901057536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 191us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290317.864388:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 10000000:01000000:3.0:1784290317.864423:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784290317.864429:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4c00/0x5953bbf6b3073e7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073e82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.864436:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4c00/0x5953bbf6b3073e7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073e82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290317.864442:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784290317.864443:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c23452c5000 from 52 10000000:01000000:3.0:1784290317.864445:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784290317.864460:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5800/0x5953bbf6b3073e89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.864465:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5800/0x5953bbf6b3073e89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.864479:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5800/0x5953bbf6b3073e89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290317.864489:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901057664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.864524:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290317.864546:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20780 going to sleep for 11 seconds 00000100:00100000:2.0:1784290317.864562:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901057664 00000100:00100000:2.0:1784290317.864567:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901057664 00000100:00100000:2.0:1784290317.864591:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784290317.864597:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901057664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290317.864603:0:88732:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290317.864610:0:88732:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b3073e90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073e89 expref: -99 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.864622:0:88732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b3073e90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073e89 expref: 12 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.864639:0:88732:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b3073e90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073e89 expref: 12 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.864644:0:88732:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebe800, rc 0) 00000100:00100000:2.0:1784290317.864675:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901057664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290317.864680:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784290317.864688:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901057664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290317.864700:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5800/0x5953bbf6b3073e89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073e90 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.864707:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5800/0x5953bbf6b3073e89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073e90 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290317.864764:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901057792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.864785:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290317.864801:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20780 going to sleep for 11 seconds 00000100:00100000:1.0:1784290317.864822:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901057792 00000100:00100000:1.0:1784290317.864828:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901057792 00000100:00100000:1.0:1784290317.864859:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784290317.864867:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901057792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.864988:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901057792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290317.864996:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784290317.865006:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901057792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.865045:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901057920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.865090:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290317.865106:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20780 going to sleep for 11 seconds 00000100:00100000:1.0:1784290317.865126:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901057920 00000100:00100000:1.0:1784290317.865132:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901057920 00000100:00100000:1.0:1784290317.865166:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784290317.865178:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901057920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.865256:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901057920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290317.865263:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901057920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.865264:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000040:00080000:1.0:1784290317.865924:0:88938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1784290317.866032:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1784290317.866056:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290317.866061:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5800/0x5953bbf6b3073e89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073e90 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.866067:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5800/0x5953bbf6b3073e89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073e90 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290317.866074:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784290317.866081:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9c23452c5000 from 109 10000000:01000000:3.0:1784290317.866083:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784290317.866099:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5000/0x5953bbf6b3073e97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.866105:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5000/0x5953bbf6b3073e97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.866110:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5000/0x5953bbf6b3073e97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290317.866121:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901058048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.866153:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290317.866186:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901058048 00000100:00100000:1.0:1784290317.866191:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901058048 00000100:00100000:3.0:1784290317.866197:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20780 going to sleep for 11 seconds 00000100:00100000:1.0:1784290317.866219:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784290317.866227:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901058048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290317.866241:0:88729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290317.866249:0:88729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c24429dee00/0x5953bbf6b3073e9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073e97 expref: -99 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.866277:0:88729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c24429dee00/0x5953bbf6b3073e9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073e97 expref: 13 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.866285:0:88729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c24429dee00/0x5953bbf6b3073e9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073e97 expref: 13 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.866291:0:88729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24429dee00, rc 0) 00000100:00100000:1.0:1784290317.866325:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901058048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290317.866331:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784290317.866507:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901058048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290317.866517:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5000/0x5953bbf6b3073e97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073e9e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.866523:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5000/0x5953bbf6b3073e97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073e9e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290317.866557:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901058176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.866580:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290317.866597:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20780 going to sleep for 11 seconds 00000100:00100000:3.0:1784290317.866609:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901058176 00000100:00100000:3.0:1784290317.866611:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901058176 00000100:00100000:3.0:1784290317.866639:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784290317.866648:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901058176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784290317.866658:0:88732:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784290317.866687:0:88732:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784290317.866691:0:88732:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1784290317.866693:0:88732:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1784290317.866694:0:88732:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1784290317.866696:0:88732:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 112 00000100:00100000:3.0:1784290317.866779:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901058176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290317.866786:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784290317.866793:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901058176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784290317.866852:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784290317.866857:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5000/0x5953bbf6b3073e97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073e9e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.866863:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5000/0x5953bbf6b3073e97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073e9e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290317.866868:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1784290317.866869:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1784290317.866871:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1784290317.866884:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24429dfe00/0x5953bbf6b3073ea5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.866889:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24429dfe00/0x5953bbf6b3073ea5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.866901:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24429dfe00/0x5953bbf6b3073ea5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290317.866911:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901058304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.866935:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290317.866952:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0a180 going to sleep for 11 seconds 00000100:00100000:2.0:1784290317.866995:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901058304 00000100:00100000:2.0:1784290317.866999:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901058304 00000100:00100000:2.0:1784290317.867039:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784290317.867047:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901058304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290317.867053:0:88729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290317.867066:0:88729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebf200/0x5953bbf6b3073eac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073ea5 expref: -99 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.867078:0:88729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebf200/0x5953bbf6b3073eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073ea5 expref: 14 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.867084:0:88729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebf200/0x5953bbf6b3073eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073ea5 expref: 14 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.867089:0:88729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebf200, rc 0) 00000100:00100000:2.0:1784290317.867119:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901058304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290317.867124:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784290317.867128:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901058304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290317.867141:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24429dfe00/0x5953bbf6b3073ea5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073eac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.867148:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24429dfe00/0x5953bbf6b3073ea5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073eac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290317.867177:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901058432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.867196:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290317.867210:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0a180 going to sleep for 11 seconds 00000100:00100000:3.0:1784290317.867300:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901058432 00000100:00100000:3.0:1784290317.867306:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901058432 00000100:00100000:3.0:1784290317.867336:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784290317.867366:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244a79c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901058432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.867463:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244a79c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901058432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290317.867471:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901058432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.867472:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784290317.867503:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901058560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.867533:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290317.867554:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0a180 going to sleep for 11 seconds 00000100:00100000:2.0:1784290317.867564:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901058560 00000100:00100000:2.0:1784290317.867569:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901058560 00000100:00100000:2.0:1784290317.867600:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784290317.867607:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244a79fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901058560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290317.868202:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244a79fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901058560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 595us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290317.868209:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784290317.868222:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901058560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784290317.868895:0:88939:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1784290317.869018:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1784290317.869048:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1784290317.869054:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24429dfe00/0x5953bbf6b3073ea5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073eac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.869062:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24429dfe00/0x5953bbf6b3073ea5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073eac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290317.869069:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1784290317.869070:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9c23452c5000 from 1 10000000:01000000:3.0:1784290317.869072:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784290317.869088:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4a00/0x5953bbf6b3073eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.869094:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4a00/0x5953bbf6b3073eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.869107:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4a00/0x5953bbf6b3073eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290317.869118:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901058688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.869146:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290317.869175:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246deb3900 going to sleep for 11 seconds 00000100:00100000:2.0:1784290317.869187:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901058688 00000100:00100000:2.0:1784290317.869192:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901058688 00000100:00100000:2.0:1784290317.869219:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784290317.869225:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244a79d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901058688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290317.869231:0:88732:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290317.869239:0:88732:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebe200/0x5953bbf6b3073eba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073eb3 expref: -99 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.869251:0:88732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebe200/0x5953bbf6b3073eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073eb3 expref: 15 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.869285:0:88732:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebe200/0x5953bbf6b3073eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073eb3 expref: 15 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.869291:0:88732:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebe200, rc 0) 00000100:00100000:2.0:1784290317.869327:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244a79d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:6485:x1870961901058688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290317.869333:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784290317.869383:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901058688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290317.869399:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4a00/0x5953bbf6b3073eb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073eba expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.869406:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4a00/0x5953bbf6b3073eb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073eba expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290317.869416:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784290317.869420:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4a00/0x5953bbf6b3073eb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073eba expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.869425:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4a00/0x5953bbf6b3073eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073eba expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290317.869431:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784290317.869433:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c23452c5000 from 7 10000000:01000000:3.0:1784290317.869435:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784290317.869448:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5e00/0x5953bbf6b3073ec1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.869453:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5e00/0x5953bbf6b3073ec1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.869481:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5e00/0x5953bbf6b3073ec1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290317.869493:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901058816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.869520:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290317.869563:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901058816 00000100:00100000:2.0:1784290317.869567:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901058816 00000100:00100000:3.0:1784290317.869570:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246deb3900 going to sleep for 11 seconds 00000100:00100000:2.0:1784290317.869593:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784290317.869602:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244a79f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:6485:x1870961901058816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290317.869616:0:88729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290317.869623:0:88729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b3073ec8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073ec1 expref: -99 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.869635:0:88729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b3073ec8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073ec1 expref: 16 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.869641:0:88729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b3073ec8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073ec1 expref: 16 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.869662:0:88729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebee00, rc 0) 00000100:00100000:2.0:1784290317.869696:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244a79f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901058816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290317.869701:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784290317.869735:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901058816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290317.869769:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5e00/0x5953bbf6b3073ec1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073ec8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.869775:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5e00/0x5953bbf6b3073ec1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073ec8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290317.869808:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901058944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.869827:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290317.869842:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246deb3900 going to sleep for 11 seconds 00000100:00100000:2.0:1784290317.869855:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901058944 00000100:00100000:2.0:1784290317.869860:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901058944 00000100:00100000:2.0:1784290317.869885:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784290317.869892:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244a79e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901058944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290317.869960:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244a79e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901058944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 68us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290317.869967:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784290317.869981:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901058944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.870006:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901059072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.870063:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290317.870077:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246deb3900 going to sleep for 11 seconds 00000100:00100000:2.0:1784290317.870087:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901059072 00000100:00100000:2.0:1784290317.870091:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901059072 00000100:00100000:2.0:1784290317.870116:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784290317.870122:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901059072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290317.870188:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901059072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290317.870201:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784290317.870207:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901059072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784290317.870805:0:88940:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784290317.870860:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784290317.870882:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784290317.870888:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5e00/0x5953bbf6b3073ec1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073ec8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.870895:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5e00/0x5953bbf6b3073ec1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073ec8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290317.870902:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784290317.870904:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c246ff27800 from 52 10000000:01000000:2.0:1784290317.870906:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784290317.870921:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe400/0x5953bbf6b3073ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.870927:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe400/0x5953bbf6b3073ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.870933:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe400/0x5953bbf6b3073ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290317.870944:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901059200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290317.870983:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290317.871008:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dac6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290317.871019:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901059200 00000100:00100000:3.0:1784290317.871034:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901059200 00000100:00100000:3.0:1784290317.871066:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784290317.871072:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901059200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290317.871078:0:88732:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290317.871086:0:88732:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247d2f5c00/0x5953bbf6b3073ed6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073ecf expref: -99 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.871098:0:88732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247d2f5c00/0x5953bbf6b3073ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073ecf expref: 17 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.871105:0:88732:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247d2f5c00/0x5953bbf6b3073ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073ecf expref: 17 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.871110:0:88732:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2f5c00, rc 0) 00000100:00100000:3.0:1784290317.871140:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901059200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290317.871146:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784290317.871157:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901059200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290317.871171:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe400/0x5953bbf6b3073ecf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073ed6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.871178:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe400/0x5953bbf6b3073ecf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073ed6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290317.871219:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901059328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290317.871243:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290317.871275:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dac6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290317.871286:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901059328 00000100:00100000:3.0:1784290317.871290:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901059328 00000100:00100000:3.0:1784290317.871317:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784290317.871324:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901059328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.871424:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901059328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290317.871430:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784290317.871445:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901059328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.871482:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901059456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.871525:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290317.871547:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901059456 00000100:00100000:3.0:1784290317.871552:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901059456 00000100:00100000:1.0:1784290317.871568:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290317.871585:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784290317.871591:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901059456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.871655:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901059456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290317.871667:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784290317.871681:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901059456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784290317.872401:0:88941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1784290317.872444:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1784290317.872465:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290317.872475:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe400/0x5953bbf6b3073ecf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073ed6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.872482:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe400/0x5953bbf6b3073ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073ed6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290317.872487:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1784290317.872489:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1784290317.872490:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784290317.872502:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5200/0x5953bbf6b3073edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.872508:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5200/0x5953bbf6b3073edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.872513:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5200/0x5953bbf6b3073edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290317.872523:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901059584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.872546:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290317.872576:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901059584 00000100:00100000:3.0:1784290317.872578:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246deb3480 going to sleep for 11 seconds 00000100:00100000:2.0:1784290317.872581:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901059584 00000100:00100000:2.0:1784290317.872611:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784290317.872619:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901059584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290317.872626:0:88729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290317.872633:0:88729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b3073ee4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073edd expref: -99 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.872645:0:88729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b3073ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073edd expref: 18 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.872652:0:88729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b3073ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073edd expref: 18 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.872657:0:88729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebf000, rc 0) 00000100:00100000:2.0:1784290317.872691:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901059584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290317.872696:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784290317.872701:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901059584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290317.872714:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5200/0x5953bbf6b3073edd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073ee4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.872731:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5200/0x5953bbf6b3073edd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073ee4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290317.872775:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901059712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.872798:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290317.872814:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246deb3480 going to sleep for 11 seconds 00000100:00100000:1.0:1784290317.872819:0:88731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901059712 00000100:00100000:1.0:1784290317.872824:0:88731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901059712 00000100:00100000:1.0:1784290317.872854:0:88731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784290317.872862:0:88731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2480354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901059712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.872948:0:88731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2480354c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901059712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290317.872955:0:88731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784290317.872976:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901059712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.873003:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901059840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.873046:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290317.873063:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246deb3480 going to sleep for 11 seconds 00000100:00100000:1.0:1784290317.873073:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901059840 00000100:00100000:1.0:1784290317.873081:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901059840 00000100:00100000:1.0:1784290317.873106:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784290317.873114:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2480354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901059840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.873569:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2480354450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901059840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 455us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290317.873576:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784290317.873588:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901059840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784290317.874193:0:88942:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1784290317.874246:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1784290317.874264:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784290317.874280:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5200/0x5953bbf6b3073edd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073ee4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.874288:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5200/0x5953bbf6b3073edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073ee4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290317.874294:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784290317.874296:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c246ff27800 from 7 10000000:01000000:1.0:1784290317.874303:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784290317.874317:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24429de600/0x5953bbf6b3073eeb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.874323:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24429de600/0x5953bbf6b3073eeb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.874328:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24429de600/0x5953bbf6b3073eeb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290317.874338:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901059968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.874386:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290317.874406:0:88731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901059968 00000100:00100000:1.0:1784290317.874409:0:88731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901059968 00000100:00100000:1.0:1784290317.874434:0:88731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784290317.874440:0:88731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2480355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901059968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290317.874446:0:88731:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290317.874452:0:88731:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c24429dfc00/0x5953bbf6b3073ef2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073eeb expref: -99 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.874463:0:88731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c24429dfc00/0x5953bbf6b3073ef2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073eeb expref: 19 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.874481:0:88731:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c24429dfc00/0x5953bbf6b3073ef2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073eeb expref: 19 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.874486:0:88731:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24429dfc00, rc 0) 00000100:00100000:1.0:1784290317.874506:0:88731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2480355850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901059968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 66us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290317.874511:0:88731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784290317.874547:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0a000 going to sleep for 11 seconds 00000100:00100000:1.0:1784290317.874558:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901059968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290317.874568:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24429de600/0x5953bbf6b3073eeb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073ef2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.874575:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24429de600/0x5953bbf6b3073eeb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073ef2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290317.874606:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901060096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.874627:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290317.874645:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0a000 going to sleep for 11 seconds 00000100:00100000:2.0:1784290317.874649:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901060096 00000100:00100000:2.0:1784290317.874654:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901060096 00000100:00100000:2.0:1784290317.874685:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784290317.874692:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2480355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901060096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290317.874754:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2480355050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901060096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 63us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290317.874766:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901060096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290317.874768:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784290317.874799:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901060224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.874832:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290317.874848:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0a000 going to sleep for 11 seconds 00000100:00100000:2.0:1784290317.874857:0:88731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901060224 00000100:00100000:2.0:1784290317.874861:0:88731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901060224 00000100:00100000:2.0:1784290317.874884:0:88731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784290317.874891:0:88731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474421050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901060224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290317.874950:0:88731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474421050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901060224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290317.874956:0:88731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784290317.874963:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901060224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784290317.875539:0:88943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784290317.875583:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784290317.875602:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784290317.875607:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24429de600/0x5953bbf6b3073eeb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073ef2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.875614:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24429de600/0x5953bbf6b3073eeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073ef2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290317.875620:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784290317.875621:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c247d3d2000 from 52 10000000:01000000:3.0:1784290317.875623:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784290317.875635:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4e00/0x5953bbf6b3073ef9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.875649:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4e00/0x5953bbf6b3073ef9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.875656:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4e00/0x5953bbf6b3073ef9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290317.875665:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901060352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.875687:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290317.875709:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246deb3900 going to sleep for 11 seconds 00000100:00100000:2.0:1784290317.875720:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901060352 00000100:00100000:2.0:1784290317.875724:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901060352 00000100:00100000:2.0:1784290317.875749:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784290317.875754:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474423c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901060352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290317.875759:0:88729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290317.875767:0:88729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b3073f00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073ef9 expref: -99 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.875778:0:88729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b3073f00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073ef9 expref: 20 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.875784:0:88729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b3073f00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073ef9 expref: 20 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.875789:0:88729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebe000, rc 0) 00000100:00100000:2.0:1784290317.875818:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474423c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901060352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 64us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290317.875822:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784290317.875845:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901060352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290317.875854:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4e00/0x5953bbf6b3073ef9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073f00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.875861:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4e00/0x5953bbf6b3073ef9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073f00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290317.875888:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901060480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.875912:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290317.875931:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246deb3900 going to sleep for 11 seconds 00000100:00100000:1.0:1784290317.875941:0:88731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901060480 00000100:00100000:1.0:1784290317.875946:0:88731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901060480 00000100:00100000:1.0:1784290317.875979:0:88731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784290317.875988:0:88731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474422450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901060480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.876070:0:88731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474422450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901060480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290317.876080:0:88731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784290317.876082:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901060480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.876110:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901060608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.876141:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290317.876157:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246deb3900 going to sleep for 11 seconds 00000100:00100000:1.0:1784290317.876170:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901060608 00000100:00100000:1.0:1784290317.876175:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901060608 00000100:00100000:1.0:1784290317.876219:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784290317.876229:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474422850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901060608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.876298:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474422850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901060608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290317.876306:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784290317.876317:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901060608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784290317.876872:0:88944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1784290317.876949:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1784290317.876966:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784290317.876973:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4e00/0x5953bbf6b3073ef9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073f00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.876984:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4e00/0x5953bbf6b3073ef9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073f00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290317.876994:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1784290317.876996:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1784290317.876999:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784290317.877017:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24429dec00/0x5953bbf6b3073f07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.877041:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24429dec00/0x5953bbf6b3073f07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.877051:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24429dec00/0x5953bbf6b3073f07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290317.877066:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901060736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.877092:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290317.877113:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1784290317.877130:0:88731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901060736 00000100:00100000:2.0:1784290317.877135:0:88731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901060736 00000100:00100000:2.0:1784290317.877161:0:88731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784290317.877166:0:88731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474422050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901060736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290317.877172:0:88731:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290317.877179:0:88731:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b3073f0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073f07 expref: -99 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.877190:0:88731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b3073f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073f07 expref: 21 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.877197:0:88731:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b3073f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073f07 expref: 21 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.877202:0:88731:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebfe00, rc 0) 00000100:00100000:2.0:1784290317.877231:0:88731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474422050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901060736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 65us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290317.877238:0:88731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784290317.877256:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901060736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290317.877274:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24429dec00/0x5953bbf6b3073f07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073f0e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.877281:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24429dec00/0x5953bbf6b3073f07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073f0e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290317.877315:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901060864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.877360:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290317.877396:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1784290317.877410:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901060864 00000100:00100000:2.0:1784290317.877415:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901060864 00000100:00100000:2.0:1784290317.877437:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784290317.877443:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474423850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901060864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290317.877509:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474423850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901060864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 66us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290317.877515:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784290317.877517:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901060864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.877543:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901060992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.877572:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290317.877585:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1784290317.877595:0:88731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901060992 00000100:00100000:2.0:1784290317.877598:0:88731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901060992 00000100:00100000:2.0:1784290317.877617:0:88731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784290317.877624:0:88731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474420c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901060992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290317.877989:0:88731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474420c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901060992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 365us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290317.877995:0:88731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784290317.878086:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901060992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784290317.878630:0:88945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1784290317.878684:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1784290317.878708:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784290317.878712:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24429dec00/0x5953bbf6b3073f07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073f0e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.878718:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24429dec00/0x5953bbf6b3073f07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073f0e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290317.878724:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784290317.878725:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c247d3d2000 from 7 10000000:01000000:3.0:1784290317.878727:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784290317.878739:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4600/0x5953bbf6b3073f15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.878744:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4600/0x5953bbf6b3073f15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.878749:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4600/0x5953bbf6b3073f15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290317.878759:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901061120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.878781:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290317.878800:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901061120 00000100:00100000:2.0:1784290317.878804:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901061120 00000100:00100000:3.0:1784290317.878806:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246deb3480 going to sleep for 11 seconds 00000100:00100000:2.0:1784290317.878834:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784290317.878840:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d92e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901061120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290317.878846:0:88729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290317.878852:0:88729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073f1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073f15 expref: -99 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.878864:0:88729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073f1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073f15 expref: 22 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.878871:0:88729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073f1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073f15 expref: 22 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.878876:0:88729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebf800, rc 0) 00000100:00100000:2.0:1784290317.878905:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d92e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901061120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 65us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290317.878911:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784290317.878920:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901061120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290317.878934:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4600/0x5953bbf6b3073f15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073f1c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.878941:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4600/0x5953bbf6b3073f15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073f1c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290317.878973:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901061248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.879005:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290317.879034:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246deb3480 going to sleep for 11 seconds 00000100:00100000:2.0:1784290317.879040:0:88731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901061248 00000100:00100000:2.0:1784290317.879044:0:88731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901061248 00000100:00100000:2.0:1784290317.879067:0:88731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784290317.879074:0:88731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d92cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901061248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290317.879128:0:88731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d92cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901061248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 57us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290317.879142:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901061248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290317.879143:0:88731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784290317.879174:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901061376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290317.879209:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290317.879225:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246deb3480 going to sleep for 11 seconds 00000100:00100000:2.0:1784290317.879235:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901061376 00000100:00100000:2.0:1784290317.879239:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901061376 00000100:00100000:2.0:1784290317.879259:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784290317.879264:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d92dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901061376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290317.879322:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d92dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901061376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 57us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290317.879327:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784290317.879337:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901061376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784290317.879860:0:88946:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784290317.879891:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784290317.879912:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784290317.879918:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4600/0x5953bbf6b3073f15 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073f1c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.879926:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4600/0x5953bbf6b3073f15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073f1c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290317.879932:0:6485:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784290317.879934:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9c2480260000 from 1 10000000:01000000:1.0:1784290317.879935:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784290317.879948:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24429de800/0x5953bbf6b3073f23 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.879958:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24429de800/0x5953bbf6b3073f23 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.879964:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24429de800/0x5953bbf6b3073f23 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290317.879975:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901061504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.879999:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290317.880052:0:88731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901061504 00000100:00100000:1.0:1784290317.880054:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0a840 going to sleep for 11 seconds 00000100:00100000:3.0:1784290317.880057:0:88731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901061504 00000100:00100000:3.0:1784290317.880085:0:88731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784290317.880091:0:88731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d92e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901061504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290317.880097:0:88731:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290317.880104:0:88731:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247d2f4800/0x5953bbf6b3073f2a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073f23 expref: -99 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.880114:0:88731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247d2f4800/0x5953bbf6b3073f2a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073f23 expref: 23 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.880121:0:88731:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247d2f4800/0x5953bbf6b3073f2a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073f23 expref: 23 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290317.880126:0:88731:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2f4800, rc 0) 00000100:00100000:3.0:1784290317.880154:0:88731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d92e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901061504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 63us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290317.880159:0:88731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784290317.880168:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901061504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290317.880182:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24429de800/0x5953bbf6b3073f23 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073f2a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.880189:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24429de800/0x5953bbf6b3073f23 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073f2a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290317.880199:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784290317.880202:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24429de800/0x5953bbf6b3073f23 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073f2a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.880207:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24429de800/0x5953bbf6b3073f23 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073f2a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290317.880211:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784290317.880212:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9c2480260000 from 1 10000000:01000000:1.0:1784290317.880214:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784290317.880225:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24429de400/0x5953bbf6b3073f31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.880239:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24429de400/0x5953bbf6b3073f31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.880245:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24429de400/0x5953bbf6b3073f31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290317.880254:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901061632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.880288:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290317.880303:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0a840 going to sleep for 11 seconds 00000100:00100000:2.0:1784290317.880306:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901061632 00000100:00100000:2.0:1784290317.880311:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901061632 00000100:00100000:2.0:1784290317.880337:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784290317.880366:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901061632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290317.880375:0:88729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290317.880384:0:88729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3073f38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3073f31 expref: -99 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.880399:0:88729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3073f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3073f31 expref: 24 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.880409:0:88729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3073f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3073f31 expref: 24 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290317.880417:0:88729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebea00, rc 0) 00000100:00100000:2.0:1784290317.880450:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901061632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290317.880456:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784290317.880461:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901061632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290317.880473:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24429de400/0x5953bbf6b3073f31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073f38 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.880488:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24429de400/0x5953bbf6b3073f31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073f38 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290317.880520:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901061760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290317.880540:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290317.880568:0:88731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901061760 00000100:00100000:1.0:1784290317.880571:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0a840 going to sleep for 11 seconds 00000100:00100000:2.0:1784290317.880578:0:88731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901061760 00000100:00100000:2.0:1784290317.880604:0:88731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784290317.880612:0:88731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901061760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290317.880660:0:88731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901061760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 49us (118us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784290317.880666:0:88731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784290317.880671:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901061760:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1784290317.880694:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784290317.880698:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24429de400/0x5953bbf6b3073f31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073f38 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290317.880704:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24429de400/0x5953bbf6b3073f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073f38 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290317.991528:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784290318.144587:0:89006:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:3.0:1784290318.554207:0:89058:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784290318.554412:0:89058:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1784290318.963023:0:89108:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784290318.963175:0:89108:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1784290319.016477:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290319.527579:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784290319.527601:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784290319.527609:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901062016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290319.527614:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901061888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784290319.527692:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290319.527743:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290319.527781:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901062016 00000100:00100000:0.0:1784290319.527793:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901062016 00000100:00100000:2.0:1784290319.527821:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901061888 00000100:00100000:2.0:1784290319.527832:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901061888 00000100:00080000:1.0:1784290319.527866:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784290319.527874:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784290319.527889:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:2.0:1784290319.527912:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:0.0:1784290319.527921:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901062016:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290319.527934:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901061888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784290319.527967:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1784290319.527968:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290319.528078:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901062016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 175us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290319.528092:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:2.0:1784290319.528099:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901061888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 169us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290319.528116:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:3.0:1784290319.528144:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901062016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290319.528144:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901061888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290319.878434:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290319.878473:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290319.878521:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290319.878526:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896222208 00000100:00100000:2.0:1784290319.878541:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896222208 00000100:00100000:1.0:1784290319.878581:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290319.878626:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 656 00000100:00100000:2.0:1784290319.878644:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896222208:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290319.878657:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896222080 00000100:00100000:0.0:1784290319.878658:0:26251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896222336 00000100:00100000:3.0:1784290319.878669:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896222080 00000100:00100000:1.0:1784290319.878669:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290319.878675:0:26251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896222336 00000100:00080000:1.0:1784290319.878710:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784290319.878720:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1093 00000100:00080000:1.0:1784290319.878722:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784290319.878733:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1870961896222080:12345-192.168.202.6@tcp:38:kworker.0 00000100:00100000:0.0:1784290319.878764:0:26251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896222464 00010000:00080000:3.0:1784290319.878772:0:66008:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'bd808cf4-dd54-45f0-9b2b-1434e8330e5d' at ffff9c2458be9000, cookie 0x5953bbf6b3073dc5 00000100:00100000:2.0:1784290319.878776:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896222208:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 129us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290319.878776:0:26251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896222464 00000100:00100000:1.0:1784290319.878783:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896222592 00010000:00080000:3.0:1784290319.878790:0:66008:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp recovering/t103079215111 exp ffff9c2458be9000 cur 2061 last 1784290316 00000100:00100000:1.0:1784290319.878794:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896222592 00000100:00100000:2.0:1784290319.878806:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 656 00010000:02000400:3.0:1784290319.878808:0:66008:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1784290319.878824:0:66008:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000100:00100000:1.0:1784290319.878848:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:1.0:1784290319.878858:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2396:x1870961896222592:12345-192.168.202.6@tcp:250:kworker.0 00000004:00100000:3.0:1784290319.878865:0:66008:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1784290319.878880:0:26251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4926 00010000:00080000:1.0:1784290319.878883:0:88729:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from bdffa268-fb6a-4248-991c-0ad16fac303f@192.168.202.6@tcp t0 exp 0000000000000000 cur 2061 last 0 00000100:00100000:2.0:1784290319.878897:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4927 00000100:00100000:0.0:1784290319.878909:0:26251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2396:x1870961896222336:12345-192.168.202.6@tcp:9:kworker.0 00000100:00100000:2.0:1784290319.878923:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2396:x1870961896222464:12345-192.168.202.6@tcp:9:kworker.0 00000020:00000080:1.0:1784290319.878930:0:88729:0:(genops.c:1406:class_connect()) connect: client bdffa268-fb6a-4248-991c-0ad16fac303f, cookie 0x5953bbf6b3073f3f 00000020:00000080:0.0:1784290319.878952:0:26251:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073a1b 00000020:00000080:2.0:1784290319.878959:0:8402:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073a22 00000100:00080000:0.0:1784290319.878969:0:26251:0:(import.c:65:import_set_state_nolock()) ffff9c245fd7d800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1784290319.878980:0:8402:0:(import.c:65:import_set_state_nolock()) ffff9c247e4b2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784290319.879121:0:8402:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968626 00000001:00000004:0.0:1784290319.879160:0:26251:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968626 00000100:00080000:3.0:1784290319.879166:0:66008:0:(import.c:65:import_set_state_nolock()) ffff9c23458df000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1784290319.879172:0:88729:0:(import.c:65:import_set_state_nolock()) ffff9c246ff1b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784290319.879230:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdffa268-fb6a-4248-991c-0ad16fac303f+5:2396:x1870961896222592:12345-192.168.202.6@tcp:250:kworker.0 Request processed in 369us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290319.879240:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896222080:12345-192.168.202.6@tcp:38:kworker.0 Request processed in 506us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290319.879245:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:3.0:1784290319.879253:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1093 00000100:00080000:3.0:1784290319.879332:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784290319.879408:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290319.879425:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+2:2396:x1870961896222464:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 513us (843us total) trans 0 rc 0/0 00010000:00010000:3.0:1784290319.879432:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290319.879439:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4927 00000100:00100000:0.0:1784290319.879458:0:26251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+2:2396:x1870961896222336:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 554us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290319.879478:0:26251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4926 00000100:00100000:0.0:1784290319.882090:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290319.882177:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896217600 00000100:00100000:3.0:1784290319.882187:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896217600 00000100:00100000:3.0:1784290319.882269:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1094 00000100:00100000:3.0:1784290319.882284:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896217600:12345-192.168.202.6@tcp:36:mcreate.0 00010000:00080000:3.0:1784290319.882327:0:66004:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215111, current: 103079215111, replaying 00000100:00100000:3.0:1784290319.882382:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896217600:12345-192.168.202.6@tcp:36:mcreate.0 Request processed in 101us (297us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784290319.882392:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1094 00010000:00080000:2.0:1784290319.882413:0:88756:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:3.0:1784290320.039559:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290321.063613:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290321.285915:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290321.286051:0:88731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896222848 00000100:00100000:2.0:1784290321.286062:0:88731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896222848 00000100:00100000:2.0:1784290321.286121:0:88731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:2.0:1784290321.286131:0:88731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+5:42227:x1870961896222848:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290321.286148:0:88731:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290321.286165:0:88731:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebfa00/0x5953bbf6b3073f46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b22b8 expref: -99 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290321.286193:0:88731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebfa00/0x5953bbf6b3073f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22b8 expref: 6 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290321.286202:0:88731:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebfa00/0x5953bbf6b3073f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22b8 expref: 6 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290321.286211:0:88731:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebfa00, rc 0) 00000100:00100000:2.0:1784290321.286293:0:88731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+6:42227:x1870961896222848:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 162us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290321.286303:0:88731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:0.0:1784290321.287871:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290321.287924:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896222976 00000100:00100000:3.0:1784290321.287930:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896222976 00000100:00100000:3.0:1784290321.287963:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:3.0:1784290321.287970:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+6:42227:x1870961896222976:12345-192.168.202.6@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784290321.287985:0:88732:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1784290321.288035:0:88732:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784290321.288040:0:88732:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1784290321.288045:0:88732:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1784290321.288049:0:88732:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1784290321.288052:0:88732:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 112 00000100:00100000:3.0:1784290321.289294:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469cca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+6:42227:x1870961896222976:12345-192.168.202.6@tcp:256:ll_cfg_requeue.0 Request processed in 1319us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290321.289305:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:1.0:1784290321.290968:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290321.291064:0:88731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896223104 00000100:00100000:2.0:1784290321.291073:0:88731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896223104 00000100:00100000:2.0:1784290321.291120:0:88731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:2.0:1784290321.291132:0:88731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+6:42227:x1870961896223104:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290321.291144:0:88731:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290321.291169:0:88731:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2482045800/0x5953bbf6b3073f4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b22bf expref: -99 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290321.291191:0:88731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2482045800/0x5953bbf6b3073f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22bf expref: 7 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290321.291203:0:88731:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2482045800/0x5953bbf6b3073f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22bf expref: 7 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290321.291211:0:88731:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2482045800, rc 0) 00000100:00100000:2.0:1784290321.291277:0:88731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+7:42227:x1870961896223104:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 146us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290321.291288:0:88731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:0.0:1784290321.292855:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290321.292921:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896223232 00000100:00100000:3.0:1784290321.292929:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896223232 00000100:00100000:3.0:1784290321.292971:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:3.0:1784290321.292980:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+7:42227:x1870961896223232:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290321.293134:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+8:42227:x1870961896223232:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 152us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290321.293150:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:1.0:1784290321.294441:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290321.294578:0:88731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896223360 00000100:00100000:2.0:1784290321.294589:0:88731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896223360 00000100:00100000:2.0:1784290321.294645:0:88731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:2.0:1784290321.294659:0:88731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+8:42227:x1870961896223360:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290321.294801:0:88731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468b01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+8:42227:x1870961896223360:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 144us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290321.294811:0:88731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:1.0:1784290321.298125:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290321.298265:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896223488 00000100:00100000:3.0:1784290321.298285:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896223488 00000100:00100000:3.0:1784290321.298335:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:3.0:1784290321.298387:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234444ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+8:42227:x1870961896223488:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290321.298401:0:88732:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290321.298415:0:88732:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247d2f4000/0x5953bbf6b3073f54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b22c6 expref: -99 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290321.298439:0:88732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247d2f4000/0x5953bbf6b3073f54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22c6 expref: 9 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290321.298452:0:88732:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247d2f4000/0x5953bbf6b3073f54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22c6 expref: 9 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290321.298462:0:88732:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2f4000, rc 0) 00000100:00100000:3.0:1784290321.298509:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234444ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896223488:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 129us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290321.298518:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:0.0:1784290321.299960:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290321.300101:0:88731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896223616 00000100:00100000:2.0:1784290321.300112:0:88731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896223616 00000100:00100000:2.0:1784290321.300168:0:88731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:2.0:1784290321.300179:0:88731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896223616:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290321.300296:0:88731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345bb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896223616:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 115us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290321.300310:0:88731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:1.0:1784290321.301940:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290321.302039:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896223744 00000100:00100000:3.0:1784290321.302049:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896223744 00000100:00100000:3.0:1784290321.302097:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:3.0:1784290321.302108:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234444a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896223744:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290321.302224:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234444a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896223744:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 115us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290321.302235:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:1.0:1784290321.305574:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290321.305700:0:88731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896223872 00000100:00100000:2.0:1784290321.305711:0:88731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896223872 00000100:00100000:2.0:1784290321.305769:0:88731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:2.0:1784290321.305780:0:88731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234444b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896223872:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290321.305793:0:88731:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290321.305808:0:88731:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2482044200/0x5953bbf6b3073f5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b22cd expref: -99 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290321.305834:0:88731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2482044200/0x5953bbf6b3073f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22cd expref: 10 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290321.305847:0:88731:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2482044200/0x5953bbf6b3073f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22cd expref: 10 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290321.305856:0:88731:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2482044200, rc 0) 00000100:00100000:2.0:1784290321.305911:0:88731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234444b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+10:42227:x1870961896223872:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 131us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290321.305921:0:88731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:0.0:1784290321.307411:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290321.307489:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896224000 00000100:00100000:3.0:1784290321.307499:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896224000 00000100:00100000:3.0:1784290321.307548:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:3.0:1784290321.307559:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+10:42227:x1870961896224000:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290321.307660:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344449c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+10:42227:x1870961896224000:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 99us (250us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784290321.307673:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:1.0:1784290322.087583:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1784290322.087604:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00010000:0.0:1784290322.087605:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290322.087617:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468893800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901062144:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1784290322.087620:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1784290322.087622:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1784290322.087631:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1784290322.087655:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901062272:0@lo:400:kworker.0 00000100:00080000:2.0:1784290322.087666:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290322.087715:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a4faa00 x1870961901062400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784290322.087748:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290322.087748:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784290322.087751:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290322.087757:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290322.087759:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784290322.087770:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901062400:0@lo:38:kworker.0 00000100:00080000:2.0:1784290322.087783:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290322.087802:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a4f8000 x1870961901062656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784290322.087814:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901062528:0@lo:400:kworker.0 00000100:00100000:0.0:1784290322.087826:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784290322.087843:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1784290322.087851:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901062784:0@lo:400:kworker.0 00000100:00080000:2.0:1784290322.087852:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1784290322.087853:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784290322.087858:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290322.087865:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290322.087869:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901062656:0@lo:38:kworker.0 00000100:00100000:2.0:1784290322.087884:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a4f9c00 x1870961901062912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784290322.087900:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290322.087913:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901062144 00000100:00100000:3.0:1784290322.087921:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901062144 00000100:00080000:2.0:1784290322.087932:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290322.087937:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290322.087939:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1784290322.087943:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784290322.087943:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901062400 00000100:00080000:2.0:1784290322.087944:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290322.087951:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901062400 00000100:00100000:1.0:1784290322.087956:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901063040:0@lo:400:kworker.0 00000100:00100000:2.0:1784290322.087964:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2446e77100 x1870961901063296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784290322.087973:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3769 00000100:00100000:1.0:1784290322.088026:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290322.088037:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901062144:12345-0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1784290322.088057:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784290322.088064:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290322.088068:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c246ff1c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784290322.088074:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901062528 00000100:00080000:2.0:1784290322.088081:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c246ff1c000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290322.088086:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901062528 00000004:00000024:3.0:1784290322.088088:0:23867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:1.0:1784290322.088090:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901063552:0@lo:400:kworker.0 00000100:00100000:2.0:1784290322.088113:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2468ad6a00 x1870961901063680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784290322.088152:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290322.088173:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901062784 00000100:00100000:0.0:1784290322.088181:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901062784 00000100:00100000:2.0:1784290322.088183:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901063168:0@lo:400:kworker.0 00000100:00100000:3.0:1784290322.088202:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468891180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901062144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 213us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290322.088216:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3769 00000100:00100000:1.0:1784290322.088244:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468893800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901062144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784290322.088258:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:0.0:1784290322.088286:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901062528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290322.088291:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901063424:0@lo:400:kworker.0 00000100:00100000:2.0:1784290322.088295:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290322.088323:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901063040 00000100:00100000:1.0:1784290322.088332:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901063040 00000100:00100000:3.0:1784290322.088432:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290322.088437:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901063552 00000100:00100000:1.0:1784290322.088444:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901063552 00000100:00100000:0.0:1784290322.088450:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901062528:12345-0@lo:400:kworker.0 Request processed in 173us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290322.088460:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1784290322.088486:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:2.0:1784290322.088498:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901062784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290322.088505:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901063168 00000100:00100000:3.0:1784290322.088511:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901062528:0@lo:400:kworker.0 00000100:00100000:1.0:1784290322.088515:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901063168 00000100:00100000:0.0:1784290322.088533:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:0.0:1784290322.088545:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901062400:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784290322.088580:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901063424 00000100:00100000:1.0:1784290322.088588:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901063424 00000100:00100000:3.0:1784290322.088594:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1531 00010000:00080000:0.0:1784290322.088601:0:65990:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2063 last 0 00000100:00100000:2.0:1784290322.088606:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901062784:12345-0@lo:400:kworker.0 Request processed in 113us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290322.088622:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901063040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290322.088624:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:1.0:1784290322.088658:0:26262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1532 00000020:00000080:0.0:1784290322.088665:0:65990:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5953bbf6b3073f62 00000100:00100000:1.0:1784290322.088679:0:26262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901063552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290322.088688:0:88731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901062272 00000004:00100000:0.0:1784290322.088693:0:65990:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1784290322.088699:0:88731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901062272 00000100:00100000:3.0:1784290322.088717:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901063040:12345-0@lo:400:kworker.0 Request processed in 102us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290322.088732:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1531 00000100:00100000:1.0:1784290322.088772:0:26262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901063552:12345-0@lo:400:kworker.0 Request processed in 96us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290322.088777:0:88731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784290322.088794:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1533 00000100:00100000:2.0:1784290322.088803:0:88731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3618:x1870961901062272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290322.088820:0:26262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1532 00000100:00100000:3.0:1784290322.088826:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901063168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290322.088866:0:26262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1534 00000100:00100000:1.0:1784290322.088891:0:26262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901063424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290322.088907:0:88731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344448450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3618:x1870961901062272:12345-0@lo:400:kworker.0 Request processed in 112us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290322.088923:0:88731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1784290322.088943:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901063168:12345-0@lo:400:kworker.0 Request processed in 125us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290322.088957:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1533 00000100:00100000:1.0:1784290322.089017:0:26262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901063424:12345-0@lo:400:kworker.0 Request processed in 103us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290322.089029:0:26262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1534 00000100:00080000:0.0:1784290322.089041:0:65990:0:(import.c:65:import_set_state_nolock()) ffff9c2343907800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784290322.089075:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901063424:0@lo:400:kworker.0 00000100:00100000:2.0:1784290322.089124:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901063168:0@lo:400:kworker.0 00000100:00100000:3.0:1784290322.089128:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901062272:0@lo:400:kworker.0 00000100:00100000:1.0:1784290322.089143:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f977800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901063552:0@lo:400:kworker.0 00000100:00100000:0.0:1784290322.089151:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1870961901062400:12345-0@lo:38:kworker.0 Request processed in 599us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290322.089168:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:1.0:1784290322.089188:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901063040:0@lo:400:kworker.0 00000100:00100000:1.0:1784290322.089212:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901062784:0@lo:400:kworker.0 00000100:00080000:2.0:1784290322.089275:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784290322.089284:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784290322.089288:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784290322.089312:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290322.089382:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901062656 00000100:00100000:2.0:1784290322.089392:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901062656 00010000:00080000:3.0:1784290322.089415:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c246a4faa00 x1870961901062400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784290322.089436:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 25 00000100:00100000:2.0:1784290322.089445:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:2.0:1784290322.089457:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901062656:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1784290322.089483:0:65989:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2063 last 0 00000020:00000080:2.0:1784290322.089516:0:65989:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5953bbf6b3073f69 00000004:00100000:2.0:1784290322.089527:0:65989:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784290322.089554:0:65989:0:(import.c:65:import_set_state_nolock()) ffff9c24481c6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784290322.089605:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1870961901062656:12345-0@lo:38:kworker.0 Request processed in 149us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290322.089614:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00080000:3.0:1784290322.090779:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9c246a4faa00 x1870961901062400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290347 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784290322.090790:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1784290322.090795:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784290322.090800:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1784290322.090806:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901062400:0@lo:38:kworker.0 00000100:00100000:3.0:1784290322.090827:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901062912:0@lo:38:kworker.0 00000100:00100000:3.0:1784290322.090861:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290322.090891:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2446e77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901063296:0@lo:38:kworker.0 00000100:00100000:3.0:1784290322.090914:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290322.090935:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901063680:0@lo:38:kworker.0 00000100:00100000:3.0:1784290322.090965:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290322.091033:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901062912 00000100:00100000:2.0:1784290322.091045:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901062912 00010000:00080000:3.0:1784290322.091053:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c246a4f8000 x1870961901062656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290322.091069:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901063296 00000100:00080000:3.0:1784290322.091071:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 25 00000100:00100000:0.0:1784290322.091084:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901063296 00000100:00100000:2.0:1784290322.091103:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3770 00000100:00100000:2.0:1784290322.091114:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901062912:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290322.091140:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901063680 00010000:00080000:2.0:1784290322.091146:0:22091:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9c2458beb800, cookie 0x5953bbf6b3073dcc 00000100:00100000:0.0:1784290322.091147:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901063680 00000100:00100000:1.0:1784290322.091159:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00010000:00080000:2.0:1784290322.091167:0:22091:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9c2458beb800 cur 2063 last 1784290316 00000100:00100000:1.0:1784290322.091180:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1870961901063296:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290322.091200:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000004:00100000:2.0:1784290322.091202:0:22091:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:1.0:1784290322.091217:0:65988:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2063 last 0 00000100:00100000:0.0:1784290322.091218:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901063680:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1784290322.091254:0:22091:0:(import.c:65:import_set_state_nolock()) ffff9c24481c4800 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1784290322.091265:0:65990:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2063 last 0 00000020:00000080:1.0:1784290322.091273:0:65988:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5953bbf6b3073f70 00000004:00100000:1.0:1784290322.091293:0:65988:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000080:0.0:1784290322.091329:0:65990:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5953bbf6b3073f77 00000100:00080000:1.0:1784290322.091334:0:65988:0:(import.c:65:import_set_state_nolock()) ffff9c246ff18800 : changing import state from RECOVER to FULL 00000004:00100000:0.0:1784290322.091410:0:65990:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1784290322.091420:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1870961901062912:12345-0@lo:38:kworker.0 Request processed in 298us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290322.091435:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3770 00000100:00080000:0.0:1784290322.091461:0:65990:0:(import.c:65:import_set_state_nolock()) ffff9c246dce3000 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1784290322.091483:0:88756:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1784290322.091485:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1870961901063296:12345-0@lo:38:kworker.0 Request processed in 305us (564us total) trans 0 rc 0/0 00010000:00080000:2.0:1784290322.091492:0:88756:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 103079215111 00000020:00080000:2.0:1784290322.091502:0:88756:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00000100:00100000:1.0:1784290322.091504:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00010000:00080000:2.0:1784290322.091512:0:88756:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 103079215111, next_transno: 103079215111 00010000:00080000:2.0:1784290322.091520:0:88756:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215111) 00000020:00080000:2.0:1784290322.091527:0:88756:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290322.091545:0:88756:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896217600 t103079215111 from 192.168.202.6@tcp req@ffff9c246a540700 x1870961896217600/t0(103079215111) o36->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:340/0 lens 528/0 e 0 to 0 dl 1784290330 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290322.091555:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1870961901063680:12345-0@lo:38:kworker.0 Request processed in 337us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290322.091589:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000004:00080000:2.0:1784290322.092407:0:88756:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 766us 00000100:00080000:3.0:1784290322.092483:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9c246a4f8000 x1870961901062656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290347 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784290322.092496:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1784290322.092500:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784290322.092506:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1784290322.092512:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901062656:0@lo:38:kworker.0 00000100:00080000:3.0:1784290322.092548:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 25 00000100:00080000:3.0:1784290322.092556:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1784290322.092560:0:3616:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1784290322.092564:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 77309411339 gen 3 00000100:00080000:3.0:1784290322.092569:0:3616:0:(recover.c:53:ptlrpc_replay_next()) import ffff9c246dd98000 from lustre-MDT0000_UUID committed 77309411339 last 0 00000100:00080000:3.0:1784290322.092573:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1784290322.092925:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901062912:0@lo:38:kworker.0 00010000:00080000:0.0:1784290322.092965:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2446e77100 x1870961901063296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1784290322.092975:0:89121:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1784290322.093003:0:89121:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1784290322.093013:0:89121:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:0.0:1784290322.093017:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 25 00000100:00080000:3.0:1784290322.096448:0:89121:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:0.0:1784290322.097382:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9c2446e77100 x1870961901063296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290347 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290322.097417:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784290322.097423:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784290322.097430:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784290322.097438:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2446e77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901063296:0@lo:38:kworker.0 00010000:00080000:0.0:1784290322.097472:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2468ad6a00 x1870961901063680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290322.097487:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 25 00000100:00080000:0.0:1784290322.097494:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784290322.097499:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784290322.097502:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246ff1c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784290322.097507:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901063680:0@lo:38:kworker.0 00000100:00100000:0.0:1784290322.097541:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901063808:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1784290322.097589:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290322.097650:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901063808 00000100:00100000:3.0:1784290322.097661:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901063808 00000100:00100000:3.0:1784290322.097721:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3771 00000100:00100000:3.0:1784290322.097735:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1870961901063808:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1784290322.097754:0:23867:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9c2446e77100 x1870961901063808/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:343/0 lens 224/0 e 0 to 0 dl 1784290333 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290322.097790:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1870961901063808:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 60us (202us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784290322.097800:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3771 00010000:00010000:2.0:1784290322.101869:0:88756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3073f7e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.101894:0:88756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3073f7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.101914:0:88756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3073f7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.101947:0:88756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073f85 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.101958:0:88756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073f85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.101968:0:88756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073f85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.102621:0:88756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3073f7e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.102635:0:88756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3073f7e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.102645:0:88756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3073f7e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.102653:0:88756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045e00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290322.102660:0:88756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3073f7e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.102672:0:88756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3073f7e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.102693:0:88756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2461f23100) 00010000:00010000:2.0:1784290322.102697:0:88756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290322.102703:0:88756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3073f7e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.102713:0:88756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3073f7e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784290322.102757:0:88756:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000018816754 reply state 00000000ff5a4254 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073f85 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.102773:0:88756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073f85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.102783:0:88756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2461f23a00) 00010000:00010000:2.0:1784290322.102787:0:88756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290322.102791:0:88756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1784290322.102930:0:88756:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1784290322.102955:0:88756:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290322.102960:0:88756:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000020:00080000:2.0:1784290322.102966:0:88756:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290322.102970:0:88756:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000001:00080000:1.0:1784290322.104104:0:88725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215111 is committed 00010000:00010000:3.0:1784290322.104151:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073f85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.104168:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073f85 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.104178:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073f85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.104185:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290322.104190:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073f85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.104198:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073f85 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.104214:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2461f23a00) 00010000:00010000:3.0:1784290322.104218:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290322.104223:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073f85 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.104230:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3073f85 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290322.104638:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290322.104708:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896218112 00000100:00100000:2.0:1784290322.104717:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896218112 00000100:00100000:2.0:1784290322.104777:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1099 00000100:00100000:2.0:1784290322.104790:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896218112:12345-192.168.202.6@tcp:36:rm.0 00010000:00080000:2.0:1784290322.104806:0:66008:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215112, current: 103079215112, replaying 00000100:00100000:2.0:1784290322.104824:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896218112:12345-192.168.202.6@tcp:36:rm.0 Request processed in 38us (192us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784290322.104838:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1099 00000020:00080000:0.0:1784290322.104841:0:88756:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290322.104849:0:88756:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215112, next_transno: 103079215112 00010000:00080000:0.0:1784290322.104856:0:88756:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215112) 00000020:00080000:0.0:1784290322.104860:0:88756:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290322.104873:0:88756:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896218112 t103079215112 from 192.168.202.6@tcp req@ffff9c2447ccb480 x1870961896218112/t0(103079215112) o36->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:343/0 lens 512/0 e 0 to 0 dl 1784290333 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784290322.104949:0:88756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b3073f8c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.104964:0:88756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b3073f8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105013:0:88756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b3073f8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105029:0:88756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b3073f93 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105038:0:88756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b3073f93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105046:0:88756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b3073f93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105118:0:88756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073f9a lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105129:0:88756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073f9a lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105137:0:88756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073f9a lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105333:0:88756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073f9a lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105381:0:88756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073f9a lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105390:0:88756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073f9a lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105399:0:88756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27c00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290322.105404:0:88756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073f9a lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105425:0:88756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073f9a lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105444:0:88756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9c2449a35500) 00010000:00010000:0.0:1784290322.105448:0:88756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784290322.105453:0:88756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073f9a lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105460:0:88756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073f9a lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105484:0:88756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b3073f8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105492:0:88756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b3073f8c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105499:0:88756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b3073f8c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105505:0:88756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290322.105509:0:88756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b3073f8c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105516:0:88756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b3073f8c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105524:0:88756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2449a35000) 00010000:00010000:0.0:1784290322.105527:0:88756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290322.105531:0:88756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b3073f8c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105552:0:88756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b3073f8c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290322.105567:0:88756:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b372070d reply state 00000000f7f0fc55 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b3073f93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105579:0:88756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b3073f93 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.105588:0:88756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2449a35100) 00010000:00010000:0.0:1784290322.105591:0:88756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290322.105594:0:88756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1784290322.105658:0:88756:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1784290322.105676:0:88756:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290322.105679:0:88756:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000020:00080000:0.0:1784290322.105684:0:88756:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290322.105687:0:88756:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000100:00100000:3.0:1784290322.107226:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290322.107376:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896219008 00000100:00100000:1.0:1784290322.107386:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896219008 00000100:00100000:1.0:1784290322.107438:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1100 00000100:00100000:1.0:1784290322.107453:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2396:x1870961896219008:12345-192.168.202.6@tcp:36:dd.0 00010000:00080000:1.0:1784290322.107481:0:65988:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215113, current: 103079215114, replaying 00000100:00100000:1.0:1784290322.107499:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2396:x1870961896219008:12345-192.168.202.6@tcp:36:dd.0 Request processed in 52us (279us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784290322.107507:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1100 00000020:00080000:0.0:1784290322.107535:0:88756:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290322.107542:0:88756:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215114, next_transno: 103079215113 00010000:00080000:0.0:1784290322.107547:0:88756:0:(ldlm_lib.c:2258:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 103079215113, ql: 1, comp: 1, conn: 2, next: 103079215114, next_update 0 last_committed: 103079215111) 00000020:00080000:0.0:1784290322.107552:0:88756:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290322.107562:0:88756:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896219008 t103079215114 from 192.168.202.6@tcp req@ffff9c246a4f9c00 x1870961896219008/t0(103079215114) o36->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:343/0 lens 488/0 e 0 to 0 dl 1784290333 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784290322.107702:0:88756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3073fa1 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.107714:0:88756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3073fa1 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.107731:0:88756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3073fa1 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290322.107805:0:88756:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006db2c84c reply state 000000008d268e9e transno 103079215114 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3073fa1 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.107819:0:88756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3073fa1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.107831:0:88756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2449a35200) 00010000:00010000:0.0:1784290322.107836:0:88756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290322.107840:0:88756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1784290322.107970:0:88756:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1784290322.108022:0:88756:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290322.108029:0:88756:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215115 00000020:00080000:0.0:1784290322.108037:0:88756:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290322.108042:0:88756:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215115 00000100:00100000:1.0:1784290322.109509:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290322.109601:0:88015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896219264 00000100:00100000:0.0:1784290322.109613:0:88015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896219264 00000100:00100000:0.0:1784290322.109696:0:88015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2 00000100:00100000:0.0:1784290322.109715:0:88015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:2396:x1870961896219264:12345-192.168.202.6@tcp:10:dd.0 00010000:00080000:0.0:1784290322.109745:0:88015:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 103079215115, current: 103079215115, replaying 00000100:00100000:0.0:1784290322.109762:0:88015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:2396:x1870961896219264:12345-192.168.202.6@tcp:10:dd.0 Request processed in 55us (259us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784290322.109772:0:88015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2 00000020:00080000:2.0:1784290322.109911:0:88756:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290322.109919:0:88756:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215115, next_transno: 103079215115 00010000:00080000:2.0:1784290322.109925:0:88756:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (103079215115) 00000020:00080000:2.0:1784290322.109929:0:88756:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290322.109941:0:88756:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896219264 t103079215115 from 192.168.202.6@tcp req@ffff9c245fe38e00 x1870961896219264/t0(103079215115) o10->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:343/0 lens 440/0 e 0 to 0 dl 1784290333 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784290322.110201:0:88756:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1784290322.110220:0:88756:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290322.110223:0:88756:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215116 00000020:00080000:2.0:1784290322.110228:0:88756:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290322.110231:0:88756:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215116 00000100:00100000:2.0:1784290322.113236:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290322.113387:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896224128 00000100:00100000:1.0:1784290322.113397:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896224128 00000100:00100000:1.0:1784290322.113457:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1101 00000100:00100000:1.0:1784290322.113468:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:2396:x1870961896224128:12345-192.168.202.6@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1784290322.113488:0:66004:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c2468ad7800 x1870961896224128/t0(0) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:343/0 lens 328/0 e 0 to 0 dl 1784290333 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290322.113514:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:2396:x1870961896224128:12345-192.168.202.6@tcp:101:ldlm_lock_repla.0 Request processed in 48us (282us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784290322.113526:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1101 00000020:00080000:2.0:1784290322.113571:0:88756:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290322.113581:0:88756:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 103079215116 00010000:00080000:2.0:1784290322.113588:0:88756:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1784290322.113593:0:88756:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290322.113603:0:88756:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1784290322.113607:0:88756:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1784290322.113623:0:88756:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.6@tcp: req@ffff9c2468ad7800 x1870961896224128/t0(0) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:343/0 lens 328/0 e 0 to 0 dl 1784290333 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1784290322.113654:0:88756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290322.113677:0:88756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3073fa8 lrc: 2/0,0 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b22a3 expref: -99 pid: 88756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.113704:0:88756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3073fa8 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 12 pid: 88756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.113720:0:88756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3073fa8 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 12 pid: 88756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.113732:0:88756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2482045000, rc 0) 00010000:00080000:2.0:1784290322.113784:0:88756:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1784290322.113812:0:88756:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1784290322.115139:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290322.115273:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896224256 00000100:00100000:0.0:1784290322.115283:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896224256 00000100:00100000:0.0:1784290322.115389:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 659 00000100:00100000:0.0:1784290322.115417:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:2396:x1870961896224256:12345-192.168.202.6@tcp:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1784290322.115439:0:65989:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9c246a4f8000 x1870961896224256/t0(0) o400->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:343/0 lens 224/0 e 0 to 0 dl 1784290333 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290322.115481:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:2396:x1870961896224256:12345-192.168.202.6@tcp:400:ptlrpcd_rcv.0 Request processed in 65us (343us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784290322.115492:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 659 00010000:00080000:3.0:1784290322.115582:0:88756:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1784290322.115689:0:88756:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 107374182400 00000001:00100000:1.0:1784290322.117050:0:88725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000001:00100000:1.0:1784290322.117060:0:88725:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1784290322.117081:0:88725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215115 is committed 00010000:00010000:0.0:1784290322.117196:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b3073f93 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.117214:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b3073f93 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.117224:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b3073f93 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.117232:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27a00 already unused, calling callback (ffffffffc1aba4f0) 00000001:00080000:3.0:1784290322.117235:0:88756:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:0.0:1784290322.117238:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b3073f93 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.117254:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b3073f93 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.117272:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b3073f93 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.117280:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b3073f93 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1784290322.117286:0:88756:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1784290322.117306:0:88756:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9c2446e77100 x1870961901063808/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:343/0 lens 224/0 e 0 to 0 dl 1784290333 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784290322.117311:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3073fa1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.117335:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3073fa1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.117389:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3073fa1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.117397:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290322.117403:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3073fa1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.117413:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3073fa1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.117431:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2449a35200) 00010000:00010000:0.0:1784290322.117436:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290322.117445:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3073fa1 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1784290322.117448:0:88756:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.202.6@tcp: req@ffff9c246a4f8000 x1870961896224256/t0(0) o400->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:343/0 lens 224/0 e 0 to 0 dl 1784290333 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784290322.117461:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00010000:00010000:0.0:1784290322.117467:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3073fa1 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 88756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784290322.117484:0:3616:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9c247f976d80 x1870961901063808/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290338 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784290322.117516:0:3616:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9c247f976d80 x1870961901063808/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290338 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784290322.117527:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1784290322.117553:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00010000:02000000:3.0:1784290322.117555:0:88756:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:02, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1784290322.117564:0:3616:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000124aa97): req@ffff9c2447ccbb80 x1870961901046912/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290318 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290322.117606:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901063808:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1784290322.117648:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784290322.117668:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901063936:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784290322.117732:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290322.117772:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290322.117836:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901046912 00000100:00100000:1.0:1784290322.117844:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901046912 00000100:00100000:2.0:1784290322.117879:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901063936 00000100:00100000:2.0:1784290322.117895:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901063936 00000100:00100000:1.0:1784290322.117910:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3772 00000100:00100000:1.0:1784290322.117928:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3617:x1870961901046912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784290322.117962:0:22091:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 0 free 1444651008 avail 1298411520 00000100:00100000:0.0:1784290322.117974:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3773 00000100:00100000:0.0:1784290322.118026:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3619:x1870961901063936:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784290322.118059:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3617:x1870961901046912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (325us total) trans 0 rc 0/0 00000004:00000024:0.0:1784290322.118063:0:8413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 0 free 1444651008 avail 1298411520 00000100:00100000:1.0:1784290322.118076:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3772 00000100:00100000:1.0:1784290322.118133:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901046912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784290322.118184:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1870961901063936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 166us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290322.118224:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3773 00000100:00100000:2.0:1784290322.118268:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901063936:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784290322.119515:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290322.119551:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290322.119595:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290322.119618:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896219776 00000100:00100000:0.0:1784290322.119622:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896222720 00000100:00100000:2.0:1784290322.119632:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896219776 00000100:00100000:0.0:1784290322.119635:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896222720 00000100:00100000:1.0:1784290322.119650:0:66002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896219648 00000100:00100000:1.0:1784290322.119660:0:66002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896219648 00002000:00100000:1.0:1784290322.119698:0:66002:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff9c2468893800 x1870961896219648/t0(0) o4->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:343/0 lens 496/0 e 0 to 0 dl 1784290333 ref 1 fl New:/602/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784290322.119712:0:66002:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9c2468893800 with x1870961896219648 00000100:00100000:2.0:1784290322.119722:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1102 00002000:00010000:1.0:1784290322.119728:0:66002:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3073fa8 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 9 pid: 88756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290322.119744:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1103 00000100:00100000:2.0:1784290322.119751:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:2399:x1870961896219776:12345-192.168.202.6@tcp:16:kworker.0 00000100:00100000:0.0:1784290322.119773:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:68007:x1870961896222720:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1784290322.119791:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1784290322.119801:0:66002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 3 00010000:00010000:0.0:1784290322.119813:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b3073faf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b22b1 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290322.119823:0:66002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:2400:x1870961896219648:12345-192.168.202.6@tcp:4:dd.0 00000100:00100000:2.0:1784290322.119858:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:2399:x1870961896219776:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 116us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290322.119870:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1102 00010000:00010000:0.0:1784290322.119895:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073fb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.119912:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.119924:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290322.119967:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784290322.119973:0:65988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784290322.120038:0:65988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.120072:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b3073faf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22b1 expref: 10 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.120094:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22b1 expref: 9 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.120124:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2449a35000) 00010000:00010000:0.0:1784290322.120129:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784290322.120134:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27c00, rc 0) 00000100:00100000:0.0:1784290322.120200:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:68007:x1870961896222720:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 437us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290322.120212:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1103 00000100:00100000:1.0:1784290322.120663:0:66002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:2400:x1870961896219648:12345-192.168.202.6@tcp:4:dd.0 Request processed in 847us (1065us total) trans 107374182401 rc 0/0 00000100:00100000:1.0:1784290322.120684:0:66002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 3 00002000:00100000:1.0:1784290322.120695:0:66002:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff9c2468893800 x1870961896219648/t107374182401(0) o4->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:343/0 lens 496/448 e 0 to 0 dl 1784290333 ref 1 fl Complete:/602/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784290322.120707:0:66002:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9c2468893800 with x1870961896219648 00002000:00010000:1.0:1784290322.120719:0:66002:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3073fa8 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 10 pid: 88756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290322.122950:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290322.123049:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896224640 00000100:00100000:0.0:1784290322.123062:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896224640 00000100:00100000:0.0:1784290322.123123:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1104 00000100:00100000:0.0:1784290322.123139:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:68007:x1870961896224640:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:0.0:1784290322.123167:0:66008:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 28672 free 1444651008 avail 1298411520 00000100:00100000:0.0:1784290322.123228:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:68007:x1870961896224640:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 94us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290322.123238:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1104 00000100:00100000:2.0:1784290322.124424:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290322.124495:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896224768 00000100:00100000:1.0:1784290322.124505:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896224768 00000100:00100000:1.0:1784290322.124584:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1105 00000100:00080000:2.0:1784290322.124596:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784290322.124599:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:68007:x1870961896224768:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:1.0:1784290322.124647:0:74876:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:1.0:1784290322.124710:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:68007:x1870961896224768:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 114us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290322.124721:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1105 00000100:00100000:2.0:1784290322.126913:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290322.127004:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896224896 00000100:00100000:0.0:1784290322.127015:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896224896 00000100:00100000:0.0:1784290322.127070:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4928 00000100:00100000:0.0:1784290322.127079:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2396:x1870961896224896:12345-192.168.202.6@tcp:8:lfs.0 00010000:00080000:0.0:1784290322.127110:0:8404:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp t0 exp 0000000000000000 cur 2063 last 0 00000020:00000080:0.0:1784290322.127142:0:8404:0:(genops.c:1406:class_connect()) connect: client bd808cf4-dd54-45f0-9b2b-1434e8330e5d, cookie 0x5953bbf6b3073fbd 00002000:00100000:0.0:1784290322.127156:0:8404:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bd808cf4-dd54-45f0-9b2b-1434e8330e5d/ffff9c247f8f5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ad ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784290322.127177:0:8404:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784290322.127249:0:8404:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784290322.127280:0:8404:0:(import.c:65:import_set_state_nolock()) ffff9c247d3d1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290322.127418:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896224896:12345-192.168.202.6@tcp:8:lfs.0 Request processed in 333us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290322.127432:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4928 00000100:00100000:2.0:1784290322.128845:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000001:00100000:1.0:1784290322.128904:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000001:00100000:1.0:1784290322.128916:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000020:00000080:1.0:1784290322.128920:0:8397:0:(genops.c:906:class_export_put()) final put ffff9c245fd7e000/bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000001:00100000:1.0:1784290322.128948:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1784290322.128976:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896225024 00000020:00000080:2.0:1784290322.129002:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c245fd7e000/bd808cf4-dd54-45f0-9b2b-1434e8330e5d for lustre-OST0000 00000100:00100000:0.0:1784290322.129017:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896225024 00000020:00000080:2.0:1784290322.129079:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c245fd7d800 for lustre-OST0000 00000100:00080000:1.0:1784290322.129084:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784290322.129115:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1156 00000100:00100000:0.0:1784290322.129130:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:68007:x1870961896225024:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:0.0:1784290322.129152:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290322.129220:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:68007:x1870961896225024:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 92us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290322.129230:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1156 00000100:00100000:1.0:1784290322.130547:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290322.130617:0:26260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896225152 00000100:00100000:0.0:1784290322.130628:0:26260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896225152 00000100:00100000:0.0:1784290322.130689:0:26260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4929 00000100:00100000:0.0:1784290322.130702:0:26260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2396:x1870961896225152:12345-192.168.202.6@tcp:8:lfs.0 00010000:00080000:0.0:1784290322.130743:0:26260:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp t0 exp 0000000000000000 cur 2063 last 0 00000020:00000080:0.0:1784290322.130782:0:26260:0:(genops.c:1406:class_connect()) connect: client bd808cf4-dd54-45f0-9b2b-1434e8330e5d, cookie 0x5953bbf6b3073fc4 00002000:00100000:0.0:1784290322.130796:0:26260:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bd808cf4-dd54-45f0-9b2b-1434e8330e5d/ffff9c247d3d7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ad ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784290322.130818:0:26260:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784290322.130909:0:26260:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784290322.130936:0:26260:0:(import.c:65:import_set_state_nolock()) ffff9c2475c2b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290322.131019:0:26260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896225152:12345-192.168.202.6@tcp:8:lfs.0 Request processed in 315us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290322.131036:0:26260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4929 00000001:00100000:1.0:1784290322.132196:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000001:00100000:1.0:1784290322.132209:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000020:00000080:1.0:1784290322.132212:0:9482:0:(genops.c:906:class_export_put()) final put ffff9c245fd7f800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000001:00100000:1.0:1784290322.132242:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784290322.132310:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c245fd7f800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d for lustre-OST0001 00000100:00100000:2.0:1784290322.132407:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000020:00000080:0.0:1784290322.132425:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c247e4b2800 for lustre-OST0001 00000100:00100000:1.0:1784290322.132468:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896225280 00000100:00100000:1.0:1784290322.132477:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896225280 00000100:00100000:1.0:1784290322.132555:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1157 00000100:00080000:2.0:1784290322.132566:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784290322.132569:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a51a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:68007:x1870961896225280:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:1.0:1784290322.132593:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290322.132652:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a51a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:68007:x1870961896225280:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 86us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290322.132665:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1157 00000004:00000080:2.0:1784290322.141684:0:88756:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae5447a83e10 00100000:10000000:2.0:1784290322.141699:0:88756:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1784290322.142140:0:88744:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x682:0x0] 00000100:00100000:3.0:1784290322.142197:0:88744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4faa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88744:1870961901064064:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1784290322.142202:0:88742:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x45c:0x0] 00000100:00100000:1.0:1784290322.142253:0:88742:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88742:1870961901064192:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784290322.142269:0:88744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290322.142329:0:88744:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784290322.142380:0:88742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290322.142437:0:88742:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343b940c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290322.142438:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901064064 00000100:00100000:3.0:1784290322.142450:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901064064 00000100:00100000:2.0:1784290322.142485:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901064192 00000100:00100000:2.0:1784290322.142500:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901064192 00000100:00100000:3.0:1784290322.142521:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4930 00000100:00100000:3.0:1784290322.142542:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:88744:x1870961901064064:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1784290322.142574:0:8403:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1793 -> diff = -127 00002000:02000040:3.0:1784290322.142582:0:8403:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1667 to 0x2c0000401:1793) 00000100:00100000:2.0:1784290322.142599:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4931 00000100:00100000:2.0:1784290322.142630:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:88742:x1870961901064192:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1784290322.142666:0:26258:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1793 -> diff = -677 00002000:02000040:2.0:1784290322.142674:0:26258:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1117 to 0x280000401:1793) 00002000:00010000:3.0:1784290322.148642:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x701:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290322.148655:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecb5999d/0x5953bbf6b3073fcb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.148677:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x701:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.148684:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x701:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290322.148692:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecb5999d/0x5953bbf6b3073fcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.148734:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecb5999d/0x5953bbf6b3073fcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.148748:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecb5999d/0x5953bbf6b3073fcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.148758:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecb5999d/0x5953bbf6b3073fcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.148787:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.148833:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.148848:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecb5999d/0x5953bbf6b3073fcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.148867:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f4400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.148874:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecb5999d/0x5953bbf6b3073fcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.148889:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecb5999d/0x5953bbf6b3073fcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290322.148895:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x700:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290322.148912:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecf74d3e/0x5953bbf6b3073fd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.148924:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x700:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:0.0:1784290322.148925:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecb5999d/0x5953bbf6b3073fcb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.148930:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x700:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290322.148946:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecf74d3e/0x5953bbf6b3073fd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.148951:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecb5999d/0x5953bbf6b3073fcb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.148979:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecf74d3e/0x5953bbf6b3073fd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.149013:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecf74d3e/0x5953bbf6b3073fd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.149023:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.149028:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.149031:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.149047:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecf74d3e/0x5953bbf6b3073fd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.149072:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.149103:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.149113:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecf74d3e/0x5953bbf6b3073fd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.149125:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f5600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.149131:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecf74d3e/0x5953bbf6b3073fd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290322.149133:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290322.149150:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0bbfcb1/0x5953bbf6b3073fd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.149162:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ff:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.149177:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290322.149191:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0bbfcb1/0x5953bbf6b3073fd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.149198:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecf74d3e/0x5953bbf6b3073fd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.149210:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0bbfcb1/0x5953bbf6b3073fd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.149224:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecf74d3e/0x5953bbf6b3073fd2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.149226:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0bbfcb1/0x5953bbf6b3073fd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.149267:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecf74d3e/0x5953bbf6b3073fd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.149269:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0bbfcb1/0x5953bbf6b3073fd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.149321:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290322.149329:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784290322.149330:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0bbfcb1/0x5953bbf6b3073fd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.149400:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f5a00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.149406:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0bbfcb1/0x5953bbf6b3073fd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.149417:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0bbfcb1/0x5953bbf6b3073fd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.149434:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0bbfcb1/0x5953bbf6b3073fd9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.149435:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.149450:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0bbfcb1/0x5953bbf6b3073fd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.149496:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.149500:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.149503:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784290322.149718:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290322.149727:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084ed3959/0x5953bbf6b3073fe0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.149750:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fe:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.149755:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290322.149761:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084ed3959/0x5953bbf6b3073fe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.149774:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084ed3959/0x5953bbf6b3073fe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.149784:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084ed3959/0x5953bbf6b3073fe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.149794:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084ed3959/0x5953bbf6b3073fe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.149819:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784290322.149872:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290322.149879:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002febafc/0x5953bbf6b3073fe7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.149889:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fd:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.149893:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290322.149899:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002febafc/0x5953bbf6b3073fe7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.149904:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290322.149920:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002febafc/0x5953bbf6b3073fe7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.149923:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084ed3959/0x5953bbf6b3073fe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.149956:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f5400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.149965:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084ed3959/0x5953bbf6b3073fe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150013:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002febafc/0x5953bbf6b3073fe7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.150020:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084ed3959/0x5953bbf6b3073fe0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150056:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002febafc/0x5953bbf6b3073fe7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.150067:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084ed3959/0x5953bbf6b3073fe0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.150090:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084ed3959/0x5953bbf6b3073fe0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150111:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.150116:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.150124:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002febafc/0x5953bbf6b3073fe7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.150132:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429df200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.150150:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002febafc/0x5953bbf6b3073fe7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.150164:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002febafc/0x5953bbf6b3073fe7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.150182:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002febafc/0x5953bbf6b3073fe7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.150193:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002febafc/0x5953bbf6b3073fe7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290322.150209:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290322.150213:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.150223:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000024c3d96/0x5953bbf6b3073fee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.150224:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.150232:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.150239:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.150247:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fc:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.150254:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290322.150261:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000024c3d96/0x5953bbf6b3073fee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150274:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000024c3d96/0x5953bbf6b3073fee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150285:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000024c3d96/0x5953bbf6b3073fee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150294:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000024c3d96/0x5953bbf6b3073fee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150333:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.150405:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.150415:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000024c3d96/0x5953bbf6b3073fee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.150426:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b8600 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:3.0:1784290322.150433:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.150434:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000024c3d96/0x5953bbf6b3073fee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150452:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004403ea8f/0x5953bbf6b3073ff5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.150458:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000024c3d96/0x5953bbf6b3073fee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150471:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fb:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.150479:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290322.150484:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000024c3d96/0x5953bbf6b3073fee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150487:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004403ea8f/0x5953bbf6b3073ff5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150505:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004403ea8f/0x5953bbf6b3073ff5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.150517:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000024c3d96/0x5953bbf6b3073fee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150525:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004403ea8f/0x5953bbf6b3073ff5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150546:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004403ea8f/0x5953bbf6b3073ff5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.150553:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.150561:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.150566:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004403ea8f/0x5953bbf6b3073ff5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150573:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784290322.150580:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b8e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.150588:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004403ea8f/0x5953bbf6b3073ff5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.150602:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004403ea8f/0x5953bbf6b3073ff5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.150620:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.150623:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004403ea8f/0x5953bbf6b3073ff5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290322.150628:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.150645:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004403ea8f/0x5953bbf6b3073ff5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150649:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af6d6aba/0x5953bbf6b3073ffc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150682:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fa:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:0.0:1784290322.150687:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.150692:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.150697:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.150702:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290322.150711:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af6d6aba/0x5953bbf6b3073ffc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150725:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af6d6aba/0x5953bbf6b3073ffc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150736:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af6d6aba/0x5953bbf6b3073ffc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150745:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af6d6aba/0x5953bbf6b3073ffc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150767:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.150808:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1784290322.150821:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.150822:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af6d6aba/0x5953bbf6b3073ffc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150831:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069b37486/0x5953bbf6b3074003 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150854:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f9:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.150867:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290322.150877:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b9e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290322.150878:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069b37486/0x5953bbf6b3074003 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.150895:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af6d6aba/0x5953bbf6b3073ffc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150900:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069b37486/0x5953bbf6b3074003 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.150949:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069b37486/0x5953bbf6b3074003 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.150953:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af6d6aba/0x5953bbf6b3073ffc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.151015:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069b37486/0x5953bbf6b3074003 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.151039:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af6d6aba/0x5953bbf6b3073ffc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.151043:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.151067:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af6d6aba/0x5953bbf6b3073ffc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.151106:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1784290322.151109:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.151117:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069b37486/0x5953bbf6b3074003 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.151121:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008ca738a/0x5953bbf6b307400a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.151148:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.151161:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f8:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:0.0:1784290322.151165:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b8a00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290322.151169:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290322.151180:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008ca738a/0x5953bbf6b307400a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.151180:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069b37486/0x5953bbf6b3074003 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.151218:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008ca738a/0x5953bbf6b307400a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.151227:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069b37486/0x5953bbf6b3074003 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.151233:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008ca738a/0x5953bbf6b307400a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.151269:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008ca738a/0x5953bbf6b307400a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.151285:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069b37486/0x5953bbf6b3074003 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.151300:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.151324:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069b37486/0x5953bbf6b3074003 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290322.151387:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290322.151388:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.151409:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008ca738a/0x5953bbf6b307400a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.151410:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000830458f3/0x5953bbf6b3074011 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.151414:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.151423:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.151432:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.151444:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b8c00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290322.151451:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f7:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:1.0:1784290322.151454:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008ca738a/0x5953bbf6b307400a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.151462:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290322.151481:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000830458f3/0x5953bbf6b3074011 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.151484:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008ca738a/0x5953bbf6b307400a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.151518:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000830458f3/0x5953bbf6b3074011 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.151536:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000830458f3/0x5953bbf6b3074011 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.151558:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000830458f3/0x5953bbf6b3074011 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.151565:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008ca738a/0x5953bbf6b307400a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.151580:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008ca738a/0x5953bbf6b307400a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.151587:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.151606:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.151614:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000830458f3/0x5953bbf6b3074011 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.151626:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b8200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290322.151632:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000830458f3/0x5953bbf6b3074011 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.151639:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.151645:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000830458f3/0x5953bbf6b3074011 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290322.151656:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290322.151662:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000830458f3/0x5953bbf6b3074011 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.151668:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0ddd08c/0x5953bbf6b3074018 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.151683:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000830458f3/0x5953bbf6b3074011 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.151690:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f6:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.151706:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290322.151715:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0ddd08c/0x5953bbf6b3074018 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.151717:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.151724:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.151732:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0ddd08c/0x5953bbf6b3074018 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.151739:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.151769:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0ddd08c/0x5953bbf6b3074018 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.151780:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0ddd08c/0x5953bbf6b3074018 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.151803:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.151854:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1784290322.151857:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.151871:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0ddd08c/0x5953bbf6b3074018 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.151872:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c218a886/0x5953bbf6b307401f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.151908:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f5:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.151918:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290322.151920:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b9800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290322.151925:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c218a886/0x5953bbf6b307401f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.151935:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0ddd08c/0x5953bbf6b3074018 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.151942:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c218a886/0x5953bbf6b307401f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152001:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c218a886/0x5953bbf6b307401f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152017:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c218a886/0x5953bbf6b307401f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.152019:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0ddd08c/0x5953bbf6b3074018 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.152071:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0ddd08c/0x5953bbf6b3074018 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152077:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.152101:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0ddd08c/0x5953bbf6b3074018 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.152112:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.152128:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c218a886/0x5953bbf6b307401f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.152143:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b9000 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:3.0:1784290322.152144:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.152151:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.152152:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c218a886/0x5953bbf6b307401f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152156:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010366057/0x5953bbf6b3074026 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.152162:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.152185:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.152198:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f4:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.152205:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290322.152206:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c218a886/0x5953bbf6b307401f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152218:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010366057/0x5953bbf6b3074026 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152252:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010366057/0x5953bbf6b3074026 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.152260:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c218a886/0x5953bbf6b307401f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152264:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010366057/0x5953bbf6b3074026 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.152299:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c218a886/0x5953bbf6b307401f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152302:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010366057/0x5953bbf6b3074026 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152386:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.152399:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.152407:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010366057/0x5953bbf6b3074026 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.152419:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b9600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290322.152425:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010366057/0x5953bbf6b3074026 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.152434:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784290322.152438:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290322.152438:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010366057/0x5953bbf6b3074026 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152449:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e3e7169/0x5953bbf6b307402d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152489:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f3:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:1.0:1784290322.152497:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010366057/0x5953bbf6b3074026 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152516:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290322.152522:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010366057/0x5953bbf6b3074026 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152527:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e3e7169/0x5953bbf6b307402d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152563:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e3e7169/0x5953bbf6b307402d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.152565:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.152571:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.152576:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.152582:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e3e7169/0x5953bbf6b307402d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152594:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e3e7169/0x5953bbf6b307402d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152616:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.152641:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.152656:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e3e7169/0x5953bbf6b307402d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290322.152670:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.152676:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b9400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290322.152681:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058f7ad42/0x5953bbf6b3074034 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.152691:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e3e7169/0x5953bbf6b307402d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152695:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f2:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.152708:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290322.152722:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058f7ad42/0x5953bbf6b3074034 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.152734:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e3e7169/0x5953bbf6b307402d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152740:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058f7ad42/0x5953bbf6b3074034 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152776:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058f7ad42/0x5953bbf6b3074034 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.152792:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e3e7169/0x5953bbf6b307402d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152799:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058f7ad42/0x5953bbf6b3074034 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.152835:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e3e7169/0x5953bbf6b307402d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152850:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.152879:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.152891:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058f7ad42/0x5953bbf6b3074034 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.152894:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784290322.152908:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.152916:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b8000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290322.152920:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b307403b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.152926:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058f7ad42/0x5953bbf6b3074034 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.152946:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f1:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.152952:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290322.152958:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b307403b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.153010:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b307403b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.153020:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058f7ad42/0x5953bbf6b3074034 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.153026:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b307403b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.153051:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b307403b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.153057:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058f7ad42/0x5953bbf6b3074034 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.153075:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058f7ad42/0x5953bbf6b3074034 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.153082:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.153097:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.153104:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b307403b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.153115:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b8400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.153120:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b307403b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.153127:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.153134:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b307403b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290322.153137:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290322.153157:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac5b8d3/0x5953bbf6b3074042 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.153164:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b307403b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.153202:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b307403b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.153208:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f0:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.153220:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290322.153227:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac5b8d3/0x5953bbf6b3074042 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.153272:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ac5b8d3/0x5953bbf6b3074042 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.153281:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.153288:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac5b8d3/0x5953bbf6b3074042 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.153288:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.153292:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.153306:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ac5b8d3/0x5953bbf6b3074042 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.153329:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.153397:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.153408:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ac5b8d3/0x5953bbf6b3074042 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.153420:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b9a00 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:3.0:1784290322.153427:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.153428:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac5b8d3/0x5953bbf6b3074042 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.153446:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b3074049 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.153453:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac5b8d3/0x5953bbf6b3074042 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.153464:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ef:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.153475:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290322.153482:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b3074049 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.153484:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ac5b8d3/0x5953bbf6b3074042 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.153512:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b3074049 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.153513:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ac5b8d3/0x5953bbf6b3074042 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.153555:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.153560:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.153563:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.153565:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b3074049 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.153578:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b3074049 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.153602:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.153631:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.153642:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b3074049 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.153656:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b8800 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:3.0:1784290322.153660:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290322.153662:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b3074049 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.153674:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d08aa7d4/0x5953bbf6b3074050 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.153684:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b3074049 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.153693:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ee:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.153709:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290322.153716:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08aa7d4/0x5953bbf6b3074050 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.153720:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b3074049 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.153741:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d08aa7d4/0x5953bbf6b3074050 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.153744:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b3074049 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.153756:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d08aa7d4/0x5953bbf6b3074050 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.153799:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d08aa7d4/0x5953bbf6b3074050 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.153813:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.153818:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.153824:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.153850:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.153861:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.153870:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d08aa7d4/0x5953bbf6b3074050 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.153883:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b9200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290322.153888:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d08aa7d4/0x5953bbf6b3074050 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.153899:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d08aa7d4/0x5953bbf6b3074050 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290322.153908:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290322.153917:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d08aa7d4/0x5953bbf6b3074050 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.153919:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb4c2cc6/0x5953bbf6b3074057 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.153959:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d08aa7d4/0x5953bbf6b3074050 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.153961:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ed:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.153976:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290322.154006:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb4c2cc6/0x5953bbf6b3074057 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.154020:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.154024:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb4c2cc6/0x5953bbf6b3074057 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.154027:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.154034:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.154047:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb4c2cc6/0x5953bbf6b3074057 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.154057:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb4c2cc6/0x5953bbf6b3074057 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.154078:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.154105:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.154115:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb4c2cc6/0x5953bbf6b3074057 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290322.154141:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290322.154145:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b9c00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290322.154152:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfd88036/0x5953bbf6b307405e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.154159:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb4c2cc6/0x5953bbf6b3074057 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.154166:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ec:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.154183:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290322.154184:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb4c2cc6/0x5953bbf6b3074057 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.154191:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfd88036/0x5953bbf6b307405e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.154230:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfd88036/0x5953bbf6b307405e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.154237:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb4c2cc6/0x5953bbf6b3074057 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.154243:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfd88036/0x5953bbf6b307405e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.154288:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb4c2cc6/0x5953bbf6b3074057 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.154289:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfd88036/0x5953bbf6b307405e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.154382:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.154390:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.154399:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfd88036/0x5953bbf6b307405e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.154412:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5cc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.154414:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.154420:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfd88036/0x5953bbf6b307405e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.154435:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfd88036/0x5953bbf6b307405e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290322.154443:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290322.154451:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfd88036/0x5953bbf6b307405e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.154454:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2581b1c/0x5953bbf6b3074065 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.154471:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6eb:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.154487:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290322.154490:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfd88036/0x5953bbf6b307405e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.154494:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2581b1c/0x5953bbf6b3074065 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.154524:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2581b1c/0x5953bbf6b3074065 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.154528:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.154535:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.154539:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2581b1c/0x5953bbf6b3074065 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.154542:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.154564:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2581b1c/0x5953bbf6b3074065 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.154589:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.154617:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.154628:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2581b1c/0x5953bbf6b3074065 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290322.154645:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290322.154666:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043eec9cd/0x5953bbf6b307406c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.154666:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5c200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.154684:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2581b1c/0x5953bbf6b3074065 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.154687:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ea:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.154699:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290322.154714:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043eec9cd/0x5953bbf6b307406c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.154730:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2581b1c/0x5953bbf6b3074065 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.154734:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043eec9cd/0x5953bbf6b307406c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.154781:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043eec9cd/0x5953bbf6b307406c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.154792:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2581b1c/0x5953bbf6b3074065 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.154793:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043eec9cd/0x5953bbf6b307406c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.154837:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2581b1c/0x5953bbf6b3074065 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.154850:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.154865:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.154874:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043eec9cd/0x5953bbf6b307406c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.154884:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5d800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.154889:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043eec9cd/0x5953bbf6b307406c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290322.154899:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.154901:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043eec9cd/0x5953bbf6b307406c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.154915:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa18268a/0x5953bbf6b3074073 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.154926:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043eec9cd/0x5953bbf6b307406c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.154932:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.154940:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e9:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.154957:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290322.154973:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043eec9cd/0x5953bbf6b307406c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.154974:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa18268a/0x5953bbf6b3074073 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.155040:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa18268a/0x5953bbf6b3074073 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.155049:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.155056:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa18268a/0x5953bbf6b3074073 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.155057:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.155064:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.155077:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa18268a/0x5953bbf6b3074073 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.155101:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.155137:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.155149:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa18268a/0x5953bbf6b3074073 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290322.155155:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290322.155172:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b76a8d4/0x5953bbf6b307407a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.155188:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5d000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290322.155190:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e8:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.155199:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290322.155204:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa18268a/0x5953bbf6b3074073 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.155206:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b76a8d4/0x5953bbf6b307407a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.155242:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b76a8d4/0x5953bbf6b307407a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.155253:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa18268a/0x5953bbf6b3074073 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.155304:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b76a8d4/0x5953bbf6b307407a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.155312:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa18268a/0x5953bbf6b3074073 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.155317:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b76a8d4/0x5953bbf6b307407a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.155387:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.155387:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa18268a/0x5953bbf6b3074073 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.155412:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.155422:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b76a8d4/0x5953bbf6b307407a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.155425:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.155433:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.155440:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5d600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.155447:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b76a8d4/0x5953bbf6b307407a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.155453:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784290322.155456:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.155470:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b76a8d4/0x5953bbf6b307407a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.155473:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e9a1ab/0x5953bbf6b3074081 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.155514:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e7:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.155518:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290322.155520:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b76a8d4/0x5953bbf6b307407a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.155525:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049e9a1ab/0x5953bbf6b3074081 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.155549:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b76a8d4/0x5953bbf6b307407a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.155557:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049e9a1ab/0x5953bbf6b3074081 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.155576:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e9a1ab/0x5953bbf6b3074081 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.155583:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.155587:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049e9a1ab/0x5953bbf6b3074081 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.155590:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.155596:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.155637:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.155671:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.155681:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049e9a1ab/0x5953bbf6b3074081 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.155709:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5d400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290322.155715:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e9a1ab/0x5953bbf6b3074081 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290322.155720:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290322.155735:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019058a20/0x5953bbf6b3074088 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.155737:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e9a1ab/0x5953bbf6b3074081 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.155786:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e6:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:1.0:1784290322.155792:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049e9a1ab/0x5953bbf6b3074081 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.155797:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290322.155822:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049e9a1ab/0x5953bbf6b3074081 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.155824:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019058a20/0x5953bbf6b3074088 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.155868:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019058a20/0x5953bbf6b3074088 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.155869:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.155875:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.155881:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.155895:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019058a20/0x5953bbf6b3074088 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.155911:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019058a20/0x5953bbf6b3074088 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.155945:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.155953:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.155962:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019058a20/0x5953bbf6b3074088 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.155973:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5c000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290322.155977:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019058a20/0x5953bbf6b3074088 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.156039:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019058a20/0x5953bbf6b3074088 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290322.156046:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290322.156059:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1538750/0x5953bbf6b307408f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.156061:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019058a20/0x5953bbf6b3074088 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.156095:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e5:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:1.0:1784290322.156098:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019058a20/0x5953bbf6b3074088 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.156117:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290322.156125:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.156126:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1538750/0x5953bbf6b307408f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.156133:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.156139:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.156153:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1538750/0x5953bbf6b307408f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.156165:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1538750/0x5953bbf6b307408f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.156175:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1538750/0x5953bbf6b307408f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.156198:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.156231:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.156242:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1538750/0x5953bbf6b307408f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290322.156254:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.156255:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5c400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.156266:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1538750/0x5953bbf6b307408f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.156270:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caa993dc/0x5953bbf6b3074096 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.156303:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1538750/0x5953bbf6b307408f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.156304:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e4:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.156318:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290322.156333:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000caa993dc/0x5953bbf6b3074096 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.156373:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1538750/0x5953bbf6b307408f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.156409:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1538750/0x5953bbf6b307408f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.156410:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000caa993dc/0x5953bbf6b3074096 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.156452:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caa993dc/0x5953bbf6b3074096 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.156461:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.156467:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.156473:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.156484:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000caa993dc/0x5953bbf6b3074096 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.156508:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.156537:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.156548:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000caa993dc/0x5953bbf6b3074096 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.156560:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5da00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290322.156566:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000caa993dc/0x5953bbf6b3074096 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290322.156569:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290322.156587:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008144730a/0x5953bbf6b307409d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.156592:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000caa993dc/0x5953bbf6b3074096 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.156612:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e3:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:3.0:1784290322.156619:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290322.156629:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000caa993dc/0x5953bbf6b3074096 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.156630:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008144730a/0x5953bbf6b307409d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.156674:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008144730a/0x5953bbf6b307409d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.156729:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008144730a/0x5953bbf6b307409d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.156729:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000caa993dc/0x5953bbf6b3074096 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.156775:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008144730a/0x5953bbf6b307409d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.156790:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.156797:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008144730a/0x5953bbf6b307409d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.156799:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784290322.156816:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5c800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290322.156822:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008144730a/0x5953bbf6b307409d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.156833:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.156836:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008144730a/0x5953bbf6b307409d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.156855:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008144730a/0x5953bbf6b307409d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290322.156856:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290322.156875:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006320ca05/0x5953bbf6b30740a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.156879:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008144730a/0x5953bbf6b307409d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.156905:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.156907:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e2:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:1.0:1784290322.156911:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.156915:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290322.156919:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290322.156924:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006320ca05/0x5953bbf6b30740a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.156941:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006320ca05/0x5953bbf6b30740a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.156952:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006320ca05/0x5953bbf6b30740a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.156961:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006320ca05/0x5953bbf6b30740a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290322.156999:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.157019:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.157028:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006320ca05/0x5953bbf6b30740a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.157051:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5d200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290322.157055:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006320ca05/0x5953bbf6b30740a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.157069:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006320ca05/0x5953bbf6b30740a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.157089:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006320ca05/0x5953bbf6b30740a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.157100:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006320ca05/0x5953bbf6b30740a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.157130:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.157135:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.157138:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784290322.157411:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x701:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290322.157425:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b30740ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.157445:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x701:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:2.0:1784290322.157453:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x701:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.157463:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b30740ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.157486:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b30740ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.157502:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b30740ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.157516:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b30740ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.157543:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.157562:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.157572:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b30740ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.157586:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482044c00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290322.157594:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b30740ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.157609:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b30740ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.157644:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b30740ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.157658:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b30740ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x701:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.157692:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.157696:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.157701:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784290322.157704:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x700:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290322.157718:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b30740b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.157735:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x700:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:2.0:1784290322.157741:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x700:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.157750:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b30740b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.157793:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b30740b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.157809:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b30740b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.157823:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b30740b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.157856:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.157893:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.157904:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b30740b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.157918:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.157927:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b30740b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.157952:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.157960:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b30740b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.157965:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b30740b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1784290322.158023:0:8403:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1666 00010000:00010000:2.0:1784290322.158024:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ff:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:0.0:1784290322.158028:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b30740b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.158040:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ff:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.158056:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b30740b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.158059:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b30740b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x700:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290322.158106:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:88744:x1870961901064064:12345-0@lo:5:osp-pre-1-0.0 Request processed in 15568us (15832us total) trans 0 rc 0/0 00010000:00010000:2.0:1784290322.158106:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b30740b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.158115:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.158126:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.158133:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290322.158143:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4930 00010000:00010000:2.0:1784290322.158146:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b30740b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290322.158168:0:88744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4faa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88744:1870961901064064:0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1784290322.158185:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b30740b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784290322.158203:0:88744:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x701:0x0] from OST, last_created [0x2c0000401:0x701:0x0]last_used is [0x2c0000401:0x682:0x0] 00010000:00010000:2.0:1784290322.158215:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.158248:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.158258:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b30740b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.158271:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.158277:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b30740b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.158290:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b30740b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.158297:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290322.158308:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b30740c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.158311:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b30740b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290322.158334:0:88744:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88744:1870961901064448:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784290322.158388:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901064320:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784290322.158396:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fe:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:2.0:1784290322.158408:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.158416:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b30740c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.158441:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b30740c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.158480:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b30740b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290322.158481:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290322.158490:0:88744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784290322.158491:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b30740c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.158527:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b30740c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290322.158550:0:88744:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343b94240 going to sleep for 11 seconds 00010000:00010000:0.0:1784290322.158552:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290322.158563:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784290322.158564:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b30740c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.158584:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.158589:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b30740c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.158600:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b30740c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.158606:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290322.158621:0:8999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901064448 00010000:00010000:0.0:1784290322.158624:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b30740c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290322.158631:0:8999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901064448 00010000:00010000:0.0:1784290322.158644:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b30740c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.158668:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.158671:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.158681:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.158685:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f920d44d/0x5953bbf6b30740c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.158689:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290322.158700:0:8999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4932 00010000:00010000:2.0:1784290322.158721:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fd:0x0].0x0 since=2063s v=(0 0) 00000100:00100000:3.0:1784290322.158729:0:8999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:88744:x1870961901064448:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1784290322.158732:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.158743:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f920d44d/0x5953bbf6b30740c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.158773:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f920d44d/0x5953bbf6b30740c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.158784:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f920d44d/0x5953bbf6b30740c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.158794:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f920d44d/0x5953bbf6b30740c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1784290322.158812:0:8999:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1794 00010000:00010000:2.0:1784290322.158823:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.158831:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.158843:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f920d44d/0x5953bbf6b30740c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.158855:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aac00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290322.158862:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f920d44d/0x5953bbf6b30740c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.158875:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f920d44d/0x5953bbf6b30740c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.158909:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f920d44d/0x5953bbf6b30740c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.158912:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290322.158932:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8d8b7e0/0x5953bbf6b30740ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.158936:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f920d44d/0x5953bbf6b30740c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.158976:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fc:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:2.0:1784290322.159006:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.159017:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8d8b7e0/0x5953bbf6b30740ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.159019:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.159026:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.159033:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.159054:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8d8b7e0/0x5953bbf6b30740ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.159111:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8d8b7e0/0x5953bbf6b30740ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.159126:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8d8b7e0/0x5953bbf6b30740ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.159154:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.159172:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.159185:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8d8b7e0/0x5953bbf6b30740ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.159205:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290322.159216:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8d8b7e0/0x5953bbf6b30740ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.159235:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8d8b7e0/0x5953bbf6b30740ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.159246:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290322.159259:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053d0fe3d/0x5953bbf6b30740d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.159268:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8d8b7e0/0x5953bbf6b30740ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.159273:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fb:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:2.0:1784290322.159289:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290322.159298:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8d8b7e0/0x5953bbf6b30740ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.159301:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053d0fe3d/0x5953bbf6b30740d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.159376:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053d0fe3d/0x5953bbf6b30740d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.159391:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053d0fe3d/0x5953bbf6b30740d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.159416:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053d0fe3d/0x5953bbf6b30740d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.159428:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.159435:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.159444:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.159470:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.159497:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.159508:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053d0fe3d/0x5953bbf6b30740d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.159535:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.159541:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053d0fe3d/0x5953bbf6b30740d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.159552:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053d0fe3d/0x5953bbf6b30740d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.159572:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.159576:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053d0fe3d/0x5953bbf6b30740d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.159592:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060d8f358/0x5953bbf6b30740dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.159594:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053d0fe3d/0x5953bbf6b30740d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.159647:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fa:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:2.0:1784290322.159654:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6fa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.159663:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060d8f358/0x5953bbf6b30740dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.159665:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.159673:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.159683:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.159687:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060d8f358/0x5953bbf6b30740dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.159704:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060d8f358/0x5953bbf6b30740dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.159714:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060d8f358/0x5953bbf6b30740dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.159742:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.159778:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.159789:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060d8f358/0x5953bbf6b30740dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.159801:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aba00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290322.159808:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060d8f358/0x5953bbf6b30740dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.159822:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060d8f358/0x5953bbf6b30740dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.159834:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290322.159844:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060d8f358/0x5953bbf6b30740dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.159846:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe30eacf/0x5953bbf6b30740e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.159895:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f9:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:1.0:1784290322.159895:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060d8f358/0x5953bbf6b30740dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.159914:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.159923:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe30eacf/0x5953bbf6b30740e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.159932:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.159941:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.159942:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe30eacf/0x5953bbf6b30740e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.159947:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.159961:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe30eacf/0x5953bbf6b30740e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.159973:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe30eacf/0x5953bbf6b30740e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.160026:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.160078:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.160092:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe30eacf/0x5953bbf6b30740e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.160110:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.160120:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe30eacf/0x5953bbf6b30740e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.160121:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290322.160139:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000849e7e60/0x5953bbf6b30740ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.160158:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe30eacf/0x5953bbf6b30740e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.160160:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f8:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:2.0:1784290322.160166:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.160173:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000849e7e60/0x5953bbf6b30740ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.160220:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000849e7e60/0x5953bbf6b30740ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.160229:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe30eacf/0x5953bbf6b30740e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.160234:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000849e7e60/0x5953bbf6b30740ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.160247:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe30eacf/0x5953bbf6b30740e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.160288:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000849e7e60/0x5953bbf6b30740ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.160311:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290322.160320:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784290322.160321:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000849e7e60/0x5953bbf6b30740ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.160337:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.160380:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000849e7e60/0x5953bbf6b30740ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.160389:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.160394:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000849e7e60/0x5953bbf6b30740ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.160411:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000849e7e60/0x5953bbf6b30740ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.160422:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000849e7e60/0x5953bbf6b30740ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.160452:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.160452:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.160459:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.160467:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001913307f/0x5953bbf6b30740f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.160478:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.160485:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f7:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:2.0:1784290322.160493:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.160500:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001913307f/0x5953bbf6b30740f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.160517:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001913307f/0x5953bbf6b30740f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.160528:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001913307f/0x5953bbf6b30740f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.160539:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001913307f/0x5953bbf6b30740f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.160570:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.160608:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.160617:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001913307f/0x5953bbf6b30740f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.160642:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290322.160649:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001913307f/0x5953bbf6b30740f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.160668:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001913307f/0x5953bbf6b30740f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.160691:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001913307f/0x5953bbf6b30740f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.160693:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290322.160717:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001913307f/0x5953bbf6b30740f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.160721:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b8191fa/0x5953bbf6b30740f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.160751:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f6:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:1.0:1784290322.160754:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.160757:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290322.160761:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.160767:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b8191fa/0x5953bbf6b30740f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.160770:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.160790:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b8191fa/0x5953bbf6b30740f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.160803:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b8191fa/0x5953bbf6b30740f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.160814:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b8191fa/0x5953bbf6b30740f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.160845:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.160882:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.160894:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b8191fa/0x5953bbf6b30740f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.160906:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450abe00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.160912:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b8191fa/0x5953bbf6b30740f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.160925:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b8191fa/0x5953bbf6b30740f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.160935:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290322.160947:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000228f1e82/0x5953bbf6b30740ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.160949:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b8191fa/0x5953bbf6b30740f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.160978:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f5:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:0.0:1784290322.161004:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b8191fa/0x5953bbf6b30740f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.161011:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.161030:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000228f1e82/0x5953bbf6b30740ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.161051:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000228f1e82/0x5953bbf6b30740ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.161055:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.161062:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.161067:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.161089:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000228f1e82/0x5953bbf6b30740ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.161102:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000228f1e82/0x5953bbf6b30740ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.161130:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.161166:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.161179:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000228f1e82/0x5953bbf6b30740ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.161197:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab600 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:2.0:1784290322.161206:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290322.161208:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000228f1e82/0x5953bbf6b30740ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290322.161213:0:8999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:88744:x1870961901064448:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2492us (2731us total) trans 4294968627 rc 0/0 00010000:00010000:2.0:1784290322.161227:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6ee89c3/0x5953bbf6b3074106 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290322.161249:0:8999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4932 00000100:00100000:0.0:1784290322.161262:0:88744:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88744:1870961901064448:0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1784290322.161270:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f4:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:1.0:1784290322.161271:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000228f1e82/0x5953bbf6b30740ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.161280:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.161287:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6ee89c3/0x5953bbf6b3074106 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784290322.161289:0:88744:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x701:0x0]-[0x2c0000401:0x721:0x0] 00000100:00100000:3.0:1784290322.161305:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901064320 00000100:00100000:3.0:1784290322.161316:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901064320 00010000:00010000:1.0:1784290322.161382:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000228f1e82/0x5953bbf6b30740ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.161389:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6ee89c3/0x5953bbf6b3074106 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.161403:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000228f1e82/0x5953bbf6b30740ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290322.161420:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00010000:00010000:2.0:1784290322.161429:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6ee89c3/0x5953bbf6b3074106 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290322.161446:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901064320:12345-0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1784290322.161454:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.161462:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6ee89c3/0x5953bbf6b3074106 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.161464:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.161471:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000024:3.0:1784290322.161474:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00010000:00010000:2.0:1784290322.161535:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784290322.161553:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901064320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (3083us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290322.161569:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00010000:00010000:0.0:1784290322.161569:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.161585:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6ee89c3/0x5953bbf6b3074106 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.161616:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aaa00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.161623:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6ee89c3/0x5953bbf6b3074106 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290322.161626:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901064320:0@lo:13:osp-pre-1-0.0 00002000:00010000:2.0:1784290322.161630:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290322.161657:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab0f9698/0x5953bbf6b307410d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.161665:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6ee89c3/0x5953bbf6b3074106 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.161681:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f3:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:2.0:1784290322.161698:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.161710:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0f9698/0x5953bbf6b307410d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.161712:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6ee89c3/0x5953bbf6b3074106 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.161763:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6ee89c3/0x5953bbf6b3074106 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.161770:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab0f9698/0x5953bbf6b307410d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.161791:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.161795:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab0f9698/0x5953bbf6b307410d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.161798:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.161804:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.161823:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab0f9698/0x5953bbf6b307410d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.161859:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.161891:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.161900:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab0f9698/0x5953bbf6b307410d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.161911:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aae00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.161918:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0f9698/0x5953bbf6b307410d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.161924:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.161937:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab0f9698/0x5953bbf6b307410d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.161940:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e9f623d/0x5953bbf6b3074114 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.161961:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f2:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:0.0:1784290322.161978:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab0f9698/0x5953bbf6b307410d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.162007:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290322.162014:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab0f9698/0x5953bbf6b307410d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.162019:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e9f623d/0x5953bbf6b3074114 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.162050:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e9f623d/0x5953bbf6b3074114 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.162055:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.162062:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.162068:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.162070:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e9f623d/0x5953bbf6b3074114 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.162084:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e9f623d/0x5953bbf6b3074114 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.162107:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.162141:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.162153:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e9f623d/0x5953bbf6b3074114 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.162165:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290322.162170:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290322.162175:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a22083ed/0x5953bbf6b307411b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.162183:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e9f623d/0x5953bbf6b3074114 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.162191:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f1:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:2.0:1784290322.162205:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.162220:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a22083ed/0x5953bbf6b307411b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.162229:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e9f623d/0x5953bbf6b3074114 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.162236:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a22083ed/0x5953bbf6b307411b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.162276:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a22083ed/0x5953bbf6b307411b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.162286:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e9f623d/0x5953bbf6b3074114 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.162314:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a22083ed/0x5953bbf6b307411b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.162318:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e9f623d/0x5953bbf6b3074114 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.162382:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.162401:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.162405:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.162413:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.162413:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a22083ed/0x5953bbf6b307411b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.162422:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.162434:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.162441:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a22083ed/0x5953bbf6b307411b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.162450:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.162455:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a22083ed/0x5953bbf6b307411b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.162462:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7305fe5/0x5953bbf6b3074122 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.162481:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a22083ed/0x5953bbf6b307411b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.162482:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f0:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:2.0:1784290322.162498:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6f0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.162514:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7305fe5/0x5953bbf6b3074122 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.162517:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a22083ed/0x5953bbf6b307411b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.162553:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7305fe5/0x5953bbf6b3074122 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.162603:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7305fe5/0x5953bbf6b3074122 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.162612:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.162618:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.162625:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.162628:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7305fe5/0x5953bbf6b3074122 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.162668:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.162698:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.162707:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7305fe5/0x5953bbf6b3074122 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.162718:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290322.162724:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7305fe5/0x5953bbf6b3074122 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.162737:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7305fe5/0x5953bbf6b3074122 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.162741:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290322.162760:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c14e744/0x5953bbf6b3074129 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.162769:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7305fe5/0x5953bbf6b3074122 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.162812:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ef:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:1.0:1784290322.162812:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7305fe5/0x5953bbf6b3074122 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.162827:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ef:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.162846:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c14e744/0x5953bbf6b3074129 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.162855:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.162862:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.162863:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c14e744/0x5953bbf6b3074129 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.162866:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.162880:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c14e744/0x5953bbf6b3074129 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.162891:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c14e744/0x5953bbf6b3074129 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.162916:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.162952:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.162963:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c14e744/0x5953bbf6b3074129 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.162976:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450abc00 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:2.0:1784290322.162978:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.163006:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c14e744/0x5953bbf6b3074129 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.163011:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5b582ff/0x5953bbf6b3074130 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.163042:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c14e744/0x5953bbf6b3074129 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.163045:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ee:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:2.0:1784290322.163061:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ee:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.163078:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5b582ff/0x5953bbf6b3074130 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.163087:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c14e744/0x5953bbf6b3074129 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.163095:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5b582ff/0x5953bbf6b3074130 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.163114:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c14e744/0x5953bbf6b3074129 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.163140:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.163146:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.163154:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.163162:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5b582ff/0x5953bbf6b3074130 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.163183:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5b582ff/0x5953bbf6b3074130 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.163219:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.163244:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.163253:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5b582ff/0x5953bbf6b3074130 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.163283:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.163289:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5b582ff/0x5953bbf6b3074130 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.163301:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.163302:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5b582ff/0x5953bbf6b3074130 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.163318:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012850e5b/0x5953bbf6b3074137 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.163331:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5b582ff/0x5953bbf6b3074130 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.163335:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ed:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:2.0:1784290322.163381:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ed:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.163401:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012850e5b/0x5953bbf6b3074137 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.163404:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5b582ff/0x5953bbf6b3074130 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.163450:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012850e5b/0x5953bbf6b3074137 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.163463:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.163467:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012850e5b/0x5953bbf6b3074137 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.163469:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.163477:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.163489:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012850e5b/0x5953bbf6b3074137 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.163530:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.163563:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.163572:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012850e5b/0x5953bbf6b3074137 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.163602:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290322.163609:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012850e5b/0x5953bbf6b3074137 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.163617:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290322.163621:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012850e5b/0x5953bbf6b3074137 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.163639:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aa8e530/0x5953bbf6b307413e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.163649:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012850e5b/0x5953bbf6b3074137 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.163665:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ec:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:1.0:1784290322.163669:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012850e5b/0x5953bbf6b3074137 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.163677:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ec:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290322.163705:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.163710:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.163714:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.163735:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003aa8e530/0x5953bbf6b307413e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.163762:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003aa8e530/0x5953bbf6b307413e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.163779:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aa8e530/0x5953bbf6b307413e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.163792:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003aa8e530/0x5953bbf6b307413e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.163816:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.163852:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.163863:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003aa8e530/0x5953bbf6b307413e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.163876:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8200 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:2.0:1784290322.163880:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.163883:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003aa8e530/0x5953bbf6b307413e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.163896:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3074145 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.163902:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003aa8e530/0x5953bbf6b307413e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.163912:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6eb:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:2.0:1784290322.163933:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6eb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290322.163937:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003aa8e530/0x5953bbf6b307413e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.163941:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3074145 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.163966:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003aa8e530/0x5953bbf6b307413e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.163977:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3074145 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.164017:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.164023:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3074145 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.164025:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.164031:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.164043:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3074145 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.164067:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.164101:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.164111:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3074145 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.164123:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9c00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290322.164129:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3074145 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.164133:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290322.164152:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004130a9d4/0x5953bbf6b307414c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.164158:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3074145 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.164166:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ea:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:2.0:1784290322.164170:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6ea:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.164180:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004130a9d4/0x5953bbf6b307414c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.164217:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004130a9d4/0x5953bbf6b307414c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.164229:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3074145 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.164230:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004130a9d4/0x5953bbf6b307414c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.164266:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3074145 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.164271:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004130a9d4/0x5953bbf6b307414c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.164311:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290322.164314:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784290322.164321:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004130a9d4/0x5953bbf6b307414c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.164334:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.164369:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.164387:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004130a9d4/0x5953bbf6b307414c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.164403:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004130a9d4/0x5953bbf6b307414c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.164422:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004130a9d4/0x5953bbf6b307414c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.164423:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290322.164443:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074ee36b3/0x5953bbf6b3074153 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.164446:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004130a9d4/0x5953bbf6b307414c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.164477:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e9:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:2.0:1784290322.164485:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290322.164490:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.164492:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074ee36b3/0x5953bbf6b3074153 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.164496:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.164510:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074ee36b3/0x5953bbf6b3074153 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.164512:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.164528:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000074ee36b3/0x5953bbf6b3074153 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.164539:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000074ee36b3/0x5953bbf6b3074153 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.164568:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.164596:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.164605:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000074ee36b3/0x5953bbf6b3074153 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.164617:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8a00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.164623:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000074ee36b3/0x5953bbf6b3074153 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.164635:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000074ee36b3/0x5953bbf6b3074153 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.164647:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.164657:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000074ee36b3/0x5953bbf6b3074153 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.164663:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1dd37d7/0x5953bbf6b307415a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.164679:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074ee36b3/0x5953bbf6b3074153 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.164710:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e8:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:2.0:1784290322.164717:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.164724:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1dd37d7/0x5953bbf6b307415a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.164767:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1dd37d7/0x5953bbf6b307415a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.164782:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1dd37d7/0x5953bbf6b307415a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.164784:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.164790:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.164796:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.164804:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1dd37d7/0x5953bbf6b307415a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.164831:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.164888:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1784290322.164889:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290322.164907:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1dd37d7/0x5953bbf6b307415a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.164908:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe4b26db/0x5953bbf6b3074161 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.164956:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e7:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:1.0:1784290322.164958:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290322.164967:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290322.164971:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1dd37d7/0x5953bbf6b307415a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.164976:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe4b26db/0x5953bbf6b3074161 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.165010:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1dd37d7/0x5953bbf6b307415a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.165028:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1dd37d7/0x5953bbf6b307415a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.165038:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1dd37d7/0x5953bbf6b307415a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.165060:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.165062:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.165064:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.165156:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe4b26db/0x5953bbf6b3074161 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.165186:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe4b26db/0x5953bbf6b3074161 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.165195:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe4b26db/0x5953bbf6b3074161 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.165218:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.165253:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.165264:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe4b26db/0x5953bbf6b3074161 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.165276:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9a00 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:2.0:1784290322.165278:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290322.165282:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe4b26db/0x5953bbf6b3074161 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.165290:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3559906/0x5953bbf6b3074168 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.165305:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe4b26db/0x5953bbf6b3074161 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.165310:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e6:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:2.0:1784290322.165326:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.165335:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3559906/0x5953bbf6b3074168 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.165390:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3559906/0x5953bbf6b3074168 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.165394:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe4b26db/0x5953bbf6b3074161 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.165414:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3559906/0x5953bbf6b3074168 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.165419:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe4b26db/0x5953bbf6b3074161 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.165447:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3559906/0x5953bbf6b3074168 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.165462:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.165469:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.165475:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.165500:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.165514:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.165524:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3559906/0x5953bbf6b3074168 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.165554:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.165560:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3559906/0x5953bbf6b3074168 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.165572:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3559906/0x5953bbf6b3074168 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.165574:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290322.165602:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ebc3a6e/0x5953bbf6b307416f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.165607:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3559906/0x5953bbf6b3074168 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.165647:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3559906/0x5953bbf6b3074168 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.165648:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e5:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:2.0:1784290322.165666:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.165690:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ebc3a6e/0x5953bbf6b307416f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.165703:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.165711:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.165716:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ebc3a6e/0x5953bbf6b307416f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.165717:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.165735:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ebc3a6e/0x5953bbf6b307416f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.165746:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ebc3a6e/0x5953bbf6b307416f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.165772:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784290322.165824:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290322.165831:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1ce9359/0x5953bbf6b3074176 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.165842:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e4:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:2.0:1784290322.165857:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290322.165861:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290322.165865:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ce9359/0x5953bbf6b3074176 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.165874:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ebc3a6e/0x5953bbf6b307416f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.165883:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1ce9359/0x5953bbf6b3074176 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.165907:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290322.165912:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1ce9359/0x5953bbf6b3074176 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.165917:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ebc3a6e/0x5953bbf6b307416f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.165945:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ce9359/0x5953bbf6b3074176 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.165973:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.165976:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ebc3a6e/0x5953bbf6b307416f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.166017:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.166028:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1ce9359/0x5953bbf6b3074176 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.166034:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ebc3a6e/0x5953bbf6b307416f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.166045:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8c00 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:2.0:1784290322.166058:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290322.166060:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ebc3a6e/0x5953bbf6b307416f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.166061:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1ce9359/0x5953bbf6b3074176 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.166075:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000949211db/0x5953bbf6b307417d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.166118:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1ce9359/0x5953bbf6b3074176 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.166119:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e3:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:2.0:1784290322.166125:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.166132:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000949211db/0x5953bbf6b307417d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.166134:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.166141:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.166148:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.166175:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000949211db/0x5953bbf6b307417d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.166180:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1ce9359/0x5953bbf6b3074176 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.166193:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000949211db/0x5953bbf6b307417d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.166201:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1ce9359/0x5953bbf6b3074176 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.166231:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.166236:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000949211db/0x5953bbf6b307417d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.166237:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.166243:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.166282:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290322.166316:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290322.166326:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000949211db/0x5953bbf6b307417d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.166365:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290322.166373:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000949211db/0x5953bbf6b307417d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.166385:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000949211db/0x5953bbf6b307417d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.166404:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000949211db/0x5953bbf6b307417d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290322.166432:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290322.166434:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000949211db/0x5953bbf6b307417d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.166457:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863234df/0x5953bbf6b3074184 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290322.166474:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.166479:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e2:0x0].0x0 since=2063s v=(0 0) 00010000:00010000:1.0:1784290322.166481:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290322.166487:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290322.166496:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6e2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290322.166509:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000863234df/0x5953bbf6b3074184 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.166529:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000863234df/0x5953bbf6b3074184 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.166548:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863234df/0x5953bbf6b3074184 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.166564:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000863234df/0x5953bbf6b3074184 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290322.166597:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290322.166626:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290322.166635:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000863234df/0x5953bbf6b3074184 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.166648:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290322.166654:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000863234df/0x5953bbf6b3074184 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.166666:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000863234df/0x5953bbf6b3074184 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.166686:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000863234df/0x5953bbf6b3074184 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.166698:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000863234df/0x5953bbf6b3074184 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290322.166747:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.166752:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290322.166757:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1784290322.174767:0:26258:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1116 00000100:00100000:2.0:1784290322.174842:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:88742:x1870961901064192:12345-0@lo:5:osp-pre-0-0.0 Request processed in 32226us (32506us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290322.174862:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4931 00000100:00100000:1.0:1784290322.174941:0:88742:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88742:1870961901064192:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1784290322.174958:0:88742:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x701:0x0] from OST, last_created [0x280000401:0x701:0x0]last_used is [0x280000401:0x45c:0x0] 00000100:00100000:1.0:1784290322.175071:0:88742:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88742:1870961901064704:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784290322.175093:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784290322.175115:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dfd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901064576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784290322.175128:0:88742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290322.175182:0:88742:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343b940c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290322.175191:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290322.175211:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901064704 00000100:00100000:0.0:1784290322.175222:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901064704 00000100:00100000:3.0:1784290322.175275:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901064576 00000100:00100000:3.0:1784290322.175287:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901064576 00000100:00100000:0.0:1784290322.175294:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4933 00000100:00100000:0.0:1784290322.175315:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:88742:x1870961901064704:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1784290322.175392:0:8402:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1794 00000100:00100000:3.0:1784290322.175402:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:3.0:1784290322.175422:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a51b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901064576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784290322.175447:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 896 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290322.175527:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a51b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901064576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290322.175543:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:2.0:1784290322.175574:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dfd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901064576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784290322.178298:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:88742:x1870961901064704:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2986us (3175us total) trans 4294968627 rc 0/0 00000100:00100000:0.0:1784290322.178315:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4933 00000100:00100000:1.0:1784290322.178396:0:88742:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88742:1870961901064704:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1784290322.178417:0:88742:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x701:0x0]-[0x280000401:0x721:0x0] 00000001:00100000:3.0:1784290322.602824:0:75386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1784290323.112552:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290324.135550:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290324.647468:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784290324.647491:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901064832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784290324.647558:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290324.647596:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901064832 00000100:00100000:1.0:1784290324.647605:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901064832 00000100:00080000:3.0:1784290324.647650:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784290324.647678:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:1.0:1784290324.647691:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901064832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784290324.647721:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290324.647776:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901064832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290324.647783:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:3.0:1784290324.647812:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901064832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784290324.648443:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784290324.648452:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901064960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784290324.648482:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290324.648508:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901064960 00000100:00100000:3.0:1784290324.648512:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901064960 00000100:00080000:1.0:1784290324.648543:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784290324.648578:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:3.0:1784290324.648589:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901064960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784290324.648604:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290324.648644:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901064960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290324.648651:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:1.0:1784290324.648678:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901064960:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1784290324.696489:0:89305:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00000100:00100000:2.0:1784290324.998435:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290324.998473:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290324.998497:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896225408 00000100:00100000:2.0:1784290324.998503:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290324.998510:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896225408 00000100:00100000:2.0:1784290324.998532:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290324.998561:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290324.998571:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00100000:3.0:1784290324.998586:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+10:2400:x1870961896225408:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290324.998588:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896225664 00000100:00100000:0.0:1784290324.998597:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896225664 00000100:00100000:1.0:1784290324.998609:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896225920 00000100:00100000:2.0:1784290324.998613:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896225536 00000100:00100000:1.0:1784290324.998617:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896225920 00000100:00100000:2.0:1784290324.998620:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896225536 00000100:00100000:3.0:1784290324.998659:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344448c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+10:2400:x1870961896225408:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 76us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290324.998671:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00100000:1.0:1784290324.998672:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896225792 00000100:00100000:1.0:1784290324.998677:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896225792 00000100:00100000:0.0:1784290324.998683:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 660 00000100:00100000:2.0:1784290324.998693:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 661 00000100:00100000:0.0:1784290324.998702:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2400:x1870961896225664:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290324.998710:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:2400:x1870961896225536:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290324.998717:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1535 00000100:00100000:1.0:1784290324.998729:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2400:x1870961896225920:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290324.998767:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2400:x1870961896225664:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 73us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290324.998773:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:2400:x1870961896225536:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 68us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290324.998784:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2400:x1870961896225920:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 54us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290324.998792:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 660 00000100:00100000:1.0:1784290324.998799:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1535 00000100:00100000:2.0:1784290324.998803:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 661 00000100:00100000:1.0:1784290324.998831:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1536 00000100:00100000:1.0:1784290324.998839:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2400:x1870961896225792:12345-192.168.202.6@tcp:400:kworker.0 00000100:00080000:0.0:1784290324.998862:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290324.998864:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2400:x1870961896225792:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 25us (303us total) trans 0 rc 0/0 00000100:00080000:0.0:1784290324.998883:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784290324.998885:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1536 00000100:00080000:0.0:1784290324.998891:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784290324.998900:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1784290325.159499:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784290325.458288:0:89353:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1784290326.183543:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290326.809444:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290326.809554:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896226048 00000100:00100000:0.0:1784290326.809565:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896226048 00000100:00080000:1.0:1784290326.809651:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784290326.809663:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1106 00000100:00100000:0.0:1784290326.809696:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:68478:x1870961896226048:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:0.0:1784290326.809750:0:66004:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 28672 free 1444646912 avail 1298407424 00000100:00100000:0.0:1784290326.809811:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:68478:x1870961896226048:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 121us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290326.809817:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1106 00000100:00100000:3.0:1784290326.810821:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290326.810866:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896226176 00000100:00100000:0.0:1784290326.810871:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896226176 00000100:00100000:0.0:1784290326.810905:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1107 00000100:00100000:0.0:1784290326.810910:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:68478:x1870961896226176:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:0.0:1784290326.810926:0:65990:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00080000:1.0:1784290326.810967:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784290326.810993:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:68478:x1870961896226176:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 63us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290326.811006:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1107 00000100:00100000:2.0:1784290326.812444:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290326.812496:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896226304 00000100:00100000:3.0:1784290326.812503:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896226304 00000100:00100000:3.0:1784290326.812592:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1162 00000100:00100000:3.0:1784290326.812611:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:68478:x1870961896226304:12345-192.168.202.6@tcp:13:lfs.0 00000100:00080000:1.0:1784290326.812614:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1784290326.812643:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290326.812712:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:68478:x1870961896226304:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 109us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290326.812734:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1162 00000100:00100000:2.0:1784290326.813670:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290326.813733:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896226432 00000100:00100000:1.0:1784290326.813738:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896226432 00000100:00100000:1.0:1784290326.813773:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1163 00000100:00100000:1.0:1784290326.813781:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:68478:x1870961896226432:12345-192.168.202.6@tcp:13:lfs.0 00000100:00080000:0.0:1784290326.813793:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1784290326.813799:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290326.813835:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:68478:x1870961896226432:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 56us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290326.813855:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1163 00000100:00100000:2.0:1784290326.826426:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290326.826516:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896226688 00000100:00100000:0.0:1784290326.826525:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896226688 00000100:00100000:0.0:1784290326.826571:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1108 00000100:00100000:0.0:1784290326.826580:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:68494:x1870961896226688:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:0.0:1784290326.826599:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290326.826619:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b307418b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b22d4 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290326.826724:0:66008:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3073fa8 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 11 pid: 88756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290326.826740:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3074192 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290326.826761:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3074192 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290326.826771:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3074192 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290326.826847:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3074192 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290326.826854:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3074192 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290326.826858:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3074192 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290326.826863:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26c00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290326.826865:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3074192 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290326.826870:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3074192 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290326.826879:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2449a35200) 00010000:00010000:0.0:1784290326.826882:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290326.826884:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3074192 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290326.826890:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3074192 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290326.826936:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b307418b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22d4 expref: 12 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290326.826966:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2449a35000) 00010000:00010000:0.0:1784290326.826968:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784290326.826972:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b307418b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22d4 expref: 12 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290326.826979:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26a00, rc 0) 00000100:00100000:0.0:1784290326.827021:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:68494:x1870961896226688:12345-192.168.202.6@tcp:101:cat.0 Request processed in 443us (602us total) trans 107374182402 rc 301/301 00000100:00100000:0.0:1784290326.827027:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1108 00000100:00100000:2.0:1784290326.828149:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290326.828200:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896226816 00000100:00100000:1.0:1784290326.828205:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896226816 00000100:00100000:1.0:1784290326.828235:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1109 00000100:00100000:1.0:1784290326.828241:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:68494:x1870961896226816:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:1.0:1784290326.828253:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290326.828263:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b30741a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b22db expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290326.828295:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30741a7 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290326.828304:0:74876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3073fa8 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 12 pid: 88756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290326.828310:0:74876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30741a7 lrc: 4/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290326.828336:0:74876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3073fa8 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 12 pid: 88756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290326.828385:0:74876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3073fa8 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 12 pid: 88756 timeout: 2168 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290326.828396:0:74876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474b4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:74876:1870961901065088:192.168.202.6@tcp:104: 00000100:00100000:1.0:1784290326.828450:0:74876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c3a240 going to sleep for 11 seconds 00000100:00100000:1.0:1784290326.829256:0:74876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474b4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:74876:1870961901065088:192.168.202.6@tcp:104: 00010000:00010000:1.0:1784290326.829280:0:74876:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30741a7 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290326.829661:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290326.829750:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896226944 00000100:00100000:1.0:1784290326.829754:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896226944 00010000:00010000:1.0:1784290326.829769:0:19591:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3073fa8 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 13 pid: 88756 timeout: 2168 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290326.829795:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2580 00000100:00100000:1.0:1784290326.829801:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:2399:x1870961896226944:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784290326.829810:0:19591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:1.0:1784290326.829822:0:19591:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 8 00000004:00010000:1.0:1784290326.829824:0:19591:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 0 -> 1784290301 00000004:00010000:1.0:1784290326.829826:0:19591:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 0 -> 1784290298 00000004:00010000:1.0:1784290326.829828:0:19591:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 0 -> 1784290301 00010000:00010000:1.0:1784290326.829832:0:19591:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3073fa8 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 13 pid: 88756 timeout: 2168 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290326.829840:0:19591:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3073fa8 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 13 pid: 88756 timeout: 2168 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290326.829865:0:19591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3073fa8 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22a3 expref: 13 pid: 88756 timeout: 2168 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290326.829874:0:19591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2449a35200) 00010000:00010000:1.0:1784290326.829878:0:19591:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30741a7 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290326.829891:0:19591:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30741a7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290326.829896:0:19591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30741a7 lrc: 4/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290326.829912:0:19591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784290326.829954:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:2399:x1870961896226944:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 137us (282us total) trans 0 rc 0/0 00010000:00010000:2.0:1784290326.829955:0:74876:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30741a7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290326.829967:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2580 00010000:00010000:2.0:1784290326.829978:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30741a7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784290326.830005:0:74876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784290326.830018:0:74876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30741a7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290326.830038:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b30741a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22db expref: 12 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290326.830052:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30741a7 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22db expref: 11 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290326.830058:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2449a35200) 00010000:00010000:2.0:1784290326.830060:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784290326.830062:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236ce00, rc 0) 00000100:00100000:2.0:1784290326.830092:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:68494:x1870961896226816:12345-192.168.202.6@tcp:101:cat.0 Request processed in 1852us (1945us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290326.830097:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1109 00000100:00100000:2.0:1784290326.831377:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290326.831407:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896227072 00000100:00100000:0.0:1784290326.831413:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896227072 00000100:00100000:0.0:1784290326.831443:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1110 00000100:00100000:0.0:1784290326.831450:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:68494:x1870961896227072:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:0.0:1784290326.831458:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290326.831465:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b30741ae lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b22e2 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290326.831487:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b30741ae lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22e2 expref: 12 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290326.831495:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b30741ae lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22e2 expref: 12 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290326.831506:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2449a35200) 00010000:00010000:0.0:1784290326.831508:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784290326.831516:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27600, rc 0) 00000100:00100000:0.0:1784290326.831543:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:68494:x1870961896227072:12345-192.168.202.6@tcp:101:cat.0 Request processed in 94us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290326.831549:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1110 00000100:00100000:1.0:1784290326.833850:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290326.833887:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896227200 00000100:00100000:2.0:1784290326.833893:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896227200 00000100:00100000:2.0:1784290326.833924:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1111 00000100:00100000:2.0:1784290326.833930:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:2399:x1870961896227200:12345-192.168.202.6@tcp:101:cat.0 00010000:00010000:2.0:1784290326.833949:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290326.833959:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8200/0x5953bbf6b30741b5 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b22e9 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290326.833990:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8200/0x5953bbf6b30741b5 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22e9 expref: 13 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784290326.834002:0:65989:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 8 -> 8 00000004:00010000:2.0:1784290326.834004:0:65989:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 1784290301 -> 1784290301 00000004:00010000:2.0:1784290326.834006:0:65989:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 1784290298 -> 1784290298 00000004:00010000:2.0:1784290326.834008:0:65989:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 1784290301 -> 1784290301 00000004:00010000:2.0:1784290326.834009:0:65989:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 8 00002000:00010000:2.0:1784290326.834012:0:65989:0:(mdt_io.c:1550:mdt_lvb2reply()) size 8 00010000:00010000:2.0:1784290326.834016:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8200/0x5953bbf6b30741b5 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22e9 expref: 13 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290326.834022:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9c2449a35200) 00010000:00010000:2.0:1784290326.834024:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1784290326.834027:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef8200, rc 0) 00000100:00100000:2.0:1784290326.834056:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:2399:x1870961896227200:12345-192.168.202.6@tcp:101:cat.0 Request processed in 126us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290326.834061:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1111 00000100:00100000:3.0:1784290326.835565:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290326.835606:0:66003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896227328 00000100:00100000:2.0:1784290326.835611:0:66003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896227328 00002000:00100000:2.0:1784290326.835650:0:66003:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff9c246a4faa00 x1870961896227328/t0(0) o3->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:347/0 lens 488/0 e 0 to 0 dl 1784290337 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784290326.835662:0:66003:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9c246a4faa00 with x1870961896227328 00000100:00100000:2.0:1784290326.835689:0:66003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4 00000100:00100000:2.0:1784290326.835698:0:66003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:2400:x1870961896227328:12345-192.168.202.6@tcp:3:cat.0 00000100:00100000:2.0:1784290326.835846:0:66003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:2400:x1870961896227328:12345-192.168.202.6@tcp:3:cat.0 Request processed in 149us (282us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1784290326.835857:0:66003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4 00002000:00100000:2.0:1784290326.835865:0:66003:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff9c246a4faa00 x1870961896227328/t0(0) o3->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:347/0 lens 488/4536 e 0 to 0 dl 1784290337 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784290326.835875:0:66003:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9c246a4faa00 with x1870961896227328 00000100:00100000:3.0:1784290326.837252:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290326.837320:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896227584 00000100:00100000:1.0:1784290326.837326:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896227584 00000100:00100000:1.0:1784290326.837385:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 220 00000100:00100000:1.0:1784290326.837394:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:68494:x1870961896227584:12345-192.168.202.6@tcp:35:cat.0 00000100:00100000:1.0:1784290326.837517:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+14:68494:x1870961896227584:12345-192.168.202.6@tcp:35:cat.0 Request processed in 125us (267us total) trans 107374182403 rc 0/0 00000100:00100000:1.0:1784290326.837523:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 220 00010000:00010000:2.0:1784290327.207539:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290327.207562:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901065216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784290327.207690:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290327.207783:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2446e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1870961901065728:0@lo:400:kworker.0 00000100:00100000:2.0:1784290327.207851:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2446e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1870961901065600:0@lo:400:kworker.0 00000100:00100000:1.0:1784290327.207862:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290327.207906:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2446e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901066240:0@lo:400:kworker.0 00000100:00100000:2.0:1784290327.207985:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290327.208044:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290327.208051:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2446e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901066112:0@lo:400:kworker.0 00000100:00100000:1.0:1784290327.208101:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1870961901066752:0@lo:400:kworker.0 00000100:00100000:2.0:1784290327.208119:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290327.208188:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901066624:0@lo:400:kworker.0 00000100:00100000:1.0:1784290327.208202:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290327.208228:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290327.208235:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1784290327.208244:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2446e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901065344:0@lo:400:kworker.0 00000100:00100000:0.0:1784290327.208255:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901065216 00000100:00100000:2.0:1784290327.208259:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1784290327.208265:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901065216 00000100:00100000:2.0:1784290327.208268:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2446e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1870961901065472:0@lo:400:kworker.0 00000100:00100000:1.0:1784290327.208276:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290327.208331:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290327.208374:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2446e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1870961901065856:0@lo:400:kworker.0 00000100:00100000:2.0:1784290327.208382:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2446e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901065984:0@lo:400:kworker.0 00000100:00100000:0.0:1784290327.208452:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:2.0:1784290327.208479:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290327.208493:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901065216:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784290327.208516:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901066496:0@lo:400:kworker.0 00002000:00000024:0.0:1784290327.208524:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290327.208552:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290327.208563:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290327.208590:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1870961901066368:0@lo:400:kworker.0 00000100:00100000:2.0:1784290327.208628:0:26254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901066240 00000100:00100000:2.0:1784290327.208635:0:26254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901066240 00000100:00100000:1.0:1784290327.208644:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290327.208693:0:26254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901066112 00000100:00100000:2.0:1784290327.208698:0:26254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901066112 00000100:00100000:1.0:1784290327.208721:0:26255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901066624 00000100:00100000:1.0:1784290327.208728:0:26255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901066624 00000100:00100000:2.0:1784290327.208739:0:26254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1537 00000100:00100000:2.0:1784290327.208761:0:26254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468539880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901066240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290327.208781:0:26255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1538 00000100:00100000:1.0:1784290327.208794:0:26255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901066112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290327.208802:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901065216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 313us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290327.208817:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:2.0:1784290327.208824:0:26254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468539880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901066240:12345-0@lo:400:kworker.0 Request processed in 62us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290327.208834:0:26254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1537 00000100:00100000:1.0:1784290327.208868:0:26255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901066112:12345-0@lo:400:kworker.0 Request processed in 73us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290327.208869:0:26254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1539 00000100:00100000:1.0:1784290327.208884:0:26255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1538 00000100:00100000:2.0:1784290327.208886:0:26254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901066624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290327.208914:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901066880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784290327.208926:0:88729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901065344 00000100:00100000:1.0:1784290327.208932:0:88729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901065344 00000100:00100000:2.0:1784290327.208952:0:26254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901066624:12345-0@lo:400:kworker.0 Request processed in 57us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290327.208960:0:26254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1539 00000100:00100000:0.0:1784290327.208988:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290327.209003:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901065984 00000100:00100000:1.0:1784290327.209004:0:88729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784290327.209010:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901065984 00000100:00100000:1.0:1784290327.209021:0:88729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234444b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3617:x1870961901065344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290327.209046:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901066880 00000100:00100000:0.0:1784290327.209053:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901066880 00000100:00100000:2.0:1784290327.209060:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901066496 00000100:00100000:2.0:1784290327.209067:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901066496 00000100:00100000:1.0:1784290327.209079:0:88729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234444b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3617:x1870961901065344:12345-0@lo:400:kworker.0 Request processed in 62us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290327.209089:0:88729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784290327.209106:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:2.0:1784290327.209114:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3774 00000100:00100000:0.0:1784290327.209123:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901066880:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290327.209131:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1870961901065984:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1784290327.209141:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784290327.209218:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1870961901065984:12345-0@lo:400:kworker.0 Request processed in 91us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290327.209229:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3774 00000100:00100000:0.0:1784290327.209237:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c535180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901066880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290327.209252:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:1.0:1784290327.209265:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3775 00000100:00100000:1.0:1784290327.209285:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901066496:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784290327.209304:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784290327.209314:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784290327.209320:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901065728 00000100:00100000:2.0:1784290327.209328:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901065728 00000100:00100000:1.0:1784290327.209408:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901066496:12345-0@lo:400:kworker.0 Request processed in 131us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290327.209412:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901065600 00000100:00100000:2.0:1784290327.209419:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901065600 00000100:00100000:0.0:1784290327.209432:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901066880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784290327.209441:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3775 00000100:00100000:2.0:1784290327.209456:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901066752 00000100:00100000:2.0:1784290327.209462:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901066752 00000100:00080000:0.0:1784290327.209479:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784290327.209490:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784290327.209497:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901065472 00000100:00100000:1.0:1784290327.209504:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901067008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290327.209506:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901065472 00000100:00100000:0.0:1784290327.209537:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901065856 00000100:00100000:0.0:1784290327.209548:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901065856 00000100:00100000:1.0:1784290327.209570:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290327.209573:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901066368 00000100:00100000:2.0:1784290327.209581:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901066368 00000100:00100000:1.0:1784290327.209622:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784290327.209632:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1784290327.209645:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901067136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784290327.209646:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:0.0:1784290327.209660:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1870961901065728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290327.209680:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1870961901065600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290327.209721:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290327.209786:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468539180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1870961901065728:12345-0@lo:400:kworker.0 Request processed in 135us (1928us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290327.209790:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1870961901065600:12345-0@lo:400:kworker.0 Request processed in 116us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290327.209802:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:0.0:1784290327.209819:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1784290327.209827:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1870961901066752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290327.209836:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:0.0:1784290327.209862:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:2.0:1784290327.209889:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:0.0:1784290327.209890:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1870961901065472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290327.209916:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1870961901066752:12345-0@lo:400:kworker.0 Request processed in 93us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290327.209917:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1870961901065856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290327.209971:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:0.0:1784290327.210014:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1870961901065472:12345-0@lo:400:kworker.0 Request processed in 135us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290327.210023:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:2.0:1784290327.210035:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1870961901065856:12345-0@lo:400:kworker.0 Request processed in 126us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290327.210037:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:1.0:1784290327.210048:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1870961901066368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290327.210059:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:0.0:1784290327.210091:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901067008 00000100:00100000:0.0:1784290327.210099:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901067008 00000100:00100000:2.0:1784290327.210144:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901067136 00000100:00100000:1.0:1784290327.210152:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1870961901066368:12345-0@lo:400:kworker.0 Request processed in 112us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290327.210155:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901067136 00000100:00100000:0.0:1784290327.210168:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3776 00000100:00100000:1.0:1784290327.210177:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:0.0:1784290327.210190:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1870961901067008:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290327.210218:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3777 00000004:00000024:0.0:1784290327.210220:0:8413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 28672 pending 28672 free 1444646912 avail 1298407424 00000100:00100000:2.0:1784290327.210240:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901067136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784290327.210266:0:8412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:0.0:1784290327.210303:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1870961901067008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290327.210316:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3776 00000100:00100000:2.0:1784290327.210377:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901067136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290327.210388:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3777 00000100:00080000:0.0:1784290327.210407:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784290327.210418:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784290327.210484:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901067136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784290327.210509:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2446e55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901065344:0@lo:400:kworker.0 00000100:00100000:1.0:1784290327.210520:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2446e54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1870961901065472:0@lo:400:kworker.0 00000100:00100000:0.0:1784290327.210531:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901067008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290327.210552:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2446e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1870961901065856:0@lo:400:kworker.0 00000100:00100000:1.0:1784290327.210565:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2446e55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901065984:0@lo:400:kworker.0 00000100:00100000:2.0:1784290327.210596:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1870961901066368:0@lo:400:kworker.0 00000100:00100000:1.0:1784290327.210612:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901066496:0@lo:400:kworker.0 00000100:00100000:2.0:1784290327.210648:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1870961901066752:0@lo:400:kworker.0 00000100:00100000:2.0:1784290327.210680:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2446e54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1870961901065728:0@lo:400:kworker.0 00000100:00100000:2.0:1784290327.210719:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2446e54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901066240:0@lo:400:kworker.0 00000100:00100000:1.0:1784290327.210745:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2446e54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1870961901065600:0@lo:400:kworker.0 00000100:00100000:2.0:1784290327.210776:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901065216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784290327.210784:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2446e55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901066112:0@lo:400:kworker.0 00000100:00100000:1.0:1784290327.210818:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901066624:0@lo:400:kworker.0 00000001:00080000:3.0:1784290327.721292:0:88725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182403 is committed 00000001:00080000:2.0:1784290327.725459:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968627 is committed 00000001:00080000:1.0:1784290327.725493:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968627 is committed 00010000:00010000:3.0:1784290328.231531:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290329.256454:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784290329.415291:0:89547:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_131b skipping excluded test 131b 00000100:00100000:2.0:1784290329.767579:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901067264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290329.767674:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901067392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784290329.767690:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290329.767757:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290329.767788:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901067264 00000100:00100000:0.0:1784290329.767808:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901067264 00000100:00100000:1.0:1784290329.767838:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901067392 00000100:00100000:1.0:1784290329.767848:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901067392 00000100:00080000:2.0:1784290329.767905:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784290329.767960:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290329.767976:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:1.0:1784290329.767987:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901067392:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784290329.767991:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:2.0:1784290329.768003:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901067264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784290329.768018:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1784290329.768023:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784290329.768075:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901067264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290329.768083:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901067392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290329.768085:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:1.0:1784290329.768098:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000100:00100000:2.0:1784290329.768135:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901067264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784290329.768136:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901067392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290330.117564:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290330.117599:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290330.117625:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290330.117627:0:88732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896227712 00000100:00100000:3.0:1784290330.117637:0:88732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896227712 00000100:00100000:1.0:1784290330.117646:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290330.117653:0:26260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896228224 00000100:00100000:2.0:1784290330.117661:0:26260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896228224 00000100:00100000:0.0:1784290330.117675:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896227968 00000100:00100000:1.0:1784290330.117683:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290330.117683:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896227968 00000100:00100000:3.0:1784290330.117695:0:88732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 74 00000100:00100000:3.0:1784290330.117706:0:88732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234444b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+10:2397:x1870961896227712:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290330.117715:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896227840 00000100:00100000:2.0:1784290330.117719:0:26260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896228096 00000100:00100000:1.0:1784290330.117721:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896227840 00000100:00100000:2.0:1784290330.117724:0:26260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896228096 00000100:00100000:0.0:1784290330.117745:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 668 00000100:00100000:0.0:1784290330.117758:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2397:x1870961896227968:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290330.117767:0:26260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1540 00000100:00100000:1.0:1784290330.117772:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 669 00000100:00100000:3.0:1784290330.117774:0:88732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234444b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+10:2397:x1870961896227712:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 69us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290330.117782:0:26260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2397:x1870961896228224:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290330.117786:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:2397:x1870961896227840:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290330.117788:0:88732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 74 00000100:00100000:0.0:1784290330.117808:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2397:x1870961896227968:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 51us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290330.117815:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 668 00000100:00100000:2.0:1784290330.117832:0:26260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2397:x1870961896228224:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 55us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290330.117838:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:2397:x1870961896227840:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 55us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290330.117840:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1541 00000100:00100000:2.0:1784290330.117852:0:26260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1540 00000100:00100000:1.0:1784290330.117855:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 669 00000100:00100000:3.0:1784290330.117857:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2397:x1870961896228096:12345-192.168.202.6@tcp:400:kworker.0 00000100:00080000:2.0:1784290330.117884:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784290330.117890:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:2397:x1870961896228096:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 38us (206us total) trans 0 rc 0/0 00000100:00080000:2.0:1784290330.117890:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784290330.117895:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1541 00000100:00080000:2.0:1784290330.117905:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784290330.117926:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1784290330.166934:0:89596:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 132a: PFL new component instantiate replay ========================================================== 08:12:09 (1784290329) 00000100:00100000:3.0:1784290330.263738:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290330.263797:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896228352 00000100:00100000:1.0:1784290330.263806:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896228352 00000100:00100000:1.0:1784290330.263857:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1112 00000100:00100000:1.0:1784290330.263875:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:69218:x1870961896228352:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1784290330.263894:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290330.263926:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c600/0x5953bbf6b30741bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b22f0 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.263992:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b30741c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264003:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b30741c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264013:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b30741c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264023:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30741ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264028:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30741ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264033:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30741ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264071:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b30741c3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264079:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b30741c3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264086:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b30741c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264105:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b30741c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264112:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290330.264117:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b30741c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264122:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b30741c3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264133:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2449a35000) 00010000:00010000:1.0:1784290330.264135:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290330.264138:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b30741c3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264143:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b30741c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264151:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30741ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264155:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30741ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264159:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30741ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264162:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290330.264164:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30741ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264175:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30741ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264180:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c2469585300) 00010000:00010000:1.0:1784290330.264182:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290330.264183:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30741ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264187:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30741ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264211:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c600/0x5953bbf6b30741bc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22f0 expref: 11 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264218:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2449a35000) 00010000:00010000:1.0:1784290330.264220:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290330.264223:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c600/0x5953bbf6b30741bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22f0 expref: 11 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.264229:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236c600, rc 0) 00000100:00100000:1.0:1784290330.264278:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:69218:x1870961896228352:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 405us (548us total) trans 0 rc 301/301 00000100:00100000:1.0:1784290330.264284:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1112 00000100:00100000:3.0:1784290330.266162:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290330.266220:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896228608 00000100:00100000:0.0:1784290330.266228:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896228608 00000100:00100000:0.0:1784290330.266266:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1113 00000100:00100000:0.0:1784290330.266276:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:69218:x1870961896228608:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1784290330.266286:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290330.266289:0:65988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784290330.266305:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3073fb6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22b1 expref: 10 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.266322:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2449a35000) 00010000:00010000:0.0:1784290330.266331:0:65988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290330.266367:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b30741d1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b22f7 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.266431:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30741d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.266442:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30741d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.266460:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30741d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.266475:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30741df lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.266484:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30741df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.266492:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30741df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.266893:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30741e6 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.266904:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30741e6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.266929:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30741e6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290330.266940:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 0 00010000:00010000:0.0:1784290330.266966:0:65988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30741d8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.266974:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30741d8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.266981:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30741d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.266988:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30741d8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.267002:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27e00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290330.267006:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30741d8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.267013:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30741d8 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.267024:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c244acdca00) 00010000:00010000:0.0:1784290330.267028:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290330.267031:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30741d8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.267038:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30741d8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290330.267050:0:65988:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000011835dc1 reply state 00000000420eb1af transno 107374182404 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30741df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.267063:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30741df lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.267070:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c244acdc900) 00010000:00010000:0.0:1784290330.267073:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290330.267076:0:65988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784290330.267101:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b30741d1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22f7 expref: 12 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.267121:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30741e6 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22f7 expref: 11 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.267143:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c244acdce00) 00010000:00010000:0.0:1784290330.267146:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784290330.267149:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26000, rc 0) 00000100:00100000:0.0:1784290330.267189:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:69218:x1870961896228608:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 914us (1027us total) trans 107374182404 rc 0/0 00000100:00100000:0.0:1784290330.267198:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1113 00000100:00100000:2.0:1784290330.268712:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290330.268749:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896228864 00000100:00100000:1.0:1784290330.268754:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896228864 00000100:00100000:1.0:1784290330.268787:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1114 00000100:00100000:1.0:1784290330.268794:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:69218:x1870961896228864:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1784290330.268814:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290330.268823:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b30741f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b22fe expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.268879:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b30741fb lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.268888:0:74876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30741e6 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22f7 expref: 13 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.268894:0:74876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b30741fb lrc: 4/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.268933:0:74876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30741e6 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22f7 expref: 13 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.268943:0:74876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30741e6 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22f7 expref: 13 pid: 65988 timeout: 2171 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290330.268953:0:74876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345cfdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:74876:1870961901067520:192.168.202.6@tcp:104: 00000100:00100000:1.0:1784290330.269005:0:74876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23422e1600 going to sleep for 11 seconds 00000100:00100000:3.0:1784290330.270192:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290330.270206:0:74876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345cfdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:74876:1870961901067520:192.168.202.6@tcp:104: 00010000:00010000:1.0:1784290330.270225:0:74876:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b30741fb lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290330.270248:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896228992 00000100:00100000:0.0:1784290330.270255:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896228992 00010000:00010000:0.0:1784290330.270278:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30741e6 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22f7 expref: 14 pid: 65988 timeout: 2171 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290330.270314:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2581 00000100:00100000:0.0:1784290330.270325:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+14:2400:x1870961896228992:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784290330.270336:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290330.270366:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30741e6 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22f7 expref: 14 pid: 65988 timeout: 2171 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.270379:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30741e6 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22f7 expref: 14 pid: 65988 timeout: 2171 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.270394:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30741e6 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22f7 expref: 14 pid: 65988 timeout: 2171 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.270406:0:9491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c244acdce00) 00010000:00010000:0.0:1784290330.270411:0:9491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b30741fb lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.270427:0:9491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b30741fb lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.270434:0:9491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b30741fb lrc: 4/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.270455:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290330.270474:0:74876:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b30741fb lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.270481:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b30741fb lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290330.270487:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:2400:x1870961896228992:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 163us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290330.270502:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2581 00000004:00200000:1.0:1784290330.270505:0:74876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 0 00000004:00080000:1.0:1784290330.270605:0:74876:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x45d:0x0], count =677 00000004:00080000:1.0:1784290330.270611:0:74876:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x45d:0x0]+677 in llog 00000004:00080000:1.0:1784290330.270626:0:74876:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x702:0x0], index 0: 0 00010000:00010000:1.0:1784290330.270677:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b30741fb lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.270682:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b30741fb lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.270687:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b30741fb lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.270690:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236cc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290330.270693:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b30741fb lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.270697:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b30741fb lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.270704:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c244acdce00) 00010000:00010000:1.0:1784290330.270706:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784290330.270708:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b30741fb lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.270713:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b30741fb lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.270739:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b30741f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22fe expref: 13 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.270755:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2469585900) 00010000:00010000:1.0:1784290330.270757:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784290330.270759:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b30741f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22fe expref: 13 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.270767:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236d800, rc 0) 00000100:00100000:1.0:1784290330.270797:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:69218:x1870961896228864:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 2005us (2087us total) trans 107374182405 rc 301/301 00000100:00100000:1.0:1784290330.270803:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1114 00000100:00100000:3.0:1784290330.271803:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290330.271866:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896229248 00000100:00100000:2.0:1784290330.271871:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896229248 00000100:00100000:2.0:1784290330.271902:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 221 00000100:00100000:2.0:1784290330.271920:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:69218:x1870961896229248:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1784290330.272050:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:69218:x1870961896229248:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 142us (248us total) trans 107374182406 rc 0/0 00000100:00100000:2.0:1784290330.272056:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 221 00000100:00100000:3.0:1784290330.272831:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290330.272895:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896229504 00000100:00100000:1.0:1784290330.272901:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896229504 00000100:00100000:1.0:1784290330.272944:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 222 00000100:00100000:1.0:1784290330.272951:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:69218:x1870961896229504:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:1.0:1784290330.273035:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+14:69218:x1870961896229504:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 84us (205us total) trans 107374182407 rc 0/0 00000100:00100000:1.0:1784290330.273042:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 222 00010000:00010000:1.0:1784290330.279480:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784290330.577943:0:88725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182407 is committed 00010000:00010000:3.0:1784290330.577973:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30741df lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290330.577986:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30741df lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290330.578000:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30741df lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290330.578006:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290330.578010:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30741df lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290330.578016:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30741df lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290330.578033:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c244acdc900) 00010000:00010000:3.0:1784290330.578036:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290330.578040:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30741df lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290330.578046:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30741df lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290330.597275:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290330.597316:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896229632 00000100:00100000:0.0:1784290330.597325:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896229632 00000100:00100000:0.0:1784290330.597460:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1115 00000100:00100000:0.0:1784290330.597472:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:69234:x1870961896229632:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1784290330.597493:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290330.597511:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3074209 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2305 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.597567:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b3074210 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.597578:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b3074210 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.597587:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b3074210 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290330.597621:0:66008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784290330.597624:0:66008:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784290330.597649:0:66008:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b3074210 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.597676:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3074209 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2305 expref: 11 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.597694:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b3074210 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2305 expref: 10 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.597703:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2446227900) 00010000:00010000:0.0:1784290330.597706:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784290330.597709:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27a00, rc 0) 00000100:00100000:0.0:1784290330.597765:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:69234:x1870961896229632:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 296us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290330.597771:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1115 00000100:00100000:2.0:1784290330.600071:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290330.600123:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896229760 00000100:00100000:0.0:1784290330.600129:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896229760 00000100:00100000:0.0:1784290330.600175:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1116 00000100:00100000:0.0:1784290330.600187:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:69234:x1870961896229760:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:0.0:1784290330.600211:0:65989:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444646912 avail 1298407424 00000100:00100000:0.0:1784290330.600258:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:69234:x1870961896229760:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 74us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290330.600268:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1116 00000100:00100000:3.0:1784290330.601121:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290330.601188:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896229888 00000100:00100000:1.0:1784290330.601194:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896229888 00000100:00100000:1.0:1784290330.601230:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1117 00000100:00100000:1.0:1784290330.601239:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:69234:x1870961896229888:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:1.0:1784290330.601256:0:65990:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:1.0:1784290330.601291:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:69234:x1870961896229888:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 55us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290330.601306:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1117 00000100:00100000:1.0:1784290330.602697:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290330.602753:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896230016 00000100:00100000:0.0:1784290330.602759:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896230016 00000100:00100000:0.0:1784290330.602802:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1168 00000100:00100000:0.0:1784290330.602813:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:69234:x1870961896230016:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:0.0:1784290330.602831:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290330.602886:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:69234:x1870961896230016:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 75us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290330.602896:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1168 00000100:00100000:3.0:1784290330.603618:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290330.603662:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896230144 00000100:00100000:0.0:1784290330.603668:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896230144 00000100:00100000:0.0:1784290330.603709:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1169 00000100:00100000:0.0:1784290330.603719:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:69234:x1870961896230144:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:0.0:1784290330.603744:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290330.603785:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:69234:x1870961896230144:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 68us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290330.603794:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1169 00000100:00100000:1.0:1784290330.625939:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290330.625978:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896230400 00000100:00100000:0.0:1784290330.625987:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896230400 00000100:00100000:0.0:1784290330.626031:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1118 00000100:00100000:0.0:1784290330.626040:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:69241:x1870961896230400:12345-192.168.202.6@tcp:36:mcreate.0 00010000:00010000:0.0:1784290330.626081:0:66004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290330.626102:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b3074210 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2305 expref: 10 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.626115:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2446227900) 00010000:00010000:0.0:1784290330.626123:0:66004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290330.626180:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3074217 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.626191:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3074217 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.626198:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3074217 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.626213:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26e00/0x5953bbf6b307421e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.626218:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26e00/0x5953bbf6b307421e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.626223:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26e00/0x5953bbf6b307421e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.626568:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3074217 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.626585:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3074217 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.626590:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3074217 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.626595:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3074217 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.626599:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27c00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290330.626603:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3074217 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.626609:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3074217 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.626617:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2446227300) 00010000:00010000:0.0:1784290330.626620:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290330.626622:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3074217 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.626634:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3074217 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290330.626645:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007c40c3e9 reply state 000000006f560624 transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26e00/0x5953bbf6b307421e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.626653:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26e00/0x5953bbf6b307421e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.626657:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2446227c00) 00010000:00010000:0.0:1784290330.626659:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290330.626661:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784290330.626732:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:69241:x1870961896230400:12345-192.168.202.6@tcp:36:mcreate.0 Request processed in 693us (797us total) trans 107374182408 rc 0/0 00000100:00100000:0.0:1784290330.626739:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1118 00000100:00100000:1.0:1784290330.634792:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290330.634830:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896230528 00000100:00100000:0.0:1784290330.634836:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896230528 00000100:00100000:0.0:1784290330.634886:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1119 00000100:00100000:0.0:1784290330.634895:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:69245:x1870961896230528:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:0.0:1784290330.634922:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290330.634934:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3074225 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b230c expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.634982:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b307422c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.634989:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b307422c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.635005:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b307422c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290330.635028:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784290330.635031:0:65988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784290330.635042:0:65988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b307422c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.635056:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3074225 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b230c expref: 13 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.635067:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b307422c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b230c expref: 12 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.635073:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2446227300) 00010000:00010000:0.0:1784290330.635075:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784290330.635077:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27a00, rc 0) 00000100:00100000:0.0:1784290330.635108:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:69245:x1870961896230528:12345-192.168.202.6@tcp:101:rm.0 Request processed in 216us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290330.635113:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1119 00000100:00100000:3.0:1784290330.636264:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290330.636359:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896230656 00000100:00100000:1.0:1784290330.636366:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896230656 00000100:00100000:1.0:1784290330.636408:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1120 00000100:00100000:1.0:1784290330.636416:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:69245:x1870961896230656:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:1.0:1784290330.636425:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290330.636434:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d600/0x5953bbf6b3074233 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2313 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636465:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b307423a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636474:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b307423a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636481:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b307423a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636488:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3074241 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636494:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3074241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636498:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3074241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636574:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236de00/0x5953bbf6b3074248 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636581:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236de00/0x5953bbf6b3074248 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636587:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236de00/0x5953bbf6b3074248 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290330.636619:0:74876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0xa:0x0]: returning size 0 00000004:00200000:1.0:1784290330.636622:0:74876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784290330.636632:0:74876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236de00/0x5953bbf6b3074248 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636639:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236de00/0x5953bbf6b3074248 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636644:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b307423a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636649:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b307423a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636653:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b307423a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636657:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236da00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290330.636675:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b307423a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636679:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b307423a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636691:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2446227300) 00010000:00010000:1.0:1784290330.636693:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290330.636695:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b307423a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636699:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236da00/0x5953bbf6b307423a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636706:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3074241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636710:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3074241 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636714:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3074241 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636717:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236ca00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290330.636719:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3074241 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636723:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3074241 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636727:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2446227c00) 00010000:00010000:1.0:1784290330.636728:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290330.636730:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3074241 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636734:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ca00/0x5953bbf6b3074241 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636755:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d600/0x5953bbf6b3074233 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2313 expref: 14 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636763:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236de00/0x5953bbf6b3074248 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2313 expref: 13 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.636767:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff9c2469829a00) 00010000:00010000:1.0:1784290330.636769:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784290330.636770:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236de00, rc 0) 00000100:00100000:1.0:1784290330.636798:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:69245:x1870961896230656:12345-192.168.202.6@tcp:101:rm.0 Request processed in 383us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290330.636802:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1120 00000100:00100000:1.0:1784290330.638573:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290330.638616:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896230912 00000100:00100000:0.0:1784290330.638623:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896230912 00000100:00100000:0.0:1784290330.638658:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1121 00000100:00100000:0.0:1784290330.638665:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:69245:x1870961896230912:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:0.0:1784290330.638703:0:66008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784290330.638713:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236de00/0x5953bbf6b3074248 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2313 expref: 13 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.638734:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff9c2469829a00) 00010000:00010000:0.0:1784290330.638743:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b307422c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b230c expref: 12 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.638750:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2446227300) 00010000:00010000:0.0:1784290330.638753:0:66008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290330.638763:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b307424f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.638769:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b307424f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.638774:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b307424f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.638780:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3074256 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.638785:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3074256 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.638789:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3074256 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.638824:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b307425d lrc: 3/0,1 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.638833:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b307425d lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.638864:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b307425d lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.638991:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3074264 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.638998:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3074264 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.639004:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3074264 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.639010:0:66008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3074264 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.639014:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3074264 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.639018:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3074264 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.639034:0:66008:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290330.639044:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b307425d lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.639048:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290330.639048:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b307425d lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.639056:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3074264 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.639057:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b307425d lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.639077:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290330.639077:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290330.639081:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3074264 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.639089:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b307425d lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.639091:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3074264 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.639102:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b307425d lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.639107:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff9c2446227100) 00010000:00010000:1.0:1784290330.639111:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784290330.639114:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3074264 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.639117:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff9c2446227100) 00010000:00010000:0.0:1784290330.639121:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784290330.639123:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b307425d lrc: 2/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.639140:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3074264 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.639141:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b307425d lrc: 0/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.639190:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290330.639193:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290330.639195:0:66008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b307424f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290330.639196:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290330.639203:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b307424f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.639208:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b307424f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.639213:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b307424f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.639217:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290330.639219:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b307424f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.639223:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b307424f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.639238:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2446227900) 00010000:00010000:0.0:1784290330.639240:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290330.639243:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b307424f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.639248:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b307424f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290330.639256:0:66008:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000be2c808e reply state 0000000006cfb974 transno 107374182409 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3074256 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.639263:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3074256 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290330.639268:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2446227c00) 00010000:00010000:0.0:1784290330.639270:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290330.639272:0:66008:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784290330.639310:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:69245:x1870961896230912:12345-192.168.202.6@tcp:36:rm.0 Request processed in 645us (738us total) trans 107374182409 rc 0/0 00000100:00100000:0.0:1784290330.639316:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1121 00010000:00010000:2.0:1784290331.303449:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290332.327506:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901068032:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784290332.327507:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901067776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784290332.327587:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901067648:0@lo:400:kworker.0 00000100:00100000:1.0:1784290332.327591:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290332.327599:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290332.327642:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1870961901068288:0@lo:400:kworker.0 00000100:00100000:0.0:1784290332.327652:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1870961901068544:0@lo:400:kworker.0 00000100:00100000:3.0:1784290332.327653:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290332.327685:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290332.327701:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247c534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901067904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784290332.327705:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901068032 00000100:00100000:0.0:1784290332.327712:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901068032 00000100:00100000:1.0:1784290332.327726:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901068800:0@lo:400:kworker.0 00000100:00100000:3.0:1784290332.327735:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290332.327762:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290332.327765:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901067904 00000100:00100000:3.0:1784290332.327768:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1870961901068416:0@lo:400:kworker.0 00000100:00100000:0.0:1784290332.327770:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901067904 00000100:00100000:1.0:1784290332.327791:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901069312:0@lo:400:kworker.0 00000100:00100000:3.0:1784290332.327807:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290332.327808:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3778 00000100:00100000:0.0:1784290332.327821:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2458b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3617:x1870961901068032:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784290332.327824:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290332.327846:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901068928:0@lo:400:kworker.0 00000004:00000024:0.0:1784290332.327866:0:22091:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:3.0:1784290332.327880:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290332.327907:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901067776 00000100:00100000:1.0:1784290332.327913:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901067776 00000100:00100000:3.0:1784290332.327923:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246ded8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901069440:0@lo:400:kworker.0 00000100:00100000:2.0:1784290332.327927:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901068800 00000100:00100000:2.0:1784290332.327934:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901068800 00000100:00100000:0.0:1784290332.327943:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2458b61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3617:x1870961901068032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290332.327952:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3778 00000100:00100000:3.0:1784290332.327960:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290332.327982:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901069312 00000100:00100000:1.0:1784290332.327986:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:0.0:1784290332.327986:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3779 00000100:00100000:2.0:1784290332.327988:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901069312 00000100:00100000:0.0:1784290332.328001:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1870961901067904:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784290332.328008:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901067776:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784290332.328011:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1870961901068160:0@lo:400:kworker.0 00000100:00100000:2.0:1784290332.328016:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901068928 00000004:00000024:0.0:1784290332.328021:0:22091:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1444646912 avail 1298407424 00000100:00100000:2.0:1784290332.328022:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901068928 00002000:00000024:1.0:1784290332.328036:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00010000:00000080:0.0:1784290332.328037:0:22091:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2446e00700 x1870961901067904/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:353/0 lens 224/368 e 0 to 0 dl 1784290343 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290332.328047:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290332.328049:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901069440 00000100:00100000:2.0:1784290332.328054:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901069440 00000100:00100000:3.0:1784290332.328077:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901068672:0@lo:400:kworker.0 00000100:00100000:2.0:1784290332.328091:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1542 00000100:00100000:1.0:1784290332.328099:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901067776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290332.328104:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901068800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290332.328110:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1870961901067904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290332.328116:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:3.0:1784290332.328120:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290332.328130:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3779 00000100:00100000:3.0:1784290332.328144:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901069184:0@lo:400:kworker.0 00000100:00100000:0.0:1784290332.328150:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901068672 00000100:00100000:1.0:1784290332.328154:0:88731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901067648 00000100:00100000:0.0:1784290332.328156:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901068672 00000100:00100000:1.0:1784290332.328160:0:88731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901067648 00000100:00100000:2.0:1784290332.328170:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a055c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901068800:12345-0@lo:400:kworker.0 Request processed in 70us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290332.328179:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1542 00000100:00100000:3.0:1784290332.328186:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290332.328194:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3780 00000100:00100000:3.0:1784290332.328210:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901069696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290332.328211:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1543 00000100:00100000:0.0:1784290332.328212:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1870961901068672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290332.328213:0:88731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784290332.328230:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901069312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290332.328232:0:88731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3620:x1870961901067648:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1784290332.328237:0:22091:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2446e03b80 x1870961901068672/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:353/0 lens 224/224 e 0 to 0 dl 1784290343 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290332.328247:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290332.328269:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901069312:12345-0@lo:400:kworker.0 Request processed in 43us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290332.328288:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1543 00000100:00100000:0.0:1784290332.328303:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1870961901068672:12345-0@lo:400:kworker.0 Request processed in 98us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290332.328306:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901068672:0@lo:400:kworker.0 00000100:00100000:1.0:1784290332.328315:0:88731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344449050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3620:x1870961901067648:12345-0@lo:400:kworker.0 Request processed in 85us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290332.328320:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3780 00000100:00100000:2.0:1784290332.328321:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1544 00000100:00100000:1.0:1784290332.328330:0:88731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:3.0:1784290332.328336:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290332.328369:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901068928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290332.328370:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901069184 00000100:00100000:0.0:1784290332.328376:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901069184 00000100:00100000:3.0:1784290332.328385:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901068288 00000100:00100000:3.0:1784290332.328391:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901068288 00000100:00100000:1.0:1784290332.328404:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901068416 00000100:00100000:1.0:1784290332.328410:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901068416 00000100:00100000:0.0:1784290332.328414:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3781 00000100:00100000:2.0:1784290332.328423:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901068928:12345-0@lo:400:kworker.0 Request processed in 88us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290332.328426:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901069184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290332.328435:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901068160 00000100:00100000:2.0:1784290332.328437:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1544 00000100:00100000:3.0:1784290332.328441:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901068160 00000100:00100000:1.0:1784290332.328448:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:1.0:1784290332.328460:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1870961901068288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290332.328466:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1545 00000100:00100000:2.0:1784290332.328478:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901069440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290332.328485:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1784290332.328497:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1870961901068416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290332.328506:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901069184:12345-0@lo:400:kworker.0 Request processed in 82us (321us total) trans 0 rc 0/0 00010000:00000080:3.0:1784290332.328515:0:65988:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2446e00380 x1870961901068416/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:353/0 lens 224/224 e 0 to 0 dl 1784290343 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290332.328517:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3781 00000100:00100000:1.0:1784290332.328521:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a054380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1870961901068288:12345-0@lo:400:kworker.0 Request processed in 62us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290332.328527:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901069440:12345-0@lo:400:kworker.0 Request processed in 51us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290332.328545:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:2.0:1784290332.328549:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1545 00000100:00100000:0.0:1784290332.328565:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901069696 00000100:00100000:0.0:1784290332.328572:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901069696 00000100:00100000:1.0:1784290332.328580:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1784290332.328583:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1870961901068416:12345-0@lo:400:kworker.0 Request processed in 88us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290332.328593:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:1.0:1784290332.328595:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1870961901068160:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1784290332.328610:0:65989:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2446e00a80 x1870961901068160/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:353/0 lens 224/224 e 0 to 0 dl 1784290343 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290332.328611:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:0.0:1784290332.328627:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901069696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784290332.328649:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290332.328654:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1870961901068160:12345-0@lo:400:kworker.0 Request processed in 65us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290332.328661:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1784290332.328667:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1870961901068160:0@lo:400:kworker.0 00000100:00100000:3.0:1784290332.328685:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901069184:0@lo:400:kworker.0 00000100:00080000:1.0:1784290332.328693:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784290332.328699:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784290332.328699:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901069696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290332.328701:0:3618:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968627 gen 2 00000100:00080000:1.0:1784290332.328706:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784290332.328712:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784290332.328717:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00100000:3.0:1784290332.328724:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a054000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901069696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784290332.328749:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901068800:0@lo:400:kworker.0 00000100:00100000:0.0:1784290332.328765:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290332.328768:0:3619:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968627 gen 2 00000100:00100000:3.0:1784290332.328775:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901067648:0@lo:400:kworker.0 00000100:00100000:1.0:1784290332.328786:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901069312:0@lo:400:kworker.0 00000100:00100000:0.0:1784290332.328795:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1870961901069056:0@lo:400:kworker.0 00000100:00100000:3.0:1784290332.328800:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247c534000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901067904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784290332.328813:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901067776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784290332.328821:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1870961901068416:0@lo:400:kworker.0 00000100:00100000:0.0:1784290332.328831:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290332.328850:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1870961901068288:0@lo:400:kworker.0 00000100:00100000:3.0:1784290332.328851:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901068928:0@lo:400:kworker.0 00000100:00100000:0.0:1784290332.328855:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2446e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1870961901069568:0@lo:400:kworker.0 00000100:00100000:3.0:1784290332.328877:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246ded8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901069440:0@lo:400:kworker.0 00000100:00100000:0.0:1784290332.328910:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290332.328932:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901068544 00000100:00100000:3.0:1784290332.328936:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901068544 00000100:00100000:1.0:1784290332.328944:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901069056 00000100:00100000:0.0:1784290332.328950:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901068032:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784290332.328953:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901069056 00000100:00100000:3.0:1784290332.328970:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901069568 00000100:00100000:3.0:1784290332.328975:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901069568 00000100:00080000:0.0:1784290332.328996:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784290332.329003:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1784290332.329010:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:1.0:1784290332.329016:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2458b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1870961901068544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290332.329023:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2458b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1870961901069056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290332.329024:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:0.0:1784290332.329040:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2458b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1870961901069568:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1784290332.329045:0:65990:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2458b61f80 x1870961901069056/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:353/0 lens 224/224 e 0 to 0 dl 1784290343 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000080:0.0:1784290332.329057:0:65989:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2458b61180 x1870961901069568/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:353/0 lens 224/224 e 0 to 0 dl 1784290343 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290332.329064:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2458b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1870961901068544:12345-0@lo:400:kworker.0 Request processed in 50us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290332.329080:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1784290332.329084:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2458b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1870961901069056:12345-0@lo:400:kworker.0 Request processed in 64us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290332.329093:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:0.0:1784290332.329112:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2458b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1870961901069568:12345-0@lo:400:kworker.0 Request processed in 76us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290332.329120:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:1.0:1784290332.329132:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1870961901068544:0@lo:400:kworker.0 00000100:00100000:1.0:1784290332.329147:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1870961901069056:0@lo:400:kworker.0 00000100:00100000:1.0:1784290332.329157:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2446e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1870961901069568:0@lo:400:kworker.0 00000001:02000400:0.0:1784290333.057309:0:89990:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:3.0:1784290333.089560:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290333.089629:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896231040 00000100:00100000:1.0:1784290333.089643:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896231040 00000100:00080000:2.0:1784290333.089722:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784290333.089747:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1122 00000100:00100000:1.0:1784290333.089763:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:69311:x1870961896231040:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:1.0:1784290333.089791:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290333.089830:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c600/0x5953bbf6b307426b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b231a expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.089922:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b3074272 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.089938:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b3074272 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.089953:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b3074272 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290333.090017:0:74876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784290333.090022:0:74876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784290333.090042:0:74876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b3074272 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.090070:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c600/0x5953bbf6b307426b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b231a expref: 15 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.090089:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b3074272 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b231a expref: 14 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.090098:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2442b61300) 00010000:00010000:1.0:1784290333.090102:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784290333.090106:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236d800, rc 0) 00010000:00000080:1.0:1784290333.090115:0:74876:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2446e03100 x1870961896231040/t0(0) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:354/0 lens 576/688 e 0 to 0 dl 1784290344 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290333.090197:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+14:69311:x1870961896231040:12345-192.168.202.6@tcp:101:dd.0 Request processed in 439us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290333.090205:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1122 00000100:00100000:3.0:1784290333.092288:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290333.092419:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896231296 00000100:00100000:1.0:1784290333.092428:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896231296 00000100:00100000:1.0:1784290333.092483:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1123 00000100:00100000:1.0:1784290333.092497:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ded8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+14:69311:x1870961896231296:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:1.0:1784290333.092511:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290333.092513:0:66008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784290333.092532:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d800/0x5953bbf6b3074272 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b231a expref: 14 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.092558:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2442b61300) 00010000:00010000:1.0:1784290333.092568:0:66008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290333.092580:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3074279 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2321 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.092691:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3074280 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.092703:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3074280 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.092712:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3074280 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.092726:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b3074287 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.092734:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b3074287 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.092741:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b3074287 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.092788:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307428e lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.092797:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307428e lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.092806:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307428e lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290333.092831:0:66008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 0 00010000:00010000:1.0:1784290333.092947:0:66008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3074280 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.092957:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3074280 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.092964:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3074280 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.092971:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3074280 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.092979:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290333.092985:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3074280 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.092993:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3074280 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.093008:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2442b61200) 00010000:00010000:1.0:1784290333.093012:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290333.093017:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3074280 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.093023:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3074280 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.093037:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b3074287 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.093043:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b3074287 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.093058:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b3074287 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.093064:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290333.093068:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b3074287 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.093075:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b3074287 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.093088:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c2442b61400) 00010000:00010000:1.0:1784290333.093091:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290333.093094:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b3074287 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.093100:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d400/0x5953bbf6b3074287 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.093138:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3074279 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2321 expref: 16 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.093153:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307428e lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2321 expref: 15 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290333.093161:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2442b61600) 00010000:00010000:1.0:1784290333.093163:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784290333.093166:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236d000, rc 0) 00010000:00000080:1.0:1784290333.093173:0:66008:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c246ded8700 x1870961896231296/t107374182410(0) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:354/0 lens 776/848 e 0 to 0 dl 1784290344 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290333.093243:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ded8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+15:69311:x1870961896231296:12345-192.168.202.6@tcp:101:dd.0 Request processed in 750us (958us total) trans 107374182410 rc 0/0 00000100:00100000:1.0:1784290333.093253:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1123 00000100:00100000:2.0:1784290333.095043:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290333.095099:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896231424 00000100:00100000:0.0:1784290333.095108:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896231424 00000100:00100000:0.0:1784290333.095152:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1124 00000100:00100000:0.0:1784290333.095161:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+15:69311:x1870961896231424:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1784290333.095176:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290333.095191:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b307429c lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2328 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.095216:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b30742a3 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.095227:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b30742a3 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.095237:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b30742a3 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.095324:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b307429c lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2328 expref: 17 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.095371:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b30742a3 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2328 expref: 16 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.095381:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2442b61600) 00010000:00010000:0.0:1784290333.095384:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784290333.095388:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26200, rc 0) 00010000:00000080:0.0:1784290333.095396:0:65988:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c24483d0700 x1870961896231424/t0(0) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:354/0 lens 568/1344 e 0 to 0 dl 1784290344 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290333.095462:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+16:69311:x1870961896231424:12345-192.168.202.6@tcp:101:dd.0 Request processed in 302us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290333.095470:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1124 00000100:00100000:2.0:1784290333.096813:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290333.096845:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896231680 00000100:00100000:3.0:1784290333.096943:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896231680 00000100:00100000:3.0:1784290333.096993:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1125 00000100:00100000:3.0:1784290333.097004:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+16:69311:x1870961896231680:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:3.0:1784290333.097037:0:65990:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290333.097053:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236d000/0x5953bbf6b307428e lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2321 expref: 16 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.097069:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2442b61600) 00010000:00010000:3.0:1784290333.097073:0:65990:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290333.097240:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ce00/0x5953bbf6b30742aa lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.097253:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ce00/0x5953bbf6b30742aa lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.097263:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ce00/0x5953bbf6b30742aa lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784290333.097310:0:65990:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 107374182411 00000004:00010000:3.0:1784290333.097334:0:65990:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005fca71bb reply state 00000000ac53ff01 transno 107374182412 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ce00/0x5953bbf6b30742aa lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.097396:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ce00/0x5953bbf6b30742aa lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.097406:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2442b61600) 00010000:00010000:3.0:1784290333.097410:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290333.097414:0:65990:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1784290333.097459:0:65990:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c24483d2a00 x1870961896231680/t107374182412(0) o36->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:354/0 lens 488/456 e 0 to 0 dl 1784290344 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290333.097540:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+18:69311:x1870961896231680:12345-192.168.202.6@tcp:36:dd.0 Request processed in 538us (728us total) trans 107374182412 rc 0/0 00000100:00100000:3.0:1784290333.097549:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1125 00000020:00080000:3.0:1784290333.097557:0:65990:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784290333.098737:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290333.098792:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896231808 00000100:00100000:0.0:1784290333.098801:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896231808 00000100:00100000:0.0:1784290333.098862:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1126 00000100:00100000:0.0:1784290333.098873:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+18:69311:x1870961896231808:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1784290333.098904:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290333.098916:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30742b1 lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b232f expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.098948:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30742b1 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b232f expref: 19 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.098960:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30742b1 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b232f expref: 19 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.098976:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2442b61600) 00010000:00010000:0.0:1784290333.098980:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784290333.098983:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26800, rc 0) 00010000:00000080:0.0:1784290333.098989:0:66004:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c247c534000 x1870961896231808/t0(0) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:354/0 lens 376/584 e 0 to 0 dl 1784290344 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290333.099039:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c534000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+19:69311:x1870961896231808:12345-192.168.202.6@tcp:101:dd.0 Request processed in 167us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290333.099048:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1126 00000100:00100000:2.0:1784290333.100541:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290333.100593:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896232064 00000100:00100000:0.0:1784290333.100610:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896232064 00000100:00100000:0.0:1784290333.100661:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1127 00000100:00100000:0.0:1784290333.100688:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+19:69311:x1870961896232064:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1784290333.100700:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290333.100702:0:65989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784290333.100717:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30742b1 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b232f expref: 19 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.100731:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2442b61600) 00010000:00010000:0.0:1784290333.100735:0:65989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290333.100746:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b30742b8 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2336 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.100776:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30742bf lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.100790:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30742bf lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.100803:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30742bf lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784290333.100937:0:65989:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x683:0x0], count =127 00000004:00080000:0.0:1784290333.100945:0:65989:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x683:0x0]+127 in llog 00000004:00080000:0.0:1784290333.100961:0:65989:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x702:0x0], index 1: 0 00000004:00080000:0.0:1784290333.100968:0:65989:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x703:0x0], index 0: 0 00010000:00010000:0.0:1784290333.101042:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30742bf lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2336 expref: 21 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.101051:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2442b61600) 00010000:00010000:0.0:1784290333.101062:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1784290333.101074:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b30742b8 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2336 expref: 21 pid: 65989 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.101088:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30742bf lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2336 expref: 20 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.101115:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2442b61600) 00010000:00010000:0.0:1784290333.101118:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1784290333.101120:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26000, rc 0) 00010000:00000080:0.0:1784290333.101125:0:65989:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c24483d3480 x1870961896232064/t107374182413(0) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:354/0 lens 376/608 e 0 to 0 dl 1784290344 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290333.101171:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+20:69311:x1870961896232064:12345-192.168.202.6@tcp:101:dd.0 Request processed in 502us (633us total) trans 107374182413 rc 0/0 00000100:00100000:0.0:1784290333.101179:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1127 00000100:00100000:2.0:1784290333.103305:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290333.103400:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896232192 00000100:00100000:3.0:1784290333.103408:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896232192 00000100:00080000:2.0:1784290333.103454:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784290333.103471:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4934 00000100:00100000:3.0:1784290333.103484:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:69311:x1870961896232192:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:3.0:1784290333.103496:0:26250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290333.103515:0:26250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5e3e00b/0x5953bbf6b30742c6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b233d expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290333.103540:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x702:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290333.103558:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x702:0x0].0x0 since=2074s v=(0 0) 00010000:00010000:3.0:1784290333.103564:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x702:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290333.103574:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5e3e00b/0x5953bbf6b30742c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b233d expref: 6 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.103589:0:26250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5e3e00b/0x5953bbf6b30742c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b233d expref: 6 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.103601:0:26250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2458d5dc00, rc 0) 00000100:00100000:3.0:1784290333.103643:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:69311:x1870961896232192:12345-192.168.202.6@tcp:101:dd.0 Request processed in 163us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290333.103665:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4934 00000100:00100000:3.0:1784290333.105012:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290333.105078:0:26255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896232320 00000100:00100000:0.0:1784290333.105086:0:26255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896232320 00000100:00080000:2.0:1784290333.105160:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290333.105171:0:26255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4935 00000100:00100000:0.0:1784290333.105185:0:26255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+5:69311:x1870961896232320:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1784290333.105197:0:26255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290333.105223:0:26255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000120e7c7/0x5953bbf6b30742cd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2344 expref: -99 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290333.105245:0:26255:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x702:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290333.105260:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x702:0x0].0x0 since=2074s v=(0 0) 00010000:00010000:0.0:1784290333.105265:0:26255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x702:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290333.105273:0:26255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000120e7c7/0x5953bbf6b30742cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2344 expref: 6 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.105302:0:26255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000120e7c7/0x5953bbf6b30742cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2344 expref: 6 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.105314:0:26255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27c00, rc 0) 00000100:00100000:0.0:1784290333.105391:0:26255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:69311:x1870961896232320:12345-192.168.202.6@tcp:101:dd.0 Request processed in 209us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290333.105402:0:26255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4935 00000100:00100000:2.0:1784290333.106628:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290333.106666:0:26263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896232448 00000100:00100000:3.0:1784290333.106673:0:26263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896232448 00000100:00100000:3.0:1784290333.106716:0:26263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4936 00000100:00100000:3.0:1784290333.106725:0:26263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:69311:x1870961896232448:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:3.0:1784290333.106735:0:26263:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290333.106748:0:26263:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000331ccedf/0x5953bbf6b30742d4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b234b expref: -99 pid: 26263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290333.106764:0:26263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x703:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290333.106776:0:26263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x703:0x0].0x0 since=2074s v=(0 0) 00010000:00010000:3.0:1784290333.106780:0:26263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x703:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290333.106787:0:26263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000331ccedf/0x5953bbf6b30742d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b234b expref: 7 pid: 26263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.106799:0:26263:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000331ccedf/0x5953bbf6b30742d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b234b expref: 7 pid: 26263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.106809:0:26263:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2458d5c600, rc 0) 00000100:00100000:3.0:1784290333.106851:0:26263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:69311:x1870961896232448:12345-192.168.202.6@tcp:101:dd.0 Request processed in 128us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290333.106859:0:26263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4936 00000100:00100000:2.0:1784290333.108219:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290333.108284:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896232576 00000100:00100000:2.0:1784290333.108291:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290333.108292:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896232576 00002000:00010000:3.0:1784290333.108320:0:8409:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/1794 (1048576->18446744073709551615) 00002000:00100000:3.0:1784290333.108333:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c24483d2680 with x1870961896232576 ext(1048576->18446744073709551615) 00002000:00010000:3.0:1784290333.108368:0:8409:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c24483d2680. 00000100:00100000:0.0:1784290333.108402:0:25097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896232704 00000100:00100000:0.0:1784290333.108410:0:25097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896232704 00000100:00100000:3.0:1784290333.108422:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 350 00002000:00010000:0.0:1784290333.108436:0:25097:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1795 (0->18446744073709551615) 00000100:00100000:3.0:1784290333.108439:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2399:x1870961896232576:12345-192.168.202.6@tcp:10:dd.0 00002000:00100000:0.0:1784290333.108445:0:25097:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c24483d0a80 with x1870961896232704 ext(0->18446744073709551615) 00002000:00010000:0.0:1784290333.108454:0:25097:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c24483d0a80. 00000100:00100000:0.0:1784290333.108488:0:25097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 351 00000100:00100000:0.0:1784290333.108504:0:25097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2400:x1870961896232704:12345-192.168.202.6@tcp:10:dd.0 00002000:00010000:3.0:1784290333.108679:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x702:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:3.0:1784290333.108684:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x702:0x0] updating lvb mtime from disk: 0 -> 1784290333 00002000:00010000:3.0:1784290333.108688:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x702:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1784290333.108691:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x702:0x0] updating lvb ctime from disk: 0 -> 1784290333 00002000:00010000:3.0:1784290333.108693:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x702:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:0.0:1784290333.108696:0:25097:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x703:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784290333.108702:0:25097:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x703:0x0] updating lvb mtime from disk: 0 -> 1784290333 00002000:00010000:0.0:1784290333.108705:0:25097:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x703:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1784290333.108707:0:25097:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x703:0x0] updating lvb ctime from disk: 0 -> 1784290333 00002000:00010000:0.0:1784290333.108710:0:25097:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x703:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1784290333.108746:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2399:x1870961896232576:12345-192.168.202.6@tcp:10:dd.0 Request processed in 312us (528us total) trans 4294968628 rc 0/0 00000100:00100000:0.0:1784290333.108757:0:25097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2400:x1870961896232704:12345-192.168.202.6@tcp:10:dd.0 Request processed in 253us (466us total) trans 4294968628 rc 0/0 00000100:00100000:3.0:1784290333.108767:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 350 00002000:00010000:3.0:1784290333.108774:0:8409:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/1794 (1048576->18446744073709551615) 00000100:00100000:0.0:1784290333.108782:0:25097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 351 00002000:00100000:3.0:1784290333.108783:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c24483d2680 with x1870961896232576 ext(1048576->18446744073709551615) 00002000:00010000:0.0:1784290333.108793:0:25097:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1795 (0->18446744073709551615) 00002000:00010000:3.0:1784290333.108795:0:8409:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c24483d2680. 00002000:00100000:0.0:1784290333.108803:0:25097:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c24483d0a80 with x1870961896232704 ext(0->18446744073709551615) 00002000:00010000:0.0:1784290333.108834:0:25097:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c24483d0a80. 00000100:00100000:2.0:1784290333.146168:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290333.146251:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896232960 00000100:00100000:3.0:1784290333.146264:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896232960 00000100:00100000:3.0:1784290333.146332:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 223 00000100:00100000:3.0:1784290333.146380:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+20:69311:x1870961896232960:12345-192.168.202.6@tcp:35:dd.0 00010000:00000080:3.0:1784290333.146643:0:65991:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2474b4df80 x1870961896232960/t107374182414(0) o35->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:354/0 lens 392/456 e 0 to 0 dl 1784290344 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290333.146724:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+21:69311:x1870961896232960:12345-192.168.202.6@tcp:35:dd.0 Request processed in 384us (564us total) trans 107374182414 rc 0/0 00000100:00100000:3.0:1784290333.146732:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 223 00000100:00100000:2.0:1784290333.158584:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290333.158678:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896233088 00000100:00100000:0.0:1784290333.158704:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896233088 00000100:00100000:0.0:1784290333.158745:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1128 00000100:00100000:0.0:1784290333.158770:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+21:69312:x1870961896233088:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1784290333.158793:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290333.158838:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b30742db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2352 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.158949:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30742e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.158964:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30742e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.158975:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30742e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290333.159003:0:74876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784290333.159006:0:74876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784290333.159020:0:74876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30742e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.159041:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b30742db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2352 expref: 23 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.159055:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30742e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2352 expref: 22 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.159063:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2446227100) 00010000:00010000:0.0:1784290333.159073:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784290333.159077:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26800, rc 0) 00010000:00000080:0.0:1784290333.159082:0:74876:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2446e55f80 x1870961896233088/t0(0) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:354/0 lens 576/688 e 0 to 0 dl 1784290344 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290333.159122:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+22:69312:x1870961896233088:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 370us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290333.159129:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1128 00000100:00100000:2.0:1784290333.160681:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290333.160724:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896233344 00000100:00100000:3.0:1784290333.160738:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896233344 00000100:00100000:3.0:1784290333.160773:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1129 00000100:00100000:3.0:1784290333.160781:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+22:69312:x1870961896233344:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1784290333.160792:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290333.160802:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5de00/0x5953bbf6b30742e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2359 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.160846:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ca00/0x5953bbf6b30742f0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.160856:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ca00/0x5953bbf6b30742f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.160863:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ca00/0x5953bbf6b30742f0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.160874:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30742f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.160899:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30742f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.160905:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30742f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.160969:0:66008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ca00/0x5953bbf6b30742f0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.160976:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ca00/0x5953bbf6b30742f0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.160982:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ca00/0x5953bbf6b30742f0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.160994:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ca00/0x5953bbf6b30742f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.160999:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5ca00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290333.161003:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ca00/0x5953bbf6b30742f0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.161009:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ca00/0x5953bbf6b30742f0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.161019:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2446227100) 00010000:00010000:3.0:1784290333.161021:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290333.161025:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ca00/0x5953bbf6b30742f0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.161031:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ca00/0x5953bbf6b30742f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.161040:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30742f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.161045:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30742f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.161050:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30742f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.161054:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5d200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290333.161057:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30742f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.161069:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30742f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.161076:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c246d9d9700) 00010000:00010000:3.0:1784290333.161078:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290333.161080:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30742f7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.161085:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30742f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.161110:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5de00/0x5953bbf6b30742e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2359 expref: 23 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.161122:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2446227100) 00010000:00010000:3.0:1784290333.161124:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784290333.161129:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5de00/0x5953bbf6b30742e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2359 expref: 23 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.161140:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2458d5de00, rc 0) 00010000:00000080:3.0:1784290333.161147:0:66008:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2446e54e00 x1870961896233344/t0(0) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:354/0 lens 800/608 e 0 to 0 dl 1784290344 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290333.161196:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+22:69312:x1870961896233344:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 415us (517us total) trans 0 rc 301/301 00000100:00100000:3.0:1784290333.161203:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1129 00000100:00100000:2.0:1784290333.162694:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290333.162736:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896233472 00000100:00100000:3.0:1784290333.162743:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896233472 00000100:00100000:3.0:1784290333.162784:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1130 00000100:00100000:3.0:1784290333.162792:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+22:69312:x1870961896233472:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:3.0:1784290333.162827:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b30742fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.162837:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b30742fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.162845:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b30742fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.162854:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b3074305 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.162860:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b3074305 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.162866:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b3074305 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.162922:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c000/0x5953bbf6b307430c lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.162930:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c000/0x5953bbf6b307430c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.162936:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c000/0x5953bbf6b307430c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290333.162956:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 2097152 00000004:00200000:3.0:1784290333.162959:0:65988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784290333.162968:0:65988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c000/0x5953bbf6b307430c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.162984:0:65988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b30742fe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.162989:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b30742fe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.162994:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b30742fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.162999:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b30742fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.163003:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5c800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290333.163006:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b30742fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.163011:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b30742fe lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.163019:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2446227100) 00010000:00010000:3.0:1784290333.163021:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290333.163024:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b30742fe lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.163029:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b30742fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.163038:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b3074305 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.163043:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b3074305 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.163053:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b3074305 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.163057:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5da00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290333.163060:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b3074305 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.163064:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b3074305 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.163070:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c246d9d9300) 00010000:00010000:3.0:1784290333.163072:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290333.163074:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b3074305 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.163079:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b3074305 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.163088:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c000/0x5953bbf6b307430c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.163093:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c000/0x5953bbf6b307430c lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.163097:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c000/0x5953bbf6b307430c lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.163101:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5c000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290333.163104:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c000/0x5953bbf6b307430c lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.163122:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c000/0x5953bbf6b307430c lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.163133:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2442b61600) 00010000:00010000:3.0:1784290333.163137:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290333.163141:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c000/0x5953bbf6b307430c lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.163150:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c000/0x5953bbf6b307430c lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:3.0:1784290333.163172:0:65988:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2446e55180 x1870961896233472/t0(0) o34->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:354/0 lens 472/728 e 0 to 0 dl 1784290344 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290333.163217:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+22:69312:x1870961896233472:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 426us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290333.163225:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1130 00000100:00100000:2.0:1784290333.176723:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290333.176777:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896233728 00000100:00100000:3.0:1784290333.176786:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896233728 00000100:00100000:3.0:1784290333.176826:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1131 00000100:00100000:3.0:1784290333.176834:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+22:69314:x1870961896233728:12345-192.168.202.6@tcp:101:md5sum.0 00010000:00010000:3.0:1784290333.176846:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290333.176857:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c000/0x5953bbf6b3074313 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2360 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.176922:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b307431a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.176934:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b307431a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.176951:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b307431a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.176962:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3074321 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.176970:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3074321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.176976:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3074321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.177034:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5de00/0x5953bbf6b3074328 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.177042:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5de00/0x5953bbf6b3074328 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.177049:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5de00/0x5953bbf6b3074328 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290333.177057:0:65990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 2097152 00010000:00010000:3.0:1784290333.177115:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b307431a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.177127:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b307431a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.177136:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b307431a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.177144:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5da00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290333.177159:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b307431a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.177171:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b307431a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.177185:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2446227100) 00010000:00010000:3.0:1784290333.177190:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290333.177195:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b307431a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.177201:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b307431a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.177213:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3074321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.177218:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3074321 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.177224:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3074321 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.177229:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5c800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290333.177232:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3074321 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.177237:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3074321 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.177243:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c246d9d9300) 00010000:00010000:3.0:1784290333.177245:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290333.177254:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3074321 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.177260:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3074321 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.177304:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c000/0x5953bbf6b3074313 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2360 expref: 25 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.177315:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5de00/0x5953bbf6b3074328 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2360 expref: 24 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290333.177322:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2442b61600) 00010000:00010000:3.0:1784290333.177324:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784290333.177326:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2458d5de00, rc 0) 00010000:00000080:3.0:1784290333.177332:0:65990:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2446e54700 x1870961896233728/t107374182415(0) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:354/0 lens 800/872 e 0 to 0 dl 1784290344 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290333.177421:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+24:69314:x1870961896233728:12345-192.168.202.6@tcp:101:md5sum.0 Request processed in 585us (702us total) trans 107374182415 rc 0/0 00000100:00100000:3.0:1784290333.177429:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1131 00000100:00100000:2.0:1784290333.180534:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290333.180606:0:25102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896233856 00000100:00100000:0.0:1784290333.180614:0:25102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896233856 00002000:00100000:0.0:1784290333.180645:0:25102:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x702:0x0] (0->32767) req@ffff9c2446e54000 x1870961896233856/t0(0) o3->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:354/0 lens 488/0 e 0 to 0 dl 1784290344 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784290333.180657:0:25102:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2446e54000 with x1870961896233856 ext(0->32767) 00002000:00010000:0.0:1784290333.180662:0:25102:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2446e54000 00000100:00100000:0.0:1784290333.180690:0:25102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 352 00000100:00100000:0.0:1784290333.180697:0:25102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2399:x1870961896233856:12345-192.168.202.6@tcp:3:md5sum.0 00000100:00100000:1.0:1784290333.181870:0:25102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2399:x1870961896233856:12345-192.168.202.6@tcp:3:md5sum.0 Request processed in 1168us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290333.181900:0:25102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 352 00002000:00100000:1.0:1784290333.181909:0:25102:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x702:0x0] (0->32767) req@ffff9c2446e54000 x1870961896233856/t0(0) o3->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:354/0 lens 488/440 e 0 to 0 dl 1784290344 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784290333.181918:0:25102:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2446e54000 with x1870961896233856 ext(0->32767) 00002000:00010000:1.0:1784290333.181923:0:25102:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2446e54000 00000100:00100000:2.0:1784290333.186071:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290333.186141:0:25096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896233984 00000100:00100000:0.0:1784290333.186148:0:25096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896233984 00002000:00100000:0.0:1784290333.186174:0:25096:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x702:0x0] (32768->1048575) req@ffff9c2446e54a80 x1870961896233984/t0(0) o3->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:354/0 lens 488/0 e 0 to 0 dl 1784290344 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784290333.186184:0:25096:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2446e54a80 with x1870961896233984 ext(32768->1048575) 00002000:00010000:0.0:1784290333.186189:0:25096:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2446e54a80 00000100:00100000:0.0:1784290333.186216:0:25096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 353 00000100:00100000:0.0:1784290333.186224:0:25096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2400:x1870961896233984:12345-192.168.202.6@tcp:3:md5sum.0 00000100:00100000:0.0:1784290333.188593:0:25096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2400:x1870961896233984:12345-192.168.202.6@tcp:3:md5sum.0 Request processed in 2366us (2520us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290333.188615:0:25096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 353 00002000:00100000:0.0:1784290333.188624:0:25096:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x702:0x0] (32768->1048575) req@ffff9c2446e54a80 x1870961896233984/t0(0) o3->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:354/0 lens 488/440 e 0 to 0 dl 1784290344 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784290333.188635:0:25096:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2446e54a80 with x1870961896233984 ext(32768->1048575) 00002000:00010000:0.0:1784290333.188639:0:25096:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2446e54a80 00000100:00100000:2.0:1784290333.203699:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290333.203872:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896234240 00000100:00100000:1.0:1784290333.203901:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896234240 00000100:00100000:1.0:1784290333.203951:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 224 00000100:00100000:1.0:1784290333.203961:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+24:69314:x1870961896234240:12345-192.168.202.6@tcp:35:md5sum.0 00010000:00000080:1.0:1784290333.204127:0:65992:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2446e57b80 x1870961896234240/t107374182416(0) o35->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:354/0 lens 392/456 e 0 to 0 dl 1784290344 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290333.204202:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+25:69314:x1870961896234240:12345-192.168.202.6@tcp:35:md5sum.0 Request processed in 242us (508us total) trans 107374182416 rc 0/0 00000100:00100000:1.0:1784290333.204213:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 224 00000100:00100000:2.0:1784290333.221810:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290333.221910:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896234368 00000100:00100000:0.0:1784290333.221918:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896234368 00000100:00100000:0.0:1784290333.221965:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1132 00000100:00100000:0.0:1784290333.221975:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+25:69316:x1870961896234368:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:0.0:1784290333.222023:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b3074336 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222037:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b3074336 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222048:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b3074336 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222061:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b307433d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222068:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b307433d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222075:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b307433d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222124:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3074344 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222144:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3074344 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222152:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3074344 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290333.222181:0:66004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 2097152 00000004:00200000:0.0:1784290333.222186:0:66004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784290333.222194:0:66004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3074344 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222205:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b3074336 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222212:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b3074336 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222218:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b3074336 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222225:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b3074336 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222230:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290333.222234:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b3074336 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222241:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b3074336 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222250:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2446227100) 00010000:00010000:0.0:1784290333.222259:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290333.222264:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b3074336 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222271:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b3074336 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222284:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b307433d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222290:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b307433d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222297:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b307433d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222302:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290333.222305:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b307433d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222310:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b307433d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222318:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c2446227d00) 00010000:00010000:0.0:1784290333.222320:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290333.222323:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b307433d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222328:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b307433d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222383:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3074344 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222398:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3074344 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222405:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3074344 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222410:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26a00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290333.222414:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3074344 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222420:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3074344 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222428:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2442b61600) 00010000:00010000:0.0:1784290333.222431:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290333.222434:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3074344 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290333.222440:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3074344 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:0.0:1784290333.222463:0:66004:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2446e55500 x1870961896234368/t0(0) o34->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:354/0 lens 472/728 e 0 to 0 dl 1784290344 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290333.222513:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+25:69316:x1870961896234368:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 540us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290333.222522:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1132 00010000:00010000:1.0:1784290333.351614:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784290334.138576:0:90087:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1784290334.138658:0:90087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24429dfa00/0x5953bbf6b3073e58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073e5f expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290334.138686:0:90087:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24429dfa00/0x5953bbf6b3073e58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073e5f expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290334.138702:0:90087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24429dfa00/0x5953bbf6b3073e58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3073e5f expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290334.138719:0:90087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c24429dfa00/0x5953bbf6b3073e58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3073e5f expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290334.138755:0:90087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784290334.138765:0:90087:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784290334.138811:0:90087:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784290334.138819:0:90087:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784290334.138830:0:90087:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784290334.138901:0:90087:0:(import.c:65:import_set_state_nolock()) ffff9c246ff1c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1784290334.138975:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290334.138989:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c24429dfa00/0x5953bbf6b3073e58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3073e5f expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290334.139007:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429dfa00 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:2.0:1784290334.139016:0:19681:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c24429dfa00/0x5953bbf6b3073e58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3073e5f expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290334.139061:0:19681:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c24429dfa00/0x5953bbf6b3073e58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3073e5f expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290334.139078:0:19681:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c24429dfa00/0x5953bbf6b3073e58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3073e5f expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290334.139091:0:19681:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784290334.139097:0:19681:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784290334.139102:0:19681:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784290334.139147:0:19681:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c24429dfa00/0x5953bbf6b3073e58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073e5f expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290334.139162:0:19681:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784290334.139212:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c24429dfa00/0x5953bbf6b3073e58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073e5f expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290334.139223:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1784290334.139227:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c24429dfa00/0x5953bbf6b3073e58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073e5f expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290334.139256:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290334.139257:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247580b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901069952:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290334.139260:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290334.139265:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290334.139415:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290334.139512:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901069952 00000100:00100000:3.0:1784290334.139524:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901069952 00000100:00100000:1.0:1784290334.139578:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247580b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901069824:0@lo:39:umount.0 00000100:00100000:3.0:1784290334.139619:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:3.0:1784290334.139643:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3620:x1870961901069952:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290334.139652:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784290334.139680:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290334.139723:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebf600/0x5953bbf6b3073e5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073e58 expref: 24 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290334.139731:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901069824 00000100:00100000:1.0:1784290334.139742:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901069824 00010000:00010000:3.0:1784290334.139754:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784290334.139818:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:1.0:1784290334.139830:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1870961901069824:12345-0@lo:39:umount.0 00000020:00000080:1.0:1784290334.139859:0:65989:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073f77 00000100:00080000:1.0:1784290334.139906:0:65989:0:(import.c:65:import_set_state_nolock()) ffff9c246dce3000 : changing import state from FULL to CLOSED 00010000:00000080:1.0:1784290334.139942:0:65989:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c246a054000 x1870961901069824/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:355/0 lens 224/224 e 0 to 0 dl 1784290345 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290334.140030:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a054000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3616:x1870961901069824:12345-0@lo:39:umount.0 Request processed in 201us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290334.140042:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000020:00000080:1.0:1784290334.140058:0:65989:0:(genops.c:906:class_export_put()) final put ffff9c2343902000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1784290334.140087:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3620:x1870961901069952:12345-0@lo:103:ldlm_bl.0 Request processed in 446us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290334.140107:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00010000:00010000:1.0:1784290334.140145:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784290334.140163:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343902000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1784290334.140227:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247580b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901069952:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1784290334.140244:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246dce3000 for lustre-MDT0000 00000100:00080000:1.0:1784290334.140294:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246ff1c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784290334.140317:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247580b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901069824:0@lo:39:umount.0 00000100:00080000:3.0:1784290334.140580:0:90087:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784290334.140588:0:90087:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784290334.140596:0:90087:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1784290334.142661:0:90087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b3073d7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073d86 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.142683:0:90087:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b3073d7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073d86 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.142700:0:90087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b3073d7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3073d86 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.142715:0:90087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b3073d7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3073d86 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.142751:0:90087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290334.142764:0:90087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4c00/0x5953bbf6b3073e7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073e82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.142779:0:90087:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4c00/0x5953bbf6b3073e7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073e82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290334.142797:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290334.142808:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b3073d7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3073d86 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.142817:0:90087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4c00/0x5953bbf6b3073e7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3073e82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290334.142823:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebec00 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:2.0:1784290334.142830:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b3073d7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3073d86 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.142832:0:90087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4c00/0x5953bbf6b3073e7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3073e82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290334.142864:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b3073d7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3073d86 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.142868:0:90087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:00010000:2.0:1784290334.142905:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b3073d7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3073d86 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.142906:0:90087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073e4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073e51 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.142914:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1784290334.142921:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784290334.142923:0:90087:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073e4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073e51 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290334.142930:0:7429:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1784290334.142930:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4c00/0x5953bbf6b3073e7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3073e82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.142948:0:90087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073e4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3073e51 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290334.142959:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b3073d7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073d86 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.142971:0:90087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073e4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3073e51 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290334.142997:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784290334.142999:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f4c00 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:0.0:1784290334.143007:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4c00/0x5953bbf6b3073e7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3073e82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.143020:0:90087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290334.143023:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4c00/0x5953bbf6b3073e7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3073e82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290334.143036:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b3073d7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073d86 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.143038:0:90087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf400/0x5953bbf6b3073d71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3073d78 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290334.143040:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4c00/0x5953bbf6b3073e7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3073e82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290334.143078:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290334.143080:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290334.143081:0:90087:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf400/0x5953bbf6b3073d71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3073d78 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290334.143081:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2345ebec00/0x5953bbf6b3073d7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073d86 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290334.143083:0:6476:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1784290334.143095:0:6476:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1784290334.143097:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073e4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3073e51 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.143118:0:90087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf400/0x5953bbf6b3073d71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3073d78 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290334.143122:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebe600 already unused, calling callback (ffffffffc14a9c20) 00010000:00010000:2.0:1784290334.143127:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1784290334.143135:0:8418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073e4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3073e51 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290334.143137:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290334.143141:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4c00/0x5953bbf6b3073e7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073e82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290334.143148:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290334.143172:0:8418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073e4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3073e51 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290334.143177:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901070080:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290334.143194:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784290334.143199:0:90087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf400/0x5953bbf6b3073d71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3073d78 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290334.143209:0:8418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073e4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3073e51 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.143241:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4c00/0x5953bbf6b3073e7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073e82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.143256:0:90087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784290334.143257:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1784290334.143273:0:90087:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1784290334.143284:0:90087:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:01000000:1.0:1784290334.143289:0:8418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784290334.143290:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4c00/0x5953bbf6b3073e7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073e82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290334.143300:0:8418:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1784290334.143309:0:8418:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1784290334.143329:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:01000004:3.0:1784290334.143334:0:90087:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00010000:00010000:0.0:1784290334.143338:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf400/0x5953bbf6b3073d71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3073d78 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1784290334.143388:0:90087:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00010000:00010000:1.0:1784290334.143399:0:8418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073e4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073e51 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784290334.143405:0:90087:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:0.0:1784290334.143406:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf400 already unused, calling callback (ffffffffc14a9c20) 00000100:00100000:2.0:1784290334.143412:0:19593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901070080 10000000:00010000:0.0:1784290334.143418:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf400/0x5953bbf6b3073d71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3073d78 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000400:3.0:1784290334.143422:0:90087:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1784290334.143423:0:8418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784290334.143427:0:19593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901070080 00010000:00010000:1.0:1784290334.143446:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073e4a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073e51 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.143454:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf400/0x5953bbf6b3073d71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3073d78 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290334.143477:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe600/0x5953bbf6b3073e4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073e51 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290334.143481:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf400/0x5953bbf6b3073d71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3073d78 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290334.143499:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00010000:00010000:1.0:1784290334.143510:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784290334.143510:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1784290334.143521:0:6476:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1784290334.143522:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290334.143529:0:19593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247580b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3620:x1870961901070080:12345-0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1784290334.143532:0:6476:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1784290334.143534:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290334.143557:0:19593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784290334.143560:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2458b60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901070208:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290334.143575:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf400/0x5953bbf6b3073d71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073d78 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.143587:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784290334.143601:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd27800/0x5953bbf6b3073d86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073d7f expref: 23 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.143613:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf400/0x5953bbf6b3073d71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073d78 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290334.143626:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784290334.143635:0:19593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290334.143641:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2345ebf400/0x5953bbf6b3073d71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3073d78 expref: -99 pid: 88724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.143665:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290334.143670:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290334.143675:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290334.143700:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2458b62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901070464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290334.143708:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784290334.143727:0:19593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247580b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:3620:x1870961901070080:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290334.143728:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901070336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290334.143757:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00000100:00100000:0.0:1784290334.143766:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290334.143808:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901070208 00000100:00100000:2.0:1784290334.143811:0:19593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901070464 00000100:00100000:1.0:1784290334.143819:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901070208 00000100:00100000:2.0:1784290334.143824:0:19593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901070464 00000100:00100000:1.0:1784290334.143916:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:0.0:1784290334.143937:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:1.0:1784290334.143938:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3617:x1870961901070208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290334.143962:0:19592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784290334.143969:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2458b63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3619:x1870961901070464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290334.143990:0:19592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebfc00/0x5953bbf6b3073e82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073e7b expref: 23 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.143991:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290334.144001:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290334.144020:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd26600/0x5953bbf6b3073d78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073d71 expref: 23 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290334.144034:0:19592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290334.144059:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784290334.144107:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2475809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901070080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290334.144118:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:3617:x1870961901070208:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290334.144134:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:0.0:1784290334.144169:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2458b63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:3619:x1870961901070464:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290334.144197:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290334.144197:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:0.0:1784290334.144245:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901070336 00000100:00100000:0.0:1784290334.144253:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901070336 00000100:00100000:1.0:1784290334.144264:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2458b60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901070208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290334.144313:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:0.0:1784290334.144328:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245818c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:3617:x1870961901070336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290334.144377:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784290334.144391:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2458b62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901070464:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290334.144400:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd26400/0x5953bbf6b3073e51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073e4a expref: 20 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.144417:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784290334.144474:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245818c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:3617:x1870961901070336:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290334.144483:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1784290334.144525:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345cff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901070336:0@lo:103:ldlm_bl.0 00000004:00000080:3.0:1784290334.146325:0:90087:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:1.0:1784290334.146941:0:88725:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182416 is committed 00010000:00010000:0.0:1784290334.147009:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26e00/0x5953bbf6b307421e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.147027:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26e00/0x5953bbf6b307421e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.147038:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26e00/0x5953bbf6b307421e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.147046:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26e00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290334.147053:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26e00/0x5953bbf6b307421e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784290334.147063:0:90087:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1784290334.147075:0:90087:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c246ff1f000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784290334.147100:0:90087:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c24481c7000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1784290334.147106:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26e00/0x5953bbf6b307421e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290334.147109:0:90087:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2343905000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784290334.147131:0:90087:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2458beb800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784290334.147150:0:90087:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2458be9000 bd808cf4-dd54-45f0-9b2b-1434e8330e5d 192.168.202.6@tcp 15 (0 0 7) 0 0 0 2: ffff9c2446e31000 107374182416 stale:0 00000020:00080000:3.0:1784290334.147158:0:90087:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9c23440d0000) has exports, disconnecting them 00000020:00080000:3.0:1784290334.147165:0:90087:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c246ff1f000), last request at 1784290322 00010000:00010000:0.0:1784290334.147165:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2446227c00) 00000020:00000080:3.0:1784290334.147176:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073f70 00010000:00010000:0.0:1784290334.147180:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00080000:3.0:1784290334.147187:0:90087:0:(import.c:65:import_set_state_nolock()) ffff9c246ff18800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1784290334.147192:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26e00/0x5953bbf6b307421e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.147210:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26e00/0x5953bbf6b307421e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290334.147217:0:90087:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c246ff1f000): rc 0 00000020:00000080:3.0:1784290334.147226:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c246ff1f000/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:1.0:1784290334.147243:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784290334.147255:0:90087:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c24481c7000), last request at 1784290332 00010000:00010000:0.0:1784290334.147259:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3074256 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784290334.147265:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073f69 00010000:00010000:0.0:1784290334.147274:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3074256 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784290334.147280:0:90087:0:(import.c:65:import_set_state_nolock()) ffff9c24481c6800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1784290334.147287:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3074256 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.147295:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27e00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290334.147305:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3074256 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784290334.147308:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246ff1f000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:0.0:1784290334.147321:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3074256 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290334.147337:0:90087:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c24481c7000): rc 0 00010000:00010000:0.0:1784290334.147380:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2446227c00) 00010000:00010000:1.0:1784290334.147385:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290334.147387:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290334.147396:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3074256 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784290334.147398:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c24481c7000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1784290334.147412:0:90087:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2343905000), last request at 1784290332 00010000:00010000:0.0:1784290334.147428:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3074256 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784290334.147430:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073f62 00000020:00000080:2.0:1784290334.147448:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246ff18800 for lustre-MDT0000 00000100:00080000:3.0:1784290334.147451:0:90087:0:(import.c:65:import_set_state_nolock()) ffff9c2343907800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1784290334.147467:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c24481c7000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:0.0:1784290334.147478:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ce00/0x5953bbf6b30742aa lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290334.147482:0:90087:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2343905000): rc 0 00000020:00000080:3.0:1784290334.147495:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c2343905000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:1.0:1784290334.147498:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290334.147499:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ce00/0x5953bbf6b30742aa lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.147515:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ce00/0x5953bbf6b30742aa lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290334.147523:0:90087:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2458beb800), last request at 1784290316 00010000:00010000:0.0:1784290334.147529:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5ce00 already unused, calling callback (ffffffffc1aba4f0) 00000020:00000080:2.0:1784290334.147533:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c24481c6800 for lustre-MDT0000 00010000:00010000:0.0:1784290334.147538:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ce00/0x5953bbf6b30742aa lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784290334.147544:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073dcc 00000020:00000080:2.0:1784290334.147545:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343905000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:0.0:1784290334.147554:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ce00/0x5953bbf6b30742aa lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784290334.147567:0:90087:0:(import.c:65:import_set_state_nolock()) ffff9c24481c4800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1784290334.147572:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2442b61600) 00010000:00010000:0.0:1784290334.147579:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290334.147585:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ce00/0x5953bbf6b30742aa lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.147593:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ce00/0x5953bbf6b30742aa lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784290334.147613:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2343907800 for lustre-MDT0000 00010000:00010000:1.0:1784290334.147623:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1784290334.147669:0:90087:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2458beb800): rc 0 00000020:00000080:2.0:1784290334.147676:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c2458beb800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:2.0:1784290334.147701:0:90087:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.6@tcp (ffff9c2458be9000), last request at 1784290333 00000020:00000080:2.0:1784290334.147710:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073dc5 00000020:00010000:2.0:1784290334.147723:0:90087:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2458be9000: total 1 00000020:00000080:1.0:1784290334.147731:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458beb800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000100:00080000:2.0:1784290334.147732:0:90087:0:(import.c:65:import_set_state_nolock()) ffff9c23458df000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784290334.147769:0:90087:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.6@tcp (ffff9c2458be9000): rc 0 00000004:00000080:2.0:1784290334.147782:0:90087:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae5441d3fae0 00000020:00000080:1.0:1784290334.147803:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c24481c4800 for lustre-MDT0000 00000020:00010000:3.0:1784290334.147807:0:19681:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2458be9000: total 0 00000100:00080000:2.0:1784290334.147810:0:90087:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784290334.147816:0:90087:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1784290334.147866:0:19681:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2458be9000, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1784290334.147942:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30742bf lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2336 expref: 8 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.147979:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b30742a3 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2328 expref: 7 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.148010:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b30741ae lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22e2 expref: 6 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.148037:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26800/0x5953bbf6b30742e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2352 expref: 5 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.148071:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5de00/0x5953bbf6b3074328 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2360 expref: 4 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.148102:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30741a7 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22db expref: 3 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.148152:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8200/0x5953bbf6b30741b5 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22e9 expref: 2 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290334.148182:0:19681:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2458be9000, canceled 7 locks, left on hash table 0. 00000100:00080000:2.0:1784290334.151816:0:90087:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1784290334.151845:0:90087:0:(import.c:65:import_set_state_nolock()) ffff9c2474ee5800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1784290334.151956:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901070592:0@lo:39:umount.0 00000100:00100000:1.0:1784290334.152017:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290334.152085:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901070592 00000100:00100000:0.0:1784290334.152096:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901070592 00000100:00080000:2.0:1784290334.152100:0:90087:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784290334.152108:0:90087:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968627 gen 3 00000004:00080000:2.0:1784290334.152133:0:90087:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784290334.152164:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3782 00000100:00100000:0.0:1784290334.152182:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3616:x1870961901070592:12345-0@lo:39:umount.0 00000020:00000080:0.0:1784290334.152230:0:22091:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073e04 00000100:00080000:0.0:1784290334.152240:0:22091:0:(import.c:65:import_set_state_nolock()) ffff9c246ff62800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784290334.152268:0:22091:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378741 00010000:00010000:1.0:1784290334.152286:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784290334.152427:0:90087:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1784290334.152452:0:90087:0:(import.c:65:import_set_state_nolock()) ffff9c246dce3800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1784290334.152478:0:90087:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784290334.152483:0:90087:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968627 gen 3 00000004:00080000:2.0:1784290334.152503:0:90087:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784290334.152506:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3616:x1870961901070592:12345-0@lo:39:umount.0 Request processed in 327us (490us total) trans 81604378742 rc 0/0 00000100:00100000:1.0:1784290334.152511:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247580b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901070720:0@lo:9:umount.0 00000100:00100000:0.0:1784290334.152529:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3782 00000100:00100000:1.0:1784290334.152576:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784290334.152623:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2474ee5800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784290334.152630:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2475809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901070592:0@lo:39:umount.0 00000100:00100000:1.0:1784290334.152661:0:26257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901070720 00000100:00100000:1.0:1784290334.152666:0:26257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901070720 00000100:00080000:0.0:1784290334.152748:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784290334.152755:0:90087:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1784290334.152756:0:26257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4937 00000100:00100000:1.0:1784290334.152779:0:26257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3616:x1870961901070720:12345-0@lo:9:umount.0 00000100:00080000:2.0:1784290334.152783:0:90087:0:(import.c:65:import_set_state_nolock()) ffff9c2474ee7800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:1.0:1784290334.152802:0:26257:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073e20 00000100:00080000:1.0:1784290334.152812:0:26257:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef6800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1784290334.152857:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247580b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901070848:0@lo:9:umount.0 00000001:00000004:1.0:1784290334.152858:0:26257:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968628 00000020:00080000:2.0:1784290334.152939:0:90087:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c23440d0000) has no exports 00000100:00100000:0.0:1784290334.152962:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290334.153037:0:26260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901070848 00000100:00100000:0.0:1784290334.153044:0:26260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901070848 00000100:00100000:1.0:1784290334.153094:0:26257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+2:3616:x1870961901070720:12345-0@lo:9:umount.0 Request processed in 316us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290334.153105:0:26257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4937 00000100:00100000:0.0:1784290334.153125:0:26260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4938 00010000:00010000:1.0:1784290334.153146:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290334.153148:0:26260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2458b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3616:x1870961901070848:12345-0@lo:9:umount.0 00000100:00080000:1.0:1784290334.153178:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dce3800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:0.0:1784290334.153179:0:26260:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073e35 00000004:00080000:1.0:1784290334.153194:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:0.0:1784290334.153198:0:26260:0:(import.c:65:import_set_state_nolock()) ffff9c246dcfe000 : changing import state from FULL to CLOSED 00000004:00080000:1.0:1784290334.153200:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784290334.153209:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247580b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901070720:0@lo:9:umount.0 00010000:00010000:1.0:1784290334.153246:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1784290334.153254:0:26260:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968628 00000100:00080000:1.0:1784290334.153271:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290334.153441:0:26260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2458b63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+2:3616:x1870961901070848:12345-0@lo:9:umount.0 Request processed in 300us (477us total) trans 0 rc 0/0 00000020:00080000:2.0:1784290334.153452:0:90087:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c23440d0000) has no exports 00000100:00100000:0.0:1784290334.153453:0:26260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4938 00000100:00080000:1.0:1784290334.153456:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2474ee7800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1784290334.153474:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1784290334.153479:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784290334.153486:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247580b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901070848:0@lo:9:umount.0 00000020:00000080:3.0:1784290334.199950:0:19681:0:(genops.c:906:class_export_put()) final put ffff9c2458be9000/bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00010000:00010000:3.0:1784290334.199975:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290334.199977:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290334.199981:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784290334.200002:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458be9000/bd808cf4-dd54-45f0-9b2b-1434e8330e5d for lustre-MDT0000 00000020:00000080:1.0:1784290334.200060:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c23458df000 for lustre-MDT0000 00000020:00000080:2.0:1784290334.211314:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073de1 00000020:00000080:2.0:1784290334.211324:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c247e407800/lustre-QMT0000_UUID 00000020:01000000:2.0:1784290334.211338:0:90087:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1784290334.211390:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247e407800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1784290334.211393:0:90087:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784290334.211406:0:90087:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784290334.211410:0:90087:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9c23440d3380) has no exports 00000020:00000080:0.0:1784290334.211578:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073dda 00000020:00000080:0.0:1784290334.211584:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c246d8aa000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784290334.211618:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246d8aa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784290334.211647:0:90087:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290334.211656:0:90087:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1784290334.211659:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c23454bb800/lustre-QMT0000_UUID 00000020:00000080:1.0:1784290334.211661:0:90087:0:(genops.c:865:class_export_destroy()) destroying export ffff9c23454bb800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1784290334.211665:0:90087:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1784290334.211777:0:90087:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2345839d20 - data ffff9c2470a03870/ffff9c245fe7d000 00000020:01000000:1.0:1784290334.211894:0:90087:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c23420e56c0 - data ffff9c247097ebd0/ffff9c24685f5000 00000100:00080000:3.0:1784290334.238819:0:90087:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784290334.238827:0:90087:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784290334.238842:0:90087:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c2475809f80 x1870961901070592/t81604378742(81604378742) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290344 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290334.238865:0:90087:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1784290334.239893:0:90087:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784290334.239896:0:90087:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968627 gen 4 00000004:00080000:3.0:1784290334.239907:0:90087:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784290334.239909:0:90087:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1784290334.240062:0:88741:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1784290334.240069:0:88741:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x64:0x0] index 1 count 1 00000040:00080000:0.0:1784290334.240080:0:88741:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 25 count 2 00000100:00080000:3.0:1784290334.240575:0:90087:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784290334.240578:0:90087:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968627 gen 4 00000004:00080000:3.0:1784290334.240589:0:90087:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784290334.240590:0:90087:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784290334.240715:0:88743:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784290334.240720:0:88743:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x66:0x0] index 1 count 1 00000040:00080000:1.0:1784290334.240729:0:88743:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 25 count 2 00000020:00000080:3.0:1784290334.241291:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073d9b 00000020:00000080:3.0:1784290334.241298:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c2458bea000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784290334.241326:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458bea000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784290334.241866:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073db0 00000020:00000080:3.0:1784290334.241885:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c2458bee800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784290334.241890:0:90087:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1784290334.241895:0:90087:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784290334.241910:0:90087:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00000080:1.0:1784290334.241910:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458bee800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00080000:3.0:1784290334.241923:0:90087:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9c23440d4d40) has no exports 00000004:01000000:3.0:1784290334.242061:0:90087:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1784290334.242067:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073e2e 00000020:00000080:3.0:1784290334.242071:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c246ff62000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784290334.242077:0:90087:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784290334.242080:0:90087:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784290334.242095:0:90087:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:1.0:1784290334.242095:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246ff62000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00080000:3.0:1784290334.242103:0:90087:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9c24581b4d40) has no exports 00000020:00000080:3.0:1784290334.242108:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073e27 00000020:00000080:3.0:1784290334.242112:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c246dce1000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784290334.242126:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dce1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1784290334.242451:0:90087:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784290334.242455:0:90087:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784290334.242457:0:90087:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968627 gen 5 00000004:00080000:3.0:1784290334.242461:0:90087:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784290334.242462:0:90087:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784290334.242480:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2474ee7800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1784290334.242499:0:90087:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784290334.242507:0:90087:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784290334.242510:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c246ff64000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784290334.242512:0:90087:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246ff64000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1784290334.242518:0:90087:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784290334.242571:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073e12 00000020:00000080:3.0:1784290334.242575:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c246ff67800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784290334.242584:0:90087:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784290334.242587:0:90087:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784290334.242592:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246ff67800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1784290334.242593:0:90087:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784290334.242599:0:90087:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9c247d268000) has no exports 00000020:00000080:3.0:1784290334.242603:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073e0b 00000020:00000080:3.0:1784290334.242606:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c246dce5000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784290334.242618:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dce5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1784290334.242925:0:90087:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784290334.242928:0:90087:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784290334.242931:0:90087:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968627 gen 5 00000004:00080000:3.0:1784290334.242940:0:90087:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784290334.242942:0:90087:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784290334.242959:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246dce3800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1784290334.242975:0:90087:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784290334.242983:0:90087:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784290334.242986:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c2344b51800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784290334.242989:0:90087:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2344b51800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1784290334.242994:0:90087:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1784290334.243030:0:90087:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1784290334.243035:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073df6 00000020:00000080:3.0:1784290334.243045:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c2458bec800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784290334.243054:0:90087:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1784290334.243058:0:90087:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784290334.243060:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458bec800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1784290334.243065:0:90087:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784290334.243069:0:90087:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9c247d26b380) has no exports 00000020:00000080:3.0:1784290334.243074:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073def 00000020:00000080:3.0:1784290334.243076:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c2474ee3000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784290334.243089:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2474ee3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1784290334.245177:0:90087:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1784290334.245180:0:90087:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1784290334.245183:0:90087:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784290334.245193:0:90087:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784290334.245213:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2474ee5800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1784290334.245224:0:90087:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784290334.245232:0:90087:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784290334.245235:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c2458bef000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784290334.245238:0:90087:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458bef000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1784290334.245242:0:90087:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784290334.245288:0:90087:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784290334.245293:0:90087:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784290334.245295:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c2458bea800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784290334.245297:0:90087:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458bea800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1784290334.245301:0:90087:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784290334.245367:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073db7 00000020:00000080:3.0:1784290334.245377:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c2458be8800/lustre-MDD0000_UUID 00000020:01000000:3.0:1784290334.245391:0:90087:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1784290334.245395:0:90087:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784290334.245395:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458be8800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1784290334.245403:0:90087:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784290334.245407:0:90087:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9c23440d19c0) has no exports 00000020:00000080:3.0:1784290334.245423:0:90087:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784290334.245426:0:90087:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1784290334.245429:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c2458be9800/lustre-MDD0000_UUID 00000020:00000080:3.0:1784290334.245431:0:90087:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458be9800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1784290334.245436:0:90087:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1784290334.245464:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073dbe 00000020:00000080:3.0:1784290334.245468:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c2458bec000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1784290334.245479:0:90087:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c24444ab000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1784290334.245481:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458bec000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:3.0:1784290334.245483:0:90087:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c24444ab000 3 00000020:01000004:3.0:1784290334.245488:0:90087:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c24444ab000 from lustre-MDT0000 00000020:00000080:3.0:1784290334.245502:0:90087:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784290334.245506:0:90087:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1784290334.245509:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c2458bed800/lustre-MDT0000_UUID 00000020:00000080:3.0:1784290334.245511:0:90087:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458bed800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1784290334.245518:0:90087:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1784290334.245543:0:90087:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1784290334.245546:0:90087:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1784290334.245549:0:90087:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1784290334.245551:0:90087:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784290334.245554:0:90087:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1784290334.245561:0:90087:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c246ff1d800 bdffa268-fb6a-4248-991c-0ad16fac303f 192.168.202.6@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784290334.245574:0:90087:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c2344b55800 2e54cd1c-9dbd-4e31-b60e-998135d46053 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784290334.245579:0:90087:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff9c246ff6cd40) has exports, disconnecting them 00000020:00080000:3.0:1784290334.245583:0:90087:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.6@tcp (ffff9c246ff1d800), last request at 1784290319 00000020:00000080:3.0:1784290334.245600:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073f3f 00000020:00010000:3.0:1784290334.245604:0:90087:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c246ff1d800: total 0 00000100:00080000:3.0:1784290334.245612:0:90087:0:(import.c:65:import_set_state_nolock()) ffff9c246ff1b800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784290334.245624:0:90087:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.6@tcp (ffff9c246ff1d800): rc 0 00000020:00080000:3.0:1784290334.245627:0:90087:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c2344b55800), last request at 1784290316 00000020:00010000:1.0:1784290334.245631:0:6476:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c246ff1d800: total 0 00010000:00010000:1.0:1784290334.245635:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290334.245675:0:6476:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c246ff1d800, canceled 0 locks, left on hash table 4. 00000020:00000080:3.0:1784290334.245678:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073d5c 00000020:00010000:3.0:1784290334.245683:0:90087:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2344b55800: total 0 00000100:00080000:3.0:1784290334.245685:0:90087:0:(import.c:65:import_set_state_nolock()) ffff9c2344b52800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784290334.245696:0:90087:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2344b55800): rc 0 00000020:00080000:3.0:1784290334.245701:0:90087:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9c246ff6cd40) has no exports 00010000:00010000:1.0:1784290334.245706:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebfa00/0x5953bbf6b3073f46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22b8 expref: 5 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:0.0:1784290334.245707:0:6477:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2344b55800: total 0 00010000:00010000:1.0:1784290334.245725:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247d2f4000/0x5953bbf6b3073f54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22c6 expref: 4 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290334.245741:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2482044200/0x5953bbf6b3073f5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22cd expref: 3 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290334.245766:0:88732:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c246d477400:88732] 2 exiting: rc = 0 00010000:00010000:0.0:1784290334.245769:0:6477:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2344b55800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1784290334.245772:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2482045800/0x5953bbf6b3073f4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b22bf expref: 2 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290334.245788:0:6476:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c246ff1d800, canceled 4 locks, left on hash table 0. 00010000:00010000:0.0:1784290334.245798:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c24429dfc00/0x5953bbf6b3073ef2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073eeb expref: 14 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.245821:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b3073ee4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073edd expref: 13 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784290334.245822:0:6476:0:(genops.c:906:class_export_put()) final put ffff9c246ff1d800/bdffa268-fb6a-4248-991c-0ad16fac303f 00010000:00010000:1.0:1784290334.245835:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290334.245838:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290334.245842:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290334.245842:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b3073f00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073ef9 expref: 12 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.245858:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b3073e90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073e89 expref: 11 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.245886:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b3073f0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073f07 expref: 10 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290334.245890:0:88731:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c234303cc00:88731] 1 exiting: rc = 0 00010000:00010000:0.0:1784290334.245899:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c24429dee00/0x5953bbf6b3073e9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073e97 expref: 9 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.245917:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b3073f1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073f15 expref: 8 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.245931:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebf200/0x5953bbf6b3073eac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073ea5 expref: 7 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.245940:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247d2f4800/0x5953bbf6b3073f2a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073f23 expref: 6 pid: 88731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784290334.245950:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246ff1d800/bdffa268-fb6a-4248-991c-0ad16fac303f for MGS 00010000:00010000:0.0:1784290334.245956:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebe200/0x5953bbf6b3073eba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073eb3 expref: 5 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.245967:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247d2f5c00/0x5953bbf6b3073ed6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073ecf expref: 4 pid: 88732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784290334.245979:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246ff1b800 for MGS 00010000:00010000:0.0:1784290334.245988:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3073f38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073f31 expref: 3 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.246000:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b3073ec8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3073ec1 expref: 2 pid: 88729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290334.246009:0:6477:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2344b55800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1784290334.246030:0:6477:0:(genops.c:906:class_export_put()) final put ffff9c2344b55800/2e54cd1c-9dbd-4e31-b60e-998135d46053 00010000:00010000:0.0:1784290334.246042:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290334.246045:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784290334.246051:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2344b55800/2e54cd1c-9dbd-4e31-b60e-998135d46053 for MGS 00010000:00010000:0.0:1784290334.246053:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784290334.246077:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2344b52800 for MGS 00000100:00100000:0.0:1784290334.246097:0:88729:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c2345cc6600:88729] 0 exiting: rc = 1 00000100:00100000:3.0:1784290334.246144:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246155:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246161:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246167:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246173:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246178:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246183:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246189:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246194:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246200:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246205:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246211:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246217:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246222:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246228:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246234:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246240:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246253:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246261:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246266:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246272:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246277:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246283:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246288:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246300:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246306:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246312:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246317:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246322:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246328:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246333:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246338:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246374:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246383:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246390:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246395:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246401:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246407:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246412:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246417:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246422:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246428:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246434:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246440:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246454:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246460:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246466:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246471:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246477:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246482:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246488:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246493:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246498:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246504:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246509:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246514:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246518:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246523:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246529:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246540:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246545:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246551:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246556:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784290334.246562:0:90087:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1784290334.247043:0:90087:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2345ff11e0 - data ffff9c247091d438/ffff9c245fe7ac00 00000020:01000000:3.0:1784290334.247146:0:90087:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2345dd70c0 - data ffff9c23419c41b0/ffff9c246dac0000 00000020:00000080:3.0:1784290334.247526:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073d55 00000020:00000080:3.0:1784290334.247531:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c246dce0800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1784290334.247549:0:90087:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c24444ab000 from MGS, refs=2 00000020:01000004:3.0:1784290334.247552:0:90087:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c24444ab000 2 00000020:00000080:1.0:1784290334.247554:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dce0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:3.0:1784290334.247555:0:90087:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c24444ab000 from MGS 00000020:00000080:3.0:1784290334.247577:0:90087:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784290334.247582:0:90087:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1784290334.247584:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c246dce1800/MGS 00000020:00000080:3.0:1784290334.247586:0:90087:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dce1800/MGS for MGS 00000020:01000000:3.0:1784290334.247591:0:90087:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1784290334.247633:0:90087:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1784290334.247636:0:90087:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784290334.247641:0:90087:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784290334.247645:0:90087:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c247e4b5000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784290334.247649:0:90087:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9c246ff68000) has exports, disconnecting them 00000020:00080000:3.0:1784290334.247652:0:90087:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c247e4b5000), last request at 1784290316 00000020:00000080:3.0:1784290334.247655:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073e6d 00000020:00080000:3.0:1784290334.247664:0:90087:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c247e4b5000): rc 0 00000020:00000080:3.0:1784290334.247667:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c247e4b5000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784290334.247687:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247e4b5000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1784290334.249685:0:90087:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1784290334.249688:0:90087:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784290334.249691:0:90087:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784290334.249694:0:90087:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784290334.249718:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246ff1c000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1784290334.249783:0:90087:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784290334.249794:0:90087:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1784290334.249798:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c247e4b6000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1784290334.249800:0:90087:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247e4b6000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1784290334.249805:0:90087:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1784290334.249835:0:90087:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c24444ab000 1 00000020:00000080:3.0:1784290334.249838:0:90087:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073d47 00000020:00000080:3.0:1784290334.249841:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c246dce2800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1784290334.249851:0:90087:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1784290334.249854:0:90087:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784290334.249856:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dce2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784290334.249858:0:90087:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784290334.249864:0:90087:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9c2445c14d40) has no exports 00000020:00000080:3.0:1784290334.263420:0:90087:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784290334.263425:0:90087:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1784290334.263427:0:90087:0:(genops.c:906:class_export_put()) final put ffff9c24444ae000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784290334.263429:0:90087:0:(genops.c:865:class_export_destroy()) destroying export ffff9c24444ae000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1784290334.263435:0:90087:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1784290334.263494:0:90087:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c24444a8000 00000020:02000400:3.0:1784290334.263522:0:90087:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1784290334.375513:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290334.887563:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901070976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784290334.887659:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290334.887725:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901070976 00000100:00100000:1.0:1784290334.887739:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901070976 00000100:00080000:0.0:1784290334.887800:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290334.887841:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:1.0:1784290334.887857:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d55d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901070976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784290334.887921:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290334.888007:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d55d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901070976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 153us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290334.888019:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:0.0:1784290334.888071:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2475809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901070976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290334.888548:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2458b62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901071104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290334.888613:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290334.888684:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901071104 00000100:00100000:0.0:1784290334.888693:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901071104 00000100:00080000:1.0:1784290334.888742:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290334.888775:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:0.0:1784290334.888786:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901071104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784290334.888835:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290334.888921:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901071104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290334.888931:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:1.0:1784290334.888982:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2458b62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901071104:0@lo:13:osp-pre-1-1.0 00000400:00000100:2.0:1784290335.237999:0:3610:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.6@tcp portal 26 match 1870961896234496 offset 0 length 224: 4 00000100:00100000:2.0:1784290335.238056:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290335.238101:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290335.238135:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290335.238172:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896234624 00000100:00100000:3.0:1784290335.238186:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896234752 00000100:00100000:0.0:1784290335.238188:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896234624 00000100:00100000:2.0:1784290335.238196:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290335.238201:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896234752 00000100:00100000:2.0:1784290335.238251:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896234880 00000100:00100000:2.0:1784290335.238259:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896234880 00000100:00100000:0.0:1784290335.238298:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 676 00000100:00100000:1.0:1784290335.238300:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896235008 00000100:00100000:1.0:1784290335.238310:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896235008 00000100:00100000:3.0:1784290335.238317:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1134 00000100:00100000:0.0:1784290335.238326:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247580b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2399:x1870961896234752:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290335.238327:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1546 00000100:00100000:3.0:1784290335.238332:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247580b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1870961896234624:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290335.238349:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2400:x1870961896234880:12345-192.168.202.6@tcp:400:kworker.0 00000020:00080000:3.0:1784290335.238383:0:65990:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.6@tcp 00000100:00100000:1.0:1784290335.238409:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1547 00000100:00100000:1.0:1784290335.238425:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2399:x1870961896235008:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290335.238460:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247580b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2400:x1870961896234624:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 129us (401us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784290335.238468:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247580b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2399:x1870961896234752:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 148us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290335.238469:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2400:x1870961896234880:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 119us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290335.238488:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1134 00000100:00100000:1.0:1784290335.238489:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2399:x1870961896235008:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 61us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290335.238504:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 676 00000100:00100000:1.0:1784290335.238518:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1547 00000100:00100000:2.0:1784290335.238529:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1546 00000100:00080000:1.0:1784290335.238556:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784290335.238564:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784290335.238569:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784290335.240411:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290335.240547:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896235136 00000100:00100000:1.0:1784290335.240556:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896235136 00000100:00100000:1.0:1784290335.240595:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1135 00000100:00100000:1.0:1784290335.240601:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1870961896235136:12345-192.168.202.6@tcp:38:ptlrpcd_01_01.0 00010000:00020000:1.0:1784290335.240623:0:65989:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784290335.256319:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1870961896235136:12345-192.168.202.6@tcp:38:ptlrpcd_01_01.0 Request processed in 15711us (15909us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784290335.256334:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1135 00010000:00010000:1.0:1784290335.399615:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290336.423506:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290337.447627:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1870961901071616:0@lo:400:kworker.0 00000100:00100000:1.0:1784290337.447637:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2458b60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901071488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290337.447642:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901071232:0@lo:400:kworker.0 00000400:00000100:2.0:1784290337.447756:0:3618:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870961901071232 offset 0 length 224: 4 00000100:00100000:0.0:1784290337.447771:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290337.447774:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290337.447817:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1870961901071360:0@lo:400:kworker.0 00000100:00100000:2.0:1784290337.447838:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1870961901071744:0@lo:400:kworker.0 00000100:00100000:1.0:1784290337.447875:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901072128:0@lo:400:kworker.0 00000100:00100000:0.0:1784290337.447879:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901072000:0@lo:400:kworker.0 00000100:00100000:3.0:1784290337.447910:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290337.447985:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290337.447993:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290337.448001:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290337.448011:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901071872:0@lo:400:kworker.0 00000100:00100000:2.0:1784290337.448060:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901072256:0@lo:400:kworker.0 00000100:00100000:0.0:1784290337.448063:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901071488 00000100:00100000:0.0:1784290337.448075:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901071488 00000100:00100000:3.0:1784290337.448093:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784290337.448094:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290337.448117:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290337.448139:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901072000 00000100:00100000:0.0:1784290337.448144:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901072000 00000100:00100000:1.0:1784290337.448165:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901071616 00000100:00100000:1.0:1784290337.448178:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901071616 00000100:00100000:3.0:1784290337.448185:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961901072384:0@lo:400:kworker.0 00000100:00100000:0.0:1784290337.448195:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3783 00000100:00100000:2.0:1784290337.448201:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901072128 00000100:00100000:0.0:1784290337.448209:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3617:x1870961901071488:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290337.448211:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901072128 00000020:00080000:0.0:1784290337.448226:0:8412:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784290337.448242:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290337.448292:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1784290337.448293:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901072256 00000100:00100000:2.0:1784290337.448300:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901072256 00000100:00100000:0.0:1784290337.448313:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3617:x1870961901071488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (544us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784290337.448315:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2458b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1870961901071616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290337.448332:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3784 00000100:00100000:3.0:1784290337.448382:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3620:x1870961901072000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290337.448401:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3783 00000020:00080000:3.0:1784290337.448402:0:8413:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784290337.448413:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1548 00000100:00100000:2.0:1784290337.448434:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901072128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290337.448466:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901071360 00000100:00100000:1.0:1784290337.448470:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2458b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1870961901071616:12345-0@lo:400:kworker.0 Request processed in 161us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290337.448474:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901071360 00000100:00100000:3.0:1784290337.448488:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3620:x1870961901072000:12345-0@lo:400:kworker.0 Request processed in 140us (510us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784290337.448489:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1784290337.448510:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3784 00000100:00100000:0.0:1784290337.448519:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901071744 00000100:00100000:2.0:1784290337.448524:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901072128:12345-0@lo:400:kworker.0 Request processed in 94us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290337.448526:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901071744 00000100:00100000:1.0:1784290337.448538:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901071872 00000100:00100000:1.0:1784290337.448547:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901071872 00000100:00100000:2.0:1784290337.448549:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1548 00000100:00100000:0.0:1784290337.448557:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901072384 00000100:00100000:0.0:1784290337.448566:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901072384 00000100:00100000:3.0:1784290337.448567:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:3.0:1784290337.448582:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1870961901071360:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1784290337.448594:0:65988:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784290337.448613:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1784290337.448614:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1549 00000100:00100000:0.0:1784290337.448629:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:1.0:1784290337.448638:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901071872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290337.448641:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901072256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290337.448654:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3618:x1870961901071744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290337.448656:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1870961901071360:12345-0@lo:400:kworker.0 Request processed in 63us (737us total) trans 0 rc -107/-107 00000020:00080000:0.0:1784290337.448673:0:66008:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784290337.448682:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:1.0:1784290337.448731:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901071872:12345-0@lo:400:kworker.0 Request processed in 100us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290337.448733:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:2.0:1784290337.448750:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901072256:12345-0@lo:400:kworker.0 Request processed in 118us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290337.448758:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:3.0:1784290337.448762:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1870961901072384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290337.448769:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3618:x1870961901071744:12345-0@lo:400:kworker.0 Request processed in 118us (784us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784290337.448805:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1549 00000020:00080000:3.0:1784290337.448807:0:65988:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784290337.448817:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00080000:1.0:1784290337.448913:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784290337.448921:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00080000:2.0:1784290337.448930:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:02000400:1.0:1784290337.448931:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1784290337.448933:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3619:x1870961901072384:12345-0@lo:400:kworker.0 Request processed in 173us (686us total) trans 0 rc -107/-107 00000100:00080000:2.0:1784290337.448943:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784290337.448947:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290337.448954:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784290337.448956:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00080000:1.0:1784290337.448960:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2063 00000100:00100000:0.0:1784290337.448973:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901072128:0@lo:400:kworker.0 00000100:00080000:1.0:1784290337.448974:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:02020000:0.0:1784290337.449002:0:3617:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1784290337.449011:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784290337.449017:0:3617:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9c246dd98000 already not connected (conn 37, was 36): CONNECTING 00000100:00100000:1.0:1784290337.449020:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2345b75880 x1870961901072512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784290337.449033:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784290337.449044:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:2.0:1784290337.449046:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901072256:0@lo:400:kworker.0 00000100:02000400:3.0:1784290337.449057:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784290337.449064:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1784290337.449067:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901072000:0@lo:400:kworker.0 00000100:00080000:2.0:1784290337.449076:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784290337.449088:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:0.0:1784290337.449088:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901072512:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1784290337.449089:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2063 00000100:02000400:2.0:1784290337.449106:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784290337.449107:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00080000:2.0:1784290337.449121:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290337.449128:0:3618:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2063 00000100:00100000:1.0:1784290337.449134:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1870961901071616:0@lo:400:kworker.0 00000100:00080000:2.0:1784290337.449142:0:3618:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290337.449149:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2345c26d80 x1870961901072640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290337.449158:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290337.449182:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2468793800 x1870961901072768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784290337.449191:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1870961901071360:0@lo:400:kworker.0 00000100:00100000:0.0:1784290337.449209:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901072640:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1784290337.449221:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1870961901071744:0@lo:400:kworker.0 00000100:00100000:1.0:1784290337.449234:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901072512 00000100:00100000:3.0:1784290337.449236:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901071872:0@lo:400:kworker.0 00000100:00100000:1.0:1784290337.449247:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901072512 00000100:00100000:0.0:1784290337.449259:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784290337.449270:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784290337.449276:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784290337.449282:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1784290337.449288:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784290337.449295:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2063 00000100:00080000:3.0:1784290337.449306:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290337.449307:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3785 00000100:00100000:0.0:1784290337.449319:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901072768:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1784290337.449329:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901072512:12345-0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1784290337.449339:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2345c24700 x1870961901072896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290337.449388:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901072640 00000100:00100000:3.0:1784290337.449396:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961901072384:0@lo:400:kworker.0 00000100:00100000:2.0:1784290337.449399:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901072640 00010000:00020000:1.0:1784290337.449403:0:8412:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290337.449414:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290337.449445:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901072768 00000100:00100000:2.0:1784290337.449451:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901072768 00000100:00100000:0.0:1784290337.449482:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901072896:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1784290337.449500:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:1.0:1784290337.449500:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901072512:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 167us (344us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784290337.449524:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:1.0:1784290337.449527:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3785 00000100:00100000:2.0:1784290337.449528:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901072640:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1784290337.449538:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290337.449548:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901072768:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1784290337.449571:0:65990:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:3.0:1784290337.449576:0:66004:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784290337.449583:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901072896 00000100:00080000:0.0:1784290337.449594:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1784290337.449595:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901072896 00000100:00080000:0.0:1784290337.449606:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290337.449613:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901072512:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1784290337.449659:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1784290337.449661:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00080000:0.0:1784290337.449672:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784290337.449674:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901072640:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 151us (413us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784290337.449682:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901072768:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 132us (269us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784290337.449689:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901072896:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1784290337.449690:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901072640:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1784290337.449710:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00100000:3.0:1784290337.449726:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00010000:00020000:1.0:1784290337.449736:0:65989:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1784290337.449739:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290337.449747:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290337.449755:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901072768:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1784290337.449901:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901072896:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 214us (366us total) trans 0 rc -19/-19 00000100:00080000:0.0:1784290337.449905:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290337.449917:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290337.449925:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901072896:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1784290337.449934:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1784290337.799154:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290337.799210:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290337.799261:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896235392 00000100:00100000:0.0:1784290337.799278:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896235392 00000100:00100000:1.0:1784290337.799323:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896235264 00000100:00100000:1.0:1784290337.799336:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896235264 00000100:00080000:2.0:1784290337.799431:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:1.0:1784290337.799433:0:8407:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x702:0x0] (1048576->2097151) req@ffff9c2345c27800 x1870961896235264/t0(0) o4->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:358/0 lens 488/0 e 0 to 0 dl 1784290348 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784290337.799454:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345c27800 with x1870961896235264 ext(1048576->2097151) 00000100:00100000:0.0:1784290337.799464:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4939 00002000:00010000:1.0:1784290337.799469:0:8407:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c2345c27800 00000100:00100000:0.0:1784290337.799492:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2397:x1870961896235392:12345-192.168.202.6@tcp:16:kworker.0 00000100:00100000:1.0:1784290337.799523:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 354 00000100:00100000:1.0:1784290337.799549:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2398:x1870961896235264:12345-192.168.202.6@tcp:4:md5sum.0 00000001:00100000:3.0:1784290337.801487:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784290337.801496:0:9482:0:(genops.c:906:class_export_put()) final put ffff9c246dcfb800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1784290337.801531:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968628 is committed 00000020:00000080:0.0:1784290337.801579:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dcfb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1784290337.801661:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246dcfe000 for lustre-OST0001 00000100:00100000:2.0:1784290337.801769:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2397:x1870961896235392:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 2284us (2620us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290337.801784:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4939 00000100:00100000:1.0:1784290337.810045:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2398:x1870961896235264:12345-192.168.202.6@tcp:4:md5sum.0 Request processed in 10504us (10831us total) trans 4294968629 rc 0/0 00000100:00100000:1.0:1784290337.810056:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 354 00002000:00100000:1.0:1784290337.810066:0:8407:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x702:0x0] (1048576->2097151) req@ffff9c2345c27800 x1870961896235264/t4294968629(0) o4->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:358/0 lens 488/448 e 0 to 0 dl 1784290348 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784290337.810076:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345c27800 with x1870961896235264 ext(1048576->2097151) 00002000:00010000:1.0:1784290337.810081:0:8407:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c2345c27800 00010000:00010000:1.0:1784290338.471610:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784290338.473170:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784290338.473186:0:8397:0:(genops.c:906:class_export_put()) final put ffff9c2342ef3800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1784290338.473216:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968628 is committed 00000020:00000080:0.0:1784290338.473307:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2342ef3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1784290338.473400:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2342ef6800 for lustre-OST0000 00010000:00010000:1.0:1784290339.495656:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784290339.496245:0:75386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1784290339.496257:0:75386:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378742 is committed 00000020:00000080:3.0:1784290339.496263:0:75386:0:(genops.c:906:class_export_put()) final put ffff9c24506b5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784290339.496336:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c24506b5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1784290339.496420:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246ff62800 for lustre-MDT0001 00000100:00100000:0.0:1784290340.007629:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901073024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290340.007630:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901073152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784290340.007748:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290340.007814:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290340.007935:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901073024 00000100:00100000:2.0:1784290340.007950:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901073024 00000100:00100000:3.0:1784290340.007955:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901073152 00000100:00100000:3.0:1784290340.007976:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901073152 00000100:00080000:1.0:1784290340.008040:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784290340.008049:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784290340.008081:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:2.0:1784290340.008097:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:3.0:1784290340.008107:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901073152:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290340.008121:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901073024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784290340.008160:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17087424 pending 1073152 free 3922481152 avail 3690958848 00002000:00000024:3.0:1784290340.008161:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784290340.008260:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901073024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 146us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290340.008279:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345b75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901073152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 176us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290340.008279:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00100000:3.0:1784290340.008300:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:0.0:1784290340.008337:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2475c7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901073024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290340.008396:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901073152:0@lo:13:osp-pre-0-1.0 00000400:00000100:3.0:1784290340.357926:0:3610:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.6@tcp portal 26 match 1870961896235520 offset 0 length 224: 4 00000100:00100000:3.0:1784290340.357981:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290340.358028:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290340.358075:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290340.358094:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896235904 00000100:00100000:1.0:1784290340.358111:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896235904 00000100:00100000:2.0:1784290340.358135:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896235776 00000100:00100000:3.0:1784290340.358146:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290340.358148:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896235776 00000100:00100000:0.0:1784290340.358200:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896235648 00000100:00100000:0.0:1784290340.358212:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896235648 00000100:00100000:1.0:1784290340.358226:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896236032 00000100:00100000:1.0:1784290340.358235:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896236032 00000100:00100000:3.0:1784290340.358241:0:26254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1550 00000100:00100000:2.0:1784290340.358249:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 679 00000100:00100000:2.0:1784290340.358274:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2399:x1870961896235776:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290340.358275:0:26254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2400:x1870961896235904:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290340.358285:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1142 00000100:00100000:1.0:1784290340.358301:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1551 00000100:00100000:0.0:1784290340.358307:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1870961896235648:12345-192.168.202.6@tcp:38:kworker.0 00000100:00100000:1.0:1784290340.358325:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2399:x1870961896236032:12345-192.168.202.6@tcp:400:kworker.0 00010000:00020000:0.0:1784290340.358390:0:66008:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784290340.358463:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2399:x1870961896236032:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 140us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290340.358465:0:26254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2400:x1870961896235904:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 194us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290340.358465:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2399:x1870961896235776:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 190us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290340.358467:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1870961896235648:12345-192.168.202.6@tcp:38:kworker.0 Request processed in 162us (392us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784290340.358499:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1551 00000100:00100000:2.0:1784290340.358509:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 679 00000100:00100000:3.0:1784290340.358512:0:26254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1550 00000100:00100000:0.0:1784290340.358525:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1142 00000100:00080000:1.0:1784290340.358541:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784290340.358553:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784290340.358573:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784290340.519640:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290341.543524:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290342.567592:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784290342.567611:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290342.567618:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290342.567623:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290342.567632:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2078 00000100:00080000:1.0:1784290342.567639:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784290342.567646:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290342.567652:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901073280:0@lo:400:kworker.0 00000100:00100000:1.0:1784290342.567690:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c245fe39f80 x1870961901073408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:3.0:1784290342.567736:0:3618:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870961901073280 offset 0 length 224: 4 00000100:00080000:1.0:1784290342.567742:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290342.567748:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290342.567751:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290342.567756:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2078 00000100:00080000:1.0:1784290342.567760:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784290342.567766:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290342.567768:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1870961901073536:0@lo:400:kworker.0 00000100:00100000:1.0:1784290342.567787:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c245fe3b100 x1870961901073664/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290342.567811:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901073408:0@lo:38:kworker.0 00000100:00080000:1.0:1784290342.567846:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290342.567853:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290342.567856:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784290342.567861:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784290342.567866:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2078 00000100:00100000:3.0:1784290342.567868:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1870961901073792:0@lo:400:kworker.0 00000100:00080000:1.0:1784290342.567872:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784290342.567881:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290342.567900:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c245f7ef480 x1870961901073920/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290342.567922:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290342.567957:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901073536 00000100:00100000:3.0:1784290342.567967:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901073536 00000100:00100000:0.0:1784290342.567970:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901073408 00000100:00080000:1.0:1784290342.567974:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1784290342.567978:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901073408 00000100:00080000:1.0:1784290342.567980:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290342.567986:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1784290342.567992:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901073664:0@lo:38:kworker.0 00000100:00080000:1.0:1784290342.567992:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2078 00000100:00080000:1.0:1784290342.567998:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784290342.568009:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290342.568027:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2343891500 x1870961901074304/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290342.568032:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1784290342.568053:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:0.0:1784290342.568060:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1870961901073536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290342.568062:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290342.568071:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901073408:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784290342.568089:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901074048:0@lo:400:kworker.0 00010000:00020000:3.0:1784290342.568094:0:74876:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784290342.568100:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245f7ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901073920:0@lo:38:kworker.0 00000100:00100000:0.0:1784290342.568151:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1870961901073536:12345-0@lo:400:kworker.0 Request processed in 104us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290342.568162:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:3.0:1784290342.568172:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901073408:12345-0@lo:38:kworker.0 Request processed in 104us (256us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784290342.568186:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290342.568188:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290342.568189:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901073664 00000100:00100000:3.0:1784290342.568193:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:0.0:1784290342.568197:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901073664 00000100:00100000:3.0:1784290342.568224:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:3.0:1784290342.568233:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901073664:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784290342.568244:0:74876:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784290342.568245:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784290342.568258:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901074176:0@lo:400:kworker.0 00000100:00080000:2.0:1784290342.568264:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290342.568272:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290342.568285:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1870961901073536:0@lo:400:kworker.0 00000100:00100000:2.0:1784290342.568290:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901073408:0@lo:38:kworker.0 00000100:00100000:3.0:1784290342.568308:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901073664:12345-0@lo:38:kworker.0 Request processed in 70us (251us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784290342.568319:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290342.568325:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901074304:0@lo:38:kworker.0 00000100:00100000:3.0:1784290342.568327:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:0.0:1784290342.568401:0:26263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901074048 00000100:00100000:0.0:1784290342.568406:0:26263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901074048 00000100:00100000:1.0:1784290342.568415:0:26259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901074176 00000100:00100000:1.0:1784290342.568423:0:26259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901074176 00000100:00100000:2.0:1784290342.568428:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290342.568462:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901073920 00000100:00100000:0.0:1784290342.568467:0:26263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1552 00000100:00100000:3.0:1784290342.568471:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901073920 00000100:00100000:1.0:1784290342.568483:0:26259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1553 00000100:00100000:0.0:1784290342.568486:0:26263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901074048:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784290342.568492:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290342.568502:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784290342.568504:0:26259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901074176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290342.568511:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901073664:0@lo:38:kworker.0 00000100:00100000:3.0:1784290342.568513:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3786 00000100:00100000:3.0:1784290342.568528:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901073920:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784290342.568540:0:8413:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290342.568555:0:26263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901074048:12345-0@lo:400:kworker.0 Request processed in 76us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290342.568566:0:26263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1552 00000100:00100000:2.0:1784290342.568569:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901074304 00000100:00100000:2.0:1784290342.568575:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901074304 00000100:00100000:1.0:1784290342.568579:0:26259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901074176:12345-0@lo:400:kworker.0 Request processed in 83us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290342.568589:0:26259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1553 00000100:00100000:3.0:1784290342.568609:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901073920:12345-0@lo:38:kworker.0 Request processed in 78us (432us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784290342.568619:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3786 00000100:00100000:0.0:1784290342.568625:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:0.0:1784290342.568636:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901074304:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784290342.568652:0:66004:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784290342.568658:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901074176:0@lo:400:kworker.0 00000100:00100000:2.0:1784290342.568669:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290342.568692:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901074048:0@lo:400:kworker.0 00000100:00080000:3.0:1784290342.568699:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1784290342.568715:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901074304:12345-0@lo:38:kworker.0 Request processed in 76us (286us total) trans 0 rc -19/-19 00000100:00080000:3.0:1784290342.568718:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784290342.568730:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901073792 00000100:00100000:3.0:1784290342.568731:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245f7ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901073920:0@lo:38:kworker.0 00000100:00100000:0.0:1784290342.568736:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:2.0:1784290342.568739:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901073792 00000100:00080000:1.0:1784290342.568764:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784290342.568773:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784290342.568778:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784290342.568784:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00080000:1.0:1784290342.568810:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784290342.568816:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901074304:0@lo:38:kworker.0 00000100:00100000:2.0:1784290342.568824:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:2.0:1784290342.568838:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1870961901073792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290342.568901:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1870961901073792:12345-0@lo:400:kworker.0 Request processed in 68us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290342.568908:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:3.0:1784290342.568941:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1870961901073792:0@lo:400:kworker.0 00010000:00010000:1.0:1784290343.591965:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784290343.593292:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968629 is committed 00010000:00010000:1.0:1784290344.615742:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290345.127691:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475c7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901074432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784290345.127735:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a48ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901074560:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290345.127852:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290345.127927:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290345.127974:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901074432 00000100:00100000:0.0:1784290345.128006:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901074432 00000100:00100000:2.0:1784290345.128069:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901074560 00000100:00100000:2.0:1784290345.128082:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901074560 00000100:00100000:0.0:1784290345.128117:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00080000:1.0:1784290345.128124:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784290345.128138:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290345.128141:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901074432:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784290345.128176:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00002000:00000024:0.0:1784290345.128185:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784290345.128199:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901074560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784290345.128236:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290345.128289:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901074432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 154us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290345.128301:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:3.0:1784290345.128337:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901074560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 144us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290345.128392:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:1.0:1784290345.128417:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2475c7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901074432:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784290345.128458:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a48ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901074560:0@lo:13:osp-pre-0-1.0 00000400:00000100:3.0:1784290345.477720:0:3612:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.6@tcp portal 26 match 1870961896236160 offset 0 length 224: 4 00000100:00100000:3.0:1784290345.477800:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290345.477848:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290345.477880:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290345.477921:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896236288 00000100:00100000:3.0:1784290345.477938:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290345.477939:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896236288 00000100:00100000:0.0:1784290345.477942:0:26260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896236544 00000100:00100000:0.0:1784290345.477956:0:26260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896236544 00000100:00100000:2.0:1784290345.478007:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896236416 00000100:00100000:2.0:1784290345.478016:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896236416 00000100:00100000:3.0:1784290345.478025:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1146 00000100:00100000:0.0:1784290345.478045:0:26260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896236672 00000100:00100000:3.0:1784290345.478047:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245f7ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1870961896236288:12345-192.168.202.6@tcp:38:kworker.0 00000100:00100000:0.0:1784290345.478054:0:26260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896236672 00000100:00100000:2.0:1784290345.478084:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 682 00010000:00020000:3.0:1784290345.478090:0:65989:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784290345.478111:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2400:x1870961896236416:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290345.478122:0:26260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1554 00000100:00100000:0.0:1784290345.478143:0:26260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2400:x1870961896236544:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290345.478180:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245f7ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1870961896236288:12345-192.168.202.6@tcp:38:kworker.0 Request processed in 136us (327us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290345.478204:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447ae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2400:x1870961896236416:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 96us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290345.478224:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1146 00000100:00100000:0.0:1784290345.478226:0:26260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2400:x1870961896236544:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 78us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290345.478260:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 682 00000100:00100000:0.0:1784290345.478261:0:26260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1554 00000100:00100000:3.0:1784290345.478288:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1555 00000100:00100000:3.0:1784290345.478307:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2400:x1870961896236672:12345-192.168.202.6@tcp:400:kworker.0 00000100:00080000:0.0:1784290345.478319:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784290345.478328:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784290345.478333:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784290345.478412:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2400:x1870961896236672:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 111us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290345.478428:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1555 00010000:00010000:1.0:1784290345.640533:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290346.663485:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290347.687471:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784290347.687480:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290347.687487:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290347.687491:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290347.687501:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2083 00000100:00100000:2.0:1784290347.687507:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901074688:0@lo:400:kworker.0 00000100:00080000:1.0:1784290347.687508:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784290347.687518:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290347.687542:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2343892d80 x1870961901074816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:2.0:1784290347.687567:0:3617:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870961901074688 offset 0 length 224: 4 00000100:00080000:1.0:1784290347.687575:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290347.687579:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290347.687581:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290347.687585:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2083 00000100:00080000:1.0:1784290347.687589:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00100000:0.0:1784290347.687593:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901074816:0@lo:38:kworker.0 00000100:00080000:1.0:1784290347.687594:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290347.687611:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2447b95f80 x1870961901075072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290347.687621:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784290347.687634:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901074944:0@lo:400:kworker.0 00000100:00080000:1.0:1784290347.687636:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290347.687647:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290347.687650:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784290347.687656:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784290347.687657:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2083 00000100:00080000:1.0:1784290347.687663:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784290347.687667:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290347.687682:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2447b94700 x1870961901075328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290347.687703:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784290347.687710:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1784290347.687714:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901075072:0@lo:38:kworker.0 00000100:00080000:1.0:1784290347.687715:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290347.687728:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290347.687735:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2083 00000100:00080000:1.0:1784290347.687738:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784290347.687741:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290347.687763:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901075584:0@lo:400:kworker.0 00000100:00100000:1.0:1784290347.687768:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2445d11c00 x1870961901075712/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290347.687786:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290347.687793:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901075200:0@lo:400:kworker.0 00000100:00100000:2.0:1784290347.687808:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290347.687821:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901075328:0@lo:38:kworker.0 00000100:00100000:1.0:1784290347.687835:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290347.687865:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901074816 00000100:00100000:1.0:1784290347.687868:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784290347.687868:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290347.687874:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901074816 00000100:00100000:1.0:1784290347.687877:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901075456:0@lo:400:kworker.0 00000100:00100000:1.0:1784290347.687908:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290347.687916:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901074944 00000100:00100000:2.0:1784290347.687921:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901074944 00000100:00100000:0.0:1784290347.687922:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901075712:0@lo:38:kworker.0 00000100:00100000:1.0:1784290347.687951:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901075072 00000100:00100000:1.0:1784290347.687956:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901075072 00000100:00100000:0.0:1784290347.687968:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290347.687969:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901075200 00000100:00100000:2.0:1784290347.687975:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901075200 00000100:00100000:1.0:1784290347.687980:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901075712 00000100:00100000:1.0:1784290347.687984:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901075712 00000100:00100000:1.0:1784290347.688012:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:1.0:1784290347.688024:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901074944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290347.688026:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:2.0:1784290347.688041:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901075200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290347.688042:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:0.0:1784290347.688056:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901074816:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784290347.688075:0:65989:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784290347.688087:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901074944:12345-0@lo:400:kworker.0 Request processed in 67us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290347.688095:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:2.0:1784290347.688111:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901075200:12345-0@lo:400:kworker.0 Request processed in 74us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290347.688118:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1784290347.688129:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:1.0:1784290347.688130:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901075072:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290347.688137:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901074816:12345-0@lo:38:kworker.0 Request processed in 78us (482us total) trans 0 rc -19/-19 00010000:00020000:1.0:1784290347.688146:0:74876:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290347.688151:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1784290347.688159:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:2.0:1784290347.688167:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901075712:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784290347.688176:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901075072:12345-0@lo:38:kworker.0 Request processed in 51us (393us total) trans 0 rc -19/-19 00010000:00020000:2.0:1784290347.688183:0:66008:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784290347.688184:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00080000:0.0:1784290347.688199:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290347.688206:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290347.688213:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901075072:0@lo:38:kworker.0 00000100:00100000:1.0:1784290347.688225:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901075328 00000100:00100000:1.0:1784290347.688230:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901075328 00000100:00100000:2.0:1784290347.688239:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901075712:12345-0@lo:38:kworker.0 Request processed in 69us (271us total) trans 0 rc -19/-19 00000100:00080000:0.0:1784290347.688243:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1784290347.688249:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00080000:0.0:1784290347.688252:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784290347.688253:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3787 00000100:00100000:1.0:1784290347.688265:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901075328:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290347.688265:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901074816:0@lo:38:kworker.0 00010000:00020000:1.0:1784290347.688281:0:8412:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784290347.688288:0:15642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901075584 00000100:00100000:2.0:1784290347.688295:0:15642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901075584 00000100:00080000:0.0:1784290347.688309:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1784290347.688318:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901075328:12345-0@lo:38:kworker.0 Request processed in 54us (451us total) trans 0 rc -19/-19 00000100:00080000:0.0:1784290347.688318:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290347.688328:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901075712:0@lo:38:kworker.0 00000100:00100000:2.0:1784290347.688330:0:15642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901075456 00000100:00100000:1.0:1784290347.688330:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3787 00000100:00100000:2.0:1784290347.688337:0:15642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901075456 00000100:00080000:0.0:1784290347.688386:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1784290347.688387:0:26251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1556 00000100:00080000:0.0:1784290347.688395:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784290347.688402:0:26251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901075584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290347.688403:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901075328:0@lo:38:kworker.0 00000100:00100000:2.0:1784290347.688413:0:15642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1557 00000100:00100000:2.0:1784290347.688425:0:15642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901075456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290347.688443:0:26251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901075584:12345-0@lo:400:kworker.0 Request processed in 45us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290347.688449:0:26251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1556 00000100:00100000:2.0:1784290347.688481:0:15642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901075456:12345-0@lo:400:kworker.0 Request processed in 58us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290347.688491:0:15642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1557 00000100:00100000:0.0:1784290347.688494:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901075456:0@lo:400:kworker.0 00000100:00100000:0.0:1784290347.688519:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901075200:0@lo:400:kworker.0 00000100:00100000:1.0:1784290347.688527:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901075584:0@lo:400:kworker.0 00000100:00080000:3.0:1784290347.688528:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784290347.688537:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784290347.688542:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784290347.688547:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901074944:0@lo:400:kworker.0 00010000:00010000:0.0:1784290348.712436:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784290349.634517:0:90704:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784290349.634522:0:90704:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1784290349.634524:0:90704:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1784290349.634627:0:90704:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9c247036f800 00000020:01000004:0.0:1784290349.634642:0:90704:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1784290349.634660:0:90704:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784290349.634678:0:90704:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c247d2699c0) 00000020:00000080:0.0:1784290349.634706:0:90704:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1784290349.693000:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1784290349.693675:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1784290349.696255:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1784290349.697379:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1784290349.697559:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1784290349.697760:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1784290349.697919:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1784290349.698079:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1784290349.698238:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1784290349.698404:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1784290349.698554:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1784290349.698720:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1784290349.698903:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1784290349.699065:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1784290349.699215:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1784290349.699371:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1784290349.699534:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1784290349.699692:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1784290349.699867:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1784290349.700023:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1784290349.700186:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1784290349.700381:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1784290349.700530:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1784290349.700694:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1784290349.700878:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1784290349.701042:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1784290349.701196:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1784290349.701378:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1784290349.701578:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1784290349.701779:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1784290349.701947:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1784290349.702117:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1784290349.702290:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1784290349.702487:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1784290349.702642:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1784290349.703294:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1784290349.703463:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1784290349.703764:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1784290349.703937:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1784290349.704099:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1784290349.704295:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1784290349.704504:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1784290349.704642:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1784290349.704807:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1784290349.704964:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1784290349.705120:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1784290349.705273:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1784290349.705828:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1784290349.706107:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1784290349.706268:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1784290349.706564:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1784290349.706764:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1784290349.706954:0:90704:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:0.0:1784290349.707452:0:90704:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1784290349.707650:0:90704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1784290349.707658:0:90704:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:0.0:1784290349.707669:0:90704:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3074352 00000020:01000004:0.0:1784290349.707676:0:90704:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1784290349.707688:0:90704:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1784290349.707693:0:90704:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c247036f800 from MGS 00000020:01000004:0.0:1784290349.707697:0:90704:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1784290349.707707:0:90704:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c247d26b380) 00000020:00000080:0.0:1784290349.707719:0:90704:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:0.0:1784290349.707794:0:90704:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c247036f800 from MGS, refs=2 00080000:01000000:0.0:1784290349.707799:0:90704:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784290349.707805:0:90704:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3074360 00010000:00010000:0.0:1784290349.707927:0:90704:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1784290349.710531:0:90704:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1784290349.711069:0:90708:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1784290349.711087:0:90704:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1784290349.711128:0:90704:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784290349.711546:0:90704:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1784290349.711925:0:90704:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784290349.712077:0:90704:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1784290349.712082:0:90704:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1784290349.712435:0:90704:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1784290349.712443:0:90704:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1784290349.712624:0:90704:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1784290349.712632:0:90704:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1784290349.713020:0:90704:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1784290349.713040:0:90704:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1784290349.713042:0:90704:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.106@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1784290349.713045:0:90704:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.106@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:0.0:1784290349.713051:0:90704:0:(import.c:65:import_set_state_nolock()) ffff9c2447cad800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1784290349.713057:0:90704:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1784290349.713068:0:90704:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.106@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1784290349.713071:0:90704:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1784290349.713079:0:90704:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2345c25180 x1870961901071232/t0(0) o400->MGC192.168.202.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784290353 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290349.713103:0:90704:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c245fe38700 x1870961901073280/t0(0) o400->MGC192.168.202.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784290358 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290349.713116:0:90704:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2343891500 x1870961901074688/t0(0) o400->MGC192.168.202.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784290363 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1784290349.713132:0:90704:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1784290349.713136:0:90704:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1784290349.713137:0:90704:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1784290349.713141:0:90704:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:1.0:1784290349.713142:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901073280:0@lo:400:kworker.0 00000100:00100000:1.0:1784290349.713159:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901071232:0@lo:400:kworker.0 00000100:00100000:2.0:1784290349.713188:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901074688:0@lo:400:kworker.0 10000000:01000000:0.0:1784290349.713214:0:90704:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1784290349.713226:0:90704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c24429de800/0x5953bbf6b3073f23 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073f2a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290349.713235:0:90704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c24429de800/0x5953bbf6b3073f23 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073f2a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290349.713240:0:90704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1784290349.713252:0:90704:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784290349.713260:0:90704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c24429de800/0x5953bbf6b3073f23 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073f2a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.713282:0:90704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5800/0x5953bbf6b3073e89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073e90 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290349.713288:0:90704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5800/0x5953bbf6b3073e89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073e90 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290349.713292:0:90704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784290349.713306:0:90704:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784290349.713312:0:90704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5800/0x5953bbf6b3073e89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073e90 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.713325:0:90704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c24429dfe00/0x5953bbf6b3073ea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073eac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290349.713331:0:90704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c24429dfe00/0x5953bbf6b3073ea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073eac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290349.713334:0:90704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784290349.713364:0:90704:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784290349.713368:0:90704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c24429dfe00/0x5953bbf6b3073ea5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073eac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.713380:0:90704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe400/0x5953bbf6b3073ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073ed6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290349.713386:0:90704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe400/0x5953bbf6b3073ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073ed6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290349.713390:0:90704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784290349.713400:0:90704:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784290349.713406:0:90704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2345ebe400/0x5953bbf6b3073ecf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073ed6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.713415:0:90704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5200/0x5953bbf6b3073edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073ee4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290349.713421:0:90704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5200/0x5953bbf6b3073edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073ee4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290349.713433:0:90704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784290349.713442:0:90704:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784290349.713447:0:90704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5200/0x5953bbf6b3073edd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073ee4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.713459:0:90704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4e00/0x5953bbf6b3073ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073f00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290349.713464:0:90704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4e00/0x5953bbf6b3073ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073f00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290349.713468:0:90704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784290349.713473:0:90704:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784290349.713477:0:90704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4e00/0x5953bbf6b3073ef9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073f00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.713486:0:90704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c24429dec00/0x5953bbf6b3073f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073f0e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290349.713491:0:90704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c24429dec00/0x5953bbf6b3073f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073f0e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290349.713494:0:90704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784290349.713501:0:90704:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784290349.713505:0:90704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c24429dec00/0x5953bbf6b3073f07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073f0e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.713515:0:90704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c24429de400/0x5953bbf6b3073f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073f38 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290349.713529:0:90704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c24429de400/0x5953bbf6b3073f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073f38 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290349.713533:0:90704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784290349.713540:0:90704:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784290349.713546:0:90704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c24429de400/0x5953bbf6b3073f31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073f38 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.713566:0:90704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5000/0x5953bbf6b3073e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073e9e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290349.713570:0:90704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5000/0x5953bbf6b3073e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073e9e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290349.713574:0:90704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784290349.713579:0:90704:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784290349.713583:0:90704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5000/0x5953bbf6b3073e97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073e9e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.713597:0:90704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4a00/0x5953bbf6b3073eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073eba expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290349.713602:0:90704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4a00/0x5953bbf6b3073eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073eba expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290349.713606:0:90704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1784290349.713611:0:90704:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784290349.713617:0:90704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4a00/0x5953bbf6b3073eb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073eba expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.713641:0:90704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5e00/0x5953bbf6b3073ec1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073ec8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290349.713647:0:90704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5e00/0x5953bbf6b3073ec1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073ec8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290349.713652:0:90704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784290349.713663:0:90704:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784290349.713669:0:90704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2f5e00/0x5953bbf6b3073ec1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073ec8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.713682:0:90704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c24429de600/0x5953bbf6b3073eeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073ef2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290349.713690:0:90704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c24429de600/0x5953bbf6b3073eeb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073ef2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290349.713696:0:90704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784290349.713706:0:90704:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784290349.713713:0:90704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c24429de600/0x5953bbf6b3073eeb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073ef2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.713741:0:90704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4600/0x5953bbf6b3073f15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3073f1c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290349.713750:0:90704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4600/0x5953bbf6b3073f15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3073f1c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290349.713756:0:90704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784290349.713779:0:90704:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1784290349.713784:0:90704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2f4600/0x5953bbf6b3073f15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3073f1c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784290349.713800:0:90704:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c2447cad800 already not connected (conn 49, was 0): DISCONN 00000100:00080000:0.0:1784290349.713804:0:90704:0:(import.c:65:import_set_state_nolock()) ffff9c2447cad800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784290349.713808:0:90704:0:(import.c:510:import_select_connection()) MGC192.168.202.106@tcp: connect to NID 0@lo last attempt 2057 00000100:00080000:0.0:1784290349.713815:0:90704:0:(import.c:624:import_select_connection()) MGC192.168.202.106@tcp: import ffff9c2447cad800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290349.713837:0:90704:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c245fe3bb80 x1870961901075840/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784290349.713856:0:90704:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1784290349.713875:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e54cd1c-9dbd-4e31-b60e-998135d46053:3616:1870961901075840:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1784290349.713926:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290349.713955:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901075840 00000100:00100000:0.0:1784290349.713961:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901075840 00000100:00100000:0.0:1784290349.713993:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784290349.713999:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3616:x1870961901075840:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1784290349.714019:0:90710:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo t0 exp 0000000000000000 cur 2090 last 0 00000020:00000080:0.0:1784290349.714035:0:90710:0:(genops.c:1406:class_connect()) connect: client 2e54cd1c-9dbd-4e31-b60e-998135d46053, cookie 0x5953bbf6b3074367 00000100:00080000:0.0:1784290349.714124:0:90710:0:(import.c:65:import_set_state_nolock()) ffff9c246ff1f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290349.714177:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:3616:x1870961901075840:12345-0@lo:250:mount.lustre.0 Request processed in 177us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290349.714184:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784290349.714196:0:3616:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.106@tcp: committing for last_committed 0 gen 26 00000100:00080000:1.0:1784290349.714204:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.106@tcp: connect to target with instance 0 00000100:00080000:1.0:1784290349.714210:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1784290349.714212:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1784290349.714215:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2447cad800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1784290349.714218:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1784290349.714238:0:3616:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1784290349.714245:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e54cd1c-9dbd-4e31-b60e-998135d46053:3616:1870961901075840:0@lo:250:mount.lustre.0 00000100:00080000:0.0:1784290349.714255:0:90704:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1784290349.714265:0:90704:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000000:2.0:1784290349.714276:0:42926:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.202.106@tcp 10000000:01000000:2.0:1784290349.714290:0:42926:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1784290349.714291:0:90704:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 00000020:01000004:2.0:1784290349.714293:0:42926:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1784290349.714296:0:42926:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784290349.714297:0:42926:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 10000000:01000000:0.0:1784290349.714297:0:90704:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000020:01000004:2.0:1784290349.714301:0:42926:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784290349.714302:0:42926:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784290349.714305:0:42926:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784290349.714307:0:42926:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784290349.714308:0:42926:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784290349.714309:0:42926:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1784290349.714339:0:42926:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1784290349.714363:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901075968:0@lo:253:kworker.0 10000000:01000000:2.0:1784290349.714376:0:42926:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1784290349.714378:0:42926:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1784290349.714380:0:42926:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784290349.714382:0:42926:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784290349.714384:0:42926:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784290349.714386:0:42926:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000040:01000000:0.0:1784290349.714387:0:90704:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1784290349.714388:0:42926:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784290349.714393:0:42926:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784290349.714396:0:42926:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784290349.714398:0:42926:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784290349.714404:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1784290349.714421:0:90704:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.106@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1784290349.714425:0:90704:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784290349.714432:0:90704:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784290349.714433:0:90704:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784290349.714435:0:90704:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784290349.714437:0:90704:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000000:2.0:1784290349.714438:0:42926:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 00000020:01000004:0.0:1784290349.714439:0:90704:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784290349.714442:0:90704:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784290349.714444:0:90704:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 10000000:01000000:2.0:1784290349.714446:0:42926:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1784290349.714446:0:90704:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784290349.714448:0:90704:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00100000:1.0:1784290349.714450:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901075968 10000000:01000000:0.0:1784290349.714451:0:90704:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1784290349.714456:0:90704:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784290349.714457:0:42926:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000100:00100000:1.0:1784290349.714457:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901075968 00000020:01000004:0.0:1784290349.714459:0:90704:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784290349.714463:0:42926:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784290349.714463:0:90704:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784290349.714467:0:90704:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784290349.714468:0:42926:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784290349.714471:0:42926:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784290349.714471:0:90704:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784290349.714474:0:90704:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784290349.714475:0:42926:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784290349.714477:0:90704:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784290349.714478:0:42926:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784290349.714479:0:90704:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784290349.714481:0:42926:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784290349.714482:0:90704:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784290349.714483:0:42926:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784290349.714485:0:90704:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784290349.714486:0:42926:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784290349.714489:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784290349.714497:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:3618:x1870961901075968:12345-0@lo:253:kworker.0 00000100:00100000:0.0:1784290349.714504:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901076096:0@lo:253:kworker.0 00000020:01000000:2.0:1784290349.714508:0:42926:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 20000000:01000000:1.0:1784290349.714517:0:90712:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:2.0:1784290349.714536:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901076224:0@lo:253:kworker.0 00000100:00100000:0.0:1784290349.714544:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290349.714581:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901076096 00000100:00100000:2.0:1784290349.714586:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290349.714586:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901076096 00000100:00100000:0.0:1784290349.714616:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901076224 00000100:00100000:0.0:1784290349.714620:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901076224 00000100:00100000:1.0:1784290349.714645:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784290349.714661:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:3619:x1870961901076096:12345-0@lo:253:kworker.0 10000000:01000000:0.0:1784290349.714681:0:90704:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 20000000:01000000:1.0:1784290349.714684:0:90711:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1784290349.714698:0:90704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901076352:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784290349.714743:0:90713:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:0.0:1784290349.714761:0:90704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290349.714790:0:90704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247d2fcc00 going to sleep for 11 seconds 20000000:01000000:1.0:1784290349.714794:0:90712:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 112 00000100:00100000:2.0:1784290349.714795:0:90710:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1784290349.714803:0:90710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:0.0:1784290349.714943:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901076352 00000100:00100000:0.0:1784290349.714948:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901076352 00000100:00100000:2.0:1784290349.715010:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784290349.715019:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:3620:x1870961901076224:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1784290349.715037:0:90714:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1784290349.715618:0:90715:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1784290349.715622:0:90715:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1784290349.715626:0:90715:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1784290349.715629:0:90715:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1784290349.715797:0:90715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1784290349.715883:0:90712:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784290349.715902:0:90712:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784290349.716787:0:90712:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784290349.716798:0:90712:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1784290349.716809:0:90711:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784290349.716815:0:90713:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784290349.716821:0:90713:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784290349.716842:0:90713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2345ef9c00/0x5953bbf6b307436e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.716858:0:90713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ef9c00/0x5953bbf6b307436e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784290349.716870:0:90713:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000048892s 00010000:00010000:2.0:1784290349.716875:0:90713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2345ef9c00/0x5953bbf6b307436e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.716884:0:90713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2345ef9c00/0x5953bbf6b307436e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.716901:0:90713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2345ef9c00/0x5953bbf6b307436e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.716909:0:90713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2345ef9c00/0x5953bbf6b307436e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.716916:0:90713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9c00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290349.716920:0:90713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2345ef9c00/0x5953bbf6b307436e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.716928:0:90713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2345ef9c00/0x5953bbf6b307436e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.716940:0:90713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2345ef9c00/0x5953bbf6b307436e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.716948:0:90713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2345ef9c00/0x5953bbf6b307436e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.716952:0:90713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ef9c00/0x5953bbf6b307436e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290349.717018:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:3618:x1870961901075968:12345-0@lo:253:kworker.0 Request processed in 2519us (2611us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290349.717033:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:1.0:1784290349.717033:0:3618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1784290349.717038:0:3618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784290349.717039:0:3618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290349.717040:0:3618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290349.717041:0:3618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290349.717043:0:3618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290349.717044:0:3618:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784290349.717045:0:3618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290349.717046:0:3618:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784290349.717050:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901075968:0@lo:253:kworker.0 00000100:00100000:3.0:1784290349.717070:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784290349.717079:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:90704:x1870961901076352:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784290349.717105:0:90712:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784290349.717108:0:90712:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784290349.717111:0:90712:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:3.0:1784290349.717117:0:90712:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1784290349.718337:0:90711:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784290349.718364:0:90711:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1784290349.718377:0:90713:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 20000000:01000000:2.0:1784290349.718380:0:90714:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 10000000:01000000:0.0:1784290349.718383:0:90713:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784290349.718400:0:90713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b3074375 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290349.718418:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:90704:x1870961901076352:12345-0@lo:253:mount.lustre.0 Request processed in 1337us (3656us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290349.718430:0:90713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b3074375 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290349.718435:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:0.0:1784290349.718446:0:90713:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000062780s 00010000:00010000:0.0:1784290349.718450:0:90713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b3074375 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.718458:0:90713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b3074375 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290349.718462:0:90704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901076352:0@lo:253:mount.lustre.0 00010000:00010000:0.0:1784290349.718473:0:90713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b3074375 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290349.718476:0:90704:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784290349.718480:0:90704:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784290349.718483:0:90704:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784290349.718484:0:90704:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784290349.718485:0:90704:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00010000:00010000:0.0:1784290349.718485:0:90713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b3074375 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784290349.718488:0:90704:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:0.0:1784290349.718495:0:90713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26e00 already unused, calling callback (ffffffffc0ec3230) 00000020:01000004:2.0:1784290349.718496:0:90704:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784290349.718498:0:90704:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784290349.718502:0:90704:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784290349.718504:0:90704:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00010000:00010000:0.0:1784290349.718505:0:90713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b3074375 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784290349.718507:0:90704:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00010000:00010000:0.0:1784290349.718517:0:90713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b3074375 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784290349.718525:0:90704:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c247036f800 from lustre-MDT0000 00010000:00010000:0.0:1784290349.718529:0:90713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b3074375 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.718539:0:90713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b3074375 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290349.718545:0:90704:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 00010000:00010000:0.0:1784290349.718547:0:90713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b3074375 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290349.718549:0:90704:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 00000100:00100000:1.0:1784290349.718554:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:3619:x1870961901076096:12345-0@lo:253:kworker.0 Request processed in 3899us (4012us total) trans 0 rc 0/0 10000000:01000000:2.0:1784290349.718556:0:90704:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c247036f800 10000000:01000000:2.0:1784290349.718563:0:90704:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784290349.718571:0:90704:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c247036f800 00000100:00100000:1.0:1784290349.718573:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:01000000:2.0:1784290349.718577:0:90704:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1784290349.718581:0:90704:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9c247036f800 from 1 10000000:01000000:2.0:1784290349.718584:0:90704:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00000020:01000004:3.0:1784290349.718588:0:3619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1784290349.718592:0:3619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784290349.718601:0:3619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784290349.718603:0:3619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784290349.718605:0:3619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784290349.718607:0:3619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784290349.718608:0:3619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784290349.718609:0:3619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784290349.718611:0:3619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1784290349.718615:0:90704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8400/0x5953bbf6b307437c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290349.718617:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901076096:0@lo:253:kworker.0 00010000:00010000:2.0:1784290349.718630:0:90704:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8400/0x5953bbf6b307437c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.718636:0:90704:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8400/0x5953bbf6b307437c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290349.718648:0:90704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901076480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784290349.718672:0:90704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290349.718699:0:90704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a016540 going to sleep for 11 seconds 00000100:00100000:0.0:1784290349.718700:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901076480 00000100:00100000:0.0:1784290349.718707:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901076480 00000100:00100000:0.0:1784290349.718749:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784290349.718758:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475cab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:90704:x1870961901076480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784290349.718768:0:90710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290349.718780:0:90710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246dd27e00/0x5953bbf6b3074383 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307437c expref: -99 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.718796:0:90710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd27e00/0x5953bbf6b3074383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307437c expref: 7 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.718805:0:90710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246dd27e00/0x5953bbf6b3074383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307437c expref: 7 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.718813:0:90710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27e00, rc 0) 00000100:00100000:0.0:1784290349.718850:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475cab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:90704:x1870961901076480:12345-0@lo:101:mount.lustre.0 Request processed in 94us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290349.718859:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784290349.718872:0:90704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901076480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784290349.718884:0:90704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8400/0x5953bbf6b307437c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074383 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.718890:0:90704:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8400/0x5953bbf6b307437c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074383 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290349.718918:0:90704:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784290349.718931:0:90704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8400/0x5953bbf6b307437c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074383 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.718940:0:90704:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8400/0x5953bbf6b307437c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074383 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290349.718948:0:90704:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784290349.718952:0:90704:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784290349.718955:0:90704:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c247036f800 10000000:01000000:2.0:1784290349.718957:0:90704:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1784290349.718959:0:90704:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1784290349.718961:0:90704:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784290349.718973:0:90704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8200/0x5953bbf6b307438a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.718978:0:90704:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8200/0x5953bbf6b307438a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.718983:0:90704:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8200/0x5953bbf6b307438a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290349.718992:0:90704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901076608:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784290349.719012:0:90704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290349.719026:0:90704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a016540 going to sleep for 11 seconds 00000100:00100000:1.0:1784290349.719058:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901076608 00000100:00100000:1.0:1784290349.719062:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901076608 00000100:00100000:1.0:1784290349.719085:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784290349.719090:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475cab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:90704:x1870961901076608:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784290349.719095:0:90711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290349.719104:0:90711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236d600/0x5953bbf6b3074391 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307438a expref: -99 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290349.719125:0:90711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236d600/0x5953bbf6b3074391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307438a expref: 8 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290349.719132:0:90711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236d600/0x5953bbf6b3074391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307438a expref: 8 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290349.719137:0:90711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236d600, rc 0) 00000100:00100000:1.0:1784290349.719164:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475cab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:90704:x1870961901076608:12345-0@lo:101:mount.lustre.0 Request processed in 74us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290349.719169:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784290349.719190:0:90704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901076608:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784290349.719199:0:90704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8200/0x5953bbf6b307438a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074391 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.719211:0:90704:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8200/0x5953bbf6b307438a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074391 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290349.719274:0:90704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901076736:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784290349.719302:0:90704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290349.719317:0:90704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a016540 going to sleep for 11 seconds 00000100:00100000:0.0:1784290349.719328:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901076736 00000100:00100000:0.0:1784290349.719334:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901076736 00000100:00100000:0.0:1784290349.719387:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784290349.719395:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475cab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:90704:x1870961901076736:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784290349.719485:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475cab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:90704:x1870961901076736:12345-0@lo:501:mount.lustre.0 Request processed in 89us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290349.719496:0:90704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901076736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784290349.719496:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784290349.719533:0:90704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901076864:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784290349.719567:0:90704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290349.719591:0:90704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a016540 going to sleep for 11 seconds 00000100:00100000:3.0:1784290349.719611:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901076864 00000100:00100000:3.0:1784290349.719617:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901076864 00000100:00100000:3.0:1784290349.719657:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784290349.719666:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dcf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:90704:x1870961901076864:12345-0@lo:503:mount.lustre.0 20000000:01000000:0.0:1784290349.719864:0:90714:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784290349.719877:0:90714:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1784290349.719894:0:90713:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784290349.719899:0:90713:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784290349.719911:0:90713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b3074398 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.719922:0:90713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b3074398 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784290349.719930:0:90713:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000062780s 00010000:00010000:2.0:1784290349.719934:0:90713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b3074398 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.719942:0:90713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b3074398 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.719949:0:90713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b3074398 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.719963:0:90713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b3074398 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.719967:0:90713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290349.719970:0:90713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b3074398 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.719975:0:90713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b3074398 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.719983:0:90713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b3074398 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.719989:0:90713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b3074398 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.719994:0:90713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b3074398 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290349.720038:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:3620:x1870961901076224:12345-0@lo:253:kworker.0 Request processed in 5019us (5453us total) trans 0 rc 0/0 00000020:01000004:2.0:1784290349.720046:0:3620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000100:00100000:0.0:1784290349.720047:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1784290349.720048:0:3620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1784290349.720053:0:3620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784290349.720054:0:3620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784290349.720055:0:3620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784290349.720056:0:3620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784290349.720057:0:3620:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784290349.720059:0:3620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784290349.720061:0:3620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1784290349.720064:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901076224:0@lo:253:kworker.0 00000100:00100000:3.0:1784290349.720091:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dcf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:90704:x1870961901076864:12345-0@lo:503:mount.lustre.0 Request processed in 425us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290349.720102:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784290349.720106:0:90704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901076864:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784290349.720336:0:90716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447aeb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:90716:1870961901076992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290349.720693:0:90716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290349.720722:0:90716:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20600 going to sleep for 11 seconds 00000100:00100000:0.0:1784290349.720741:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901076992 00000100:00100000:0.0:1784290349.720747:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901076992 00000100:00100000:0.0:1784290349.720775:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784290349.720783:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:90716:x1870961901076992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290349.721063:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:90716:x1870961901076992:12345-0@lo:502:llog_process_th.0 Request processed in 281us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290349.721068:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784290349.721098:0:90716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447aeb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:90716:1870961901076992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784290349.721125:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784290349.721134:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290349.721137:0:90716:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784290349.721144:0:90716:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1784290349.721147:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784290349.721158:0:90716:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c24581b4d40) 00000020:00000080:3.0:1784290349.721174:0:90716:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1784290349.721179:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1784290349.721243:0:90716:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:3.0:1784290349.721249:0:90716:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b30743a6 00000020:00000080:3.0:1784290349.721467:0:90716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784290349.721477:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290349.721480:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290349.721482:0:90716:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784290349.721485:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784290349.721489:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290349.721490:0:90716:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1784290349.721494:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784290349.721502:0:90716:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c24581b0000) 00000020:00000080:3.0:1784290349.721515:0:90716:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1784290349.721519:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1784290349.721521:0:90716:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1784290349.721524:0:90716:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1784290349.721530:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784290349.721577:0:90716:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c247036f800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1784290349.721588:0:90716:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c24581b19c0) 00000020:00000080:3.0:1784290349.721599:0:90716:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1784290349.721658:0:90716:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1784290349.721664:0:90716:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b30743bb 00000020:00000080:3.0:1784290349.721774:0:90716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1784290349.721781:0:90716:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1784290349.721786:0:90716:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5953bbf6b30743c2 00080000:01000000:3.0:1784290349.721791:0:90716:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1784290349.721795:0:90716:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b30743c9 00010000:00010000:1.0:1784290349.736444:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290349.756432:0:90716:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1784290349.756548:0:90716:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: bd808cf4-dd54-45f0-9b2b-1434e8330e5d idx: 0 lr: 103079215115 srv lr: 107374182400 lx: 0 gen 22 00000001:00080000:3.0:1784290349.756584:0:90716:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 107374182400 lx: 0 gen 21 00000001:00000004:3.0:1784290349.756602:0:90716:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 107374182400 00000001:00080000:3.0:1784290349.756716:0:90716:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1784290349.756777:0:90716:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2345bd9180: xid 1870961896229504, transno 107374182407, client gen 22, slot idx 0 00000001:00080000:3.0:1784290349.756785:0:90716:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2345bd9600: xid 1870961896229248, transno 107374182406, client gen 22, slot idx 1 00000020:00000080:3.0:1784290349.757107:0:90716:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c24581b3380) 00000020:00000080:3.0:1784290349.757123:0:90716:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:3.0:1784290349.757180:0:90716:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784290349.757184:0:90716:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b30743e5 00000020:00000080:0.0:1784290349.757547:0:90716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1784290349.759223:0:90716:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5953bbf6b30743ec 00000020:00000080:1.0:1784290349.759414:0:90716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1784290349.759426:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784290349.759431:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290349.759434:0:90716:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1784290349.759437:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784290349.759439:0:90716:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1784290349.759440:0:90716:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784290349.759442:0:90716:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784290349.759443:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784290349.759445:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290349.759447:0:90716:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784290349.759450:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784290349.759453:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290349.759454:0:90716:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1784290349.759459:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1784290349.759495:0:90716:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1784290349.759514:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784290349.759523:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290349.759524:0:90716:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1784290349.759526:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784290349.759530:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290349.759531:0:90716:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1784290349.759534:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784290349.759539:0:90716:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:00000080:1.0:1784290349.759562:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784290349.759571:0:90716:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c246ff6b380) 00000020:00000080:1.0:1784290349.759584:0:90716:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1784290349.759588:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784290349.759643:0:90716:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1784290349.759648:0:90716:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784290349.759656:0:90716:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b30743fa 00010000:00080000:1.0:1784290349.759694:0:90716:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2344b53800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:1.0:1784290349.761147:0:90716:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1784290349.761659:0:90716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784290349.761664:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1784290349.761682:0:90716:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784290349.761693:0:90716:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3074401 00000100:00080000:3.0:1784290349.761700:0:90716:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784290349.761704:0:90716:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c2344b53800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290349.761745:0:90716:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2447aeb100 x1870961901077120/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784290349.761764:0:90716:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1784290349.761804:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901077120:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1784290349.761808:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290349.761813:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290349.761815:0:90716:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1784290349.761818:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784290349.761820:0:90716:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1784290349.761822:0:90716:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784290349.761823:0:90716:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784290349.761825:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784290349.761829:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00080000:2.0:1784290349.761829:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000080:3.0:1784290349.761832:0:90716:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000100:00080000:2.0:1784290349.761837:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000020:01000000:3.0:1784290349.761839:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:0.0:1784290349.761842:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901077248:0@lo:400:kworker.0 00000020:01000004:3.0:1784290349.761843:0:90716:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000100:00080000:2.0:1784290349.761848:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000020:00000080:3.0:1784290349.761850:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290349.761853:0:90716:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000100:00080000:2.0:1784290349.761856:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2088 00000020:00000080:3.0:1784290349.761860:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000100:00080000:2.0:1784290349.761861:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000020:00000080:3.0:1784290349.761865:0:90716:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000100:00080000:2.0:1784290349.761871:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290349.761872:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1784290349.761884:0:90716:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000100:00100000:2.0:1784290349.761893:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2468abb800 x1870961901077376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:3.0:1784290349.761896:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000100:00100000:0.0:1784290349.761896:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1784290349.761908:0:90716:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c2474fd3380) 00000020:00000080:3.0:1784290349.761924:0:90716:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000100:00080000:2.0:1784290349.761930:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1784290349.761931:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901077376:0@lo:38:kworker.0 00000020:00000080:3.0:1784290349.761932:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1784290349.761934:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1784290349.761943:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290349.761947:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784290349.761948:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901077504:0@lo:400:kworker.0 00000100:00080000:2.0:1784290349.761957:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2088 00000100:00080000:2.0:1784290349.761960:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784290349.761964:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290349.761975:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290349.761982:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2468ab8700 x1870961901077632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00080000:3.0:1784290349.761993:0:90716:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00000100:00100000:0.0:1784290349.761999:0:90714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901077248 00080000:01000000:3.0:1784290349.762000:0:90716:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000100:00100000:0.0:1784290349.762008:0:90714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901077248 00000020:00000080:3.0:1784290349.762010:0:90716:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b307440f 00000100:00100000:1.0:1784290349.762011:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901077632:0@lo:38:kworker.0 00000100:00080000:2.0:1784290349.762015:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290349.762020:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290349.762022:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290349.762027:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2088 00000100:00080000:2.0:1784290349.762030:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1784290349.762034:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290349.762045:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290349.762049:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2468ab8380 x1870961901077888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:3.0:1784290349.762055:0:90716:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c247e4b4000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.106@tcp at head 00000100:00100000:0.0:1784290349.762056:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784290349.762071:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24686f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:3617:x1870961901077248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290349.762086:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901077120 00000100:00100000:1.0:1784290349.762091:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901077120 00000100:00080000:2.0:1784290349.762098:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290349.762102:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290349.762109:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290349.762115:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2088 00000100:00080000:2.0:1784290349.762118:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:0.0:1784290349.762122:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24686f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:3617:x1870961901077248:12345-0@lo:400:kworker.0 Request processed in 52us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290349.762124:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3788 00000100:00080000:2.0:1784290349.762127:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290349.762135:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901077120:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784290349.762138:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784290349.762147:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c234434ce00 x1870961901078272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:1.0:1784290349.762156:0:8413:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2091 last 0 00000100:00100000:2.0:1784290349.762178:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901077760:0@lo:400:kworker.0 00000020:00000080:1.0:1784290349.762198:0:8413:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3074416 00000004:00100000:1.0:1784290349.762212:0:8413:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1784290349.762219:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290349.762251:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784290349.762259:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901078016:0@lo:400:kworker.0 00000100:00100000:0.0:1784290349.762261:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901077376 00000100:00100000:0.0:1784290349.762266:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901077376 00010000:00010000:3.0:1784290349.762287:0:90716:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:0.0:1784290349.762291:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901077632 00000100:00100000:2.0:1784290349.762294:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784290349.762297:0:8413:0:(import.c:65:import_set_state_nolock()) ffff9c246dce0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290349.762297:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901077632 00000100:00100000:0.0:1784290349.762324:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901077760 00000100:00100000:0.0:1784290349.762334:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901077760 00000100:00100000:2.0:1784290349.762380:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:1.0:1784290349.762387:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3616:x1870961901077120:12345-0@lo:38:llog_process_th.0 Request processed in 252us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290349.762389:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901077376:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784290349.762407:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3788 00000100:00100000:0.0:1784290349.762408:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:0.0:1784290349.762420:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901077760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290349.762441:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901077376:12345-0@lo:38:kworker.0 Request processed in 54us (466us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784290349.762447:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:2.0:1784290349.762458:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:1.0:1784290349.762459:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901077632:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290349.762470:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901077760:12345-0@lo:400:kworker.0 Request processed in 51us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290349.762477:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:2.0:1784290349.762491:0:8999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901078016 00000100:00100000:2.0:1784290349.762496:0:8999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901078016 00000100:00100000:1.0:1784290349.762501:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901077632:12345-0@lo:38:kworker.0 Request processed in 44us (455us total) trans 0 rc -11/-11 00000100:00080000:0.0:1784290349.762503:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784290349.762509:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290349.762510:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:2.0:1784290349.762530:0:8999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1558 00000100:00100000:2.0:1784290349.762539:0:8999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901078016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290349.762540:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784290349.762550:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901078144:0@lo:400:kworker.0 00000100:00100000:2.0:1784290349.762574:0:8999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901078016:12345-0@lo:400:kworker.0 Request processed in 37us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290349.762582:0:8999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1558 00000100:00100000:1.0:1784290349.762584:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290349.762605:0:8999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901078144 00000100:00100000:2.0:1784290349.762610:0:8999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901078144 00000100:00100000:1.0:1784290349.762637:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784290349.762638:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784290349.762648:0:8999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1559 00000100:00100000:2.0:1784290349.762656:0:8999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901078144:12345-0@lo:400:kworker.0 00000040:01000000:3.0:1784290349.762670:0:90716:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1784290349.762680:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901077248:0@lo:400:kworker.0 00000040:01000000:3.0:1784290349.762693:0:90716:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1784290349.762709:0:8999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901078144:12345-0@lo:400:kworker.0 Request processed in 53us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290349.762715:0:8999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1559 00000100:00100000:1.0:1784290349.762740:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901077504 00000100:00100000:1.0:1784290349.762745:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901077504 00000100:00100000:0.0:1784290349.762748:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901078144:0@lo:400:kworker.0 00000040:00080000:3.0:1784290349.762769:0:90716:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000100:00100000:2.0:1784290349.762775:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901078016:0@lo:400:kworker.0 00000100:00100000:2.0:1784290349.762793:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901077760:0@lo:400:kworker.0 00000100:00100000:1.0:1784290349.762799:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1784290349.762813:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901077504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290349.762831:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901077888:0@lo:38:kworker.0 00000100:00100000:2.0:1784290349.762867:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290349.762868:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901077504:12345-0@lo:400:kworker.0 Request processed in 56us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290349.762877:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:0.0:1784290349.762882:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901077504:0@lo:400:kworker.0 00000100:00080000:1.0:1784290349.762902:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784290349.762904:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901078272:0@lo:38:kworker.0 00000100:00100000:3.0:1784290349.762907:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901077888 00000100:00100000:3.0:1784290349.762927:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901077888 00000100:00100000:2.0:1784290349.762939:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290349.762957:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3789 00000100:00100000:3.0:1784290349.762964:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901077888:12345-0@lo:38:kworker.0 00000100:00080000:2.0:1784290349.762978:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290349.762983:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784290349.762986:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901077632:0@lo:38:kworker.0 00000100:00080000:2.0:1784290349.762994:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290349.762998:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784290349.763002:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901077376:0@lo:38:kworker.0 00000100:00100000:3.0:1784290349.763009:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901077888:12345-0@lo:38:kworker.0 Request processed in 44us (145us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784290349.763016:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3789 00000100:00100000:2.0:1784290349.763017:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784290349.763023:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:2.0:1784290349.763030:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1784290349.763034:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1784290349.763036:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2344b53800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784290349.763039:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901078272 00000100:00100000:1.0:1784290349.763044:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901078272 00000100:00100000:2.0:1784290349.763049:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447aeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901077120:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1784290349.763086:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1784290349.763088:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901078400:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1784290349.763091:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784290349.763095:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:2.0:1784290349.763105:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901077888:0@lo:38:kworker.0 00000100:00100000:1.0:1784290349.763107:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901078272:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290349.763121:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290349.763144:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901078400 00000100:00100000:3.0:1784290349.763148:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901078400 00000100:00100000:1.0:1784290349.763168:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901078272:12345-0@lo:38:kworker.0 Request processed in 61us (229us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784290349.763181:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1784290349.763185:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3790 00000100:00080000:2.0:1784290349.763191:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1784290349.763196:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901078400:12345-0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1784290349.763199:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784290349.763205:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901078272:0@lo:38:kworker.0 00000004:00000024:3.0:1784290349.763218:0:8413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:3.0:1784290349.763254:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901078400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290349.763260:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3790 00000100:00100000:0.0:1784290349.763278:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901078400:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1784290349.763325:0:90716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784290349.763375:0:90716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].26, 64 off9856 00000040:00080000:1.0:1784290349.765563:0:90716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x68:0x0].1, 64 off8256 00000040:00080000:1.0:1784290349.765750:0:90722:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:1.0:1784290349.765754:0:90722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1784290349.765845:0:90722:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000040:00080000:1.0:1784290349.765856:0:90722:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1784290349.765946:0:90722:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:1.0:1784290349.765949:0:90722:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1784290349.766104:0:90716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784290349.766110:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784290349.766135:0:90716:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784290349.766144:0:90716:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b307441d 00000100:00080000:3.0:1784290349.766149:0:90716:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784290349.766152:0:90716:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c247e4b4000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290349.766165:0:90716:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2447aeb800 x1870961901078528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784290349.766182:0:90716:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1784290349.766218:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901078528:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1784290349.766246:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290349.766252:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290349.766254:0:90716:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1784290349.766257:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00100000:2.0:1784290349.766277:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1784290349.766278:0:90716:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1784290349.766281:0:90716:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784290349.766282:0:90716:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784290349.766283:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784290349.766285:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290349.766286:0:90716:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784290349.766288:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784290349.766290:0:90716:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1784290349.766292:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290349.766293:0:90716:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1784290349.766296:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784290349.766299:0:90716:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:01000000:3.0:1784290349.766315:0:90716:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000100:00100000:0.0:1784290349.766315:0:26254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901078528 00000020:00000080:3.0:1784290349.766318:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000100:00100000:0.0:1784290349.766321:0:26254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901078528 00000020:00000080:3.0:1784290349.766326:0:90716:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c2474fd4d40) 00000020:00000080:3.0:1784290349.766338:0:90716:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1784290349.766342:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1784290349.766372:0:26254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4940 00000100:00100000:0.0:1784290349.766380:0:26254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3616:x1870961901078528:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1784290349.766395:0:26254:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2091 last 0 00000004:00080000:3.0:1784290349.766416:0:90716:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00000020:00000080:0.0:1784290349.766417:0:26254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b307442b 00080000:01000000:3.0:1784290349.766424:0:90716:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00002000:00100000:0.0:1784290349.766428:0:26254:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c23458dd800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ad ocd_grant: 0 ocd_index: 0 ocd_group 0 00000020:00000080:3.0:1784290349.766429:0:90716:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3074432 00002000:00080000:0.0:1784290349.766435:0:26254:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1784290349.766438:0:26254:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:3.0:1784290349.766451:0:90716:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2458bed800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.106@tcp at head 00002000:00080000:0.0:1784290349.766480:0:26254:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784290349.766493:0:26254:0:(import.c:65:import_set_state_nolock()) ffff9c23458df800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290349.766541:0:26254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3616:x1870961901078528:12345-0@lo:8:llog_process_th.0 Request processed in 162us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290349.766549:0:26254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4940 00000100:00100000:2.0:1784290349.766565:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784290349.766571:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784290349.766576:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784290349.766580:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1784290349.766583:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c247e4b4000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784290349.766597:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784290349.766602:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901078528:0@lo:8:llog_process_th.0 00010000:00010000:3.0:1784290349.766619:0:90716:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000004:00080000:1.0:1784290349.766619:0:90722:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1784290349.766646:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901078656:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1784290349.766654:0:90722:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2091006312751ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784290349.766662:0:90722:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1784290349.766678:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1784290349.766683:0:90716:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784290349.766692:0:90716:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1784290349.766715:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901078656 00000100:00100000:2.0:1784290349.766719:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901078656 00000100:00080000:1.0:1784290349.766755:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784290349.766770:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:2.0:1784290349.766777:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901078656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784290349.766794:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784290349.766829:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901078656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290349.766834:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:3.0:1784290349.766892:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901078656:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1784290349.766909:0:90716:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000040:00080000:1.0:1784290349.767450:0:90716:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784290349.767465:0:90716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].26, 64 off9856 00000004:00080000:0.0:1784290349.767527:0:90705:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:1.0:1784290349.767557:0:90716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6a:0x0].1, 64 off8256 00000040:00080000:2.0:1784290349.767737:0:90724:0:(llog.c:805:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:2.0:1784290349.767740:0:90724:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1784290349.767839:0:90724:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000040:00080000:2.0:1784290349.767851:0:90724:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1784290349.767921:0:90724:0:(llog.c:805:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:2.0:1784290349.767925:0:90724:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1784290349.768098:0:90716:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784290349.768104:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1784290349.768125:0:90716:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784290349.768135:0:90716:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3074439 00000100:00080000:3.0:1784290349.768139:0:90716:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784290349.768142:0:90716:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c2458bed800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290349.768156:0:90716:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2447ae8000 x1870961901078784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784290349.768175:0:90716:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1784290349.768198:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901078784:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1784290349.768237:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290349.768242:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290349.768244:0:90716:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1784290349.768247:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784290349.768251:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290349.768252:0:90716:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784290349.768256:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784290349.768260:0:90716:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784290349.768260:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1784290349.768265:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290349.768267:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290349.768268:0:90716:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784290349.768270:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784290349.768271:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290349.768272:0:90716:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784290349.768275:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784290349.768290:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901078784 00000100:00100000:0.0:1784290349.768296:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901078784 00000100:00100000:3.0:1784290349.768297:0:90716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447ae9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:90716:1870961901078912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290349.768324:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4941 00000100:00100000:0.0:1784290349.768331:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3616:x1870961901078784:12345-0@lo:8:llog_process_th.0 00000100:00100000:3.0:1784290349.768341:0:90716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290349.768380:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901078912 00000100:00100000:2.0:1784290349.768385:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901078912 00000100:00100000:3.0:1784290349.768401:0:90716:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c3a000 going to sleep for 11 seconds 00000100:00100000:2.0:1784290349.768422:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784290349.768432:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24686fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:90716:x1870961901078912:12345-0@lo:502:llog_process_th.0 00010000:00080000:0.0:1784290349.768506:0:26252:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2091 last 0 00000020:00000080:0.0:1784290349.768523:0:26252:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3074440 00002000:00100000:0.0:1784290349.768531:0:26252:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c244a791000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ad ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784290349.768534:0:26252:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784290349.768538:0:26252:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1784290349.768539:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24686fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:90716:x1870961901078912:12345-0@lo:502:llog_process_th.0 Request processed in 105us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290349.768550:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784290349.768562:0:90716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447ae9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:90716:1870961901078912:0@lo:502:llog_process_th.0 00002000:00080000:0.0:1784290349.768578:0:26252:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000020:01000000:3.0:1784290349.768589:0:90716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:0.0:1784290349.768593:0:26252:0:(import.c:65:import_set_state_nolock()) ffff9c2458117000 : changing import state from RECOVER to FULL 00000020:00000080:3.0:1784290349.768594:0:90716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290349.768597:0:90716:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784290349.768601:0:90716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:0.0:1784290349.768640:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475f3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3616:x1870961901078784:12345-0@lo:8:llog_process_th.0 Request processed in 308us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290349.768647:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4941 00000100:00100000:2.0:1784290349.768649:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784290349.768655:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784290349.768659:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784290349.768663:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784290349.768666:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2458bed800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000020:01000000:1.0:1784290349.768667:0:90704:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 00000004:00080000:2.0:1784290349.768681:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784290349.768689:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447ae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901078784:0@lo:8:llog_process_th.0 10000000:01000000:1.0:1784290349.768710:0:90704:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000004:00080000:2.0:1784290349.768714:0:90724:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:1.0:1784290349.768740:0:90704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8200/0x5953bbf6b307438a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074391 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290349.768751:0:90704:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8200/0x5953bbf6b307438a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074391 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290349.768757:0:90704:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9c247036f800 from 1 10000000:01000000:1.0:1784290349.768760:0:90704:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000004:00080000:2.0:1784290349.768761:0:90724:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2091008419533ns, next at 0ns, rc = 0 00080000:00080000:2.0:1784290349.768767:0:90724:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:1.0:1784290349.768781:0:90704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b3074447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290349.768795:0:90704:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b3074447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290349.768802:0:90704:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b3074447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290349.768815:0:90704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901079040:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784290349.768850:0:90704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290349.768872:0:90704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343b943c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290349.768885:0:90714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901079040 00000100:00100000:2.0:1784290349.768890:0:90714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901079040 00000100:00100000:0.0:1784290349.768906:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784290349.768915:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901079168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290349.768935:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784290349.768947:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:90704:x1870961901079040:12345-0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784290349.768949:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784290349.768963:0:90714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1784290349.768975:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901079168 00010000:00010000:2.0:1784290349.768976:0:90714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b307444e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074447 expref: -99 pid: 90714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290349.768980:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901079168 00010000:00010000:2.0:1784290349.768998:0:90714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b307444e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074447 expref: 9 pid: 90714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784290349.769006:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1784290349.769008:0:90714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b307444e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074447 expref: 9 pid: 90714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.769016:0:90714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef9400, rc 0) 00000100:00100000:1.0:1784290349.769020:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:1.0:1784290349.769029:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901079168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784290349.769043:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784290349.769057:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:90704:x1870961901079040:12345-0@lo:101:mount.lustre.0 Request processed in 113us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290349.769063:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784290349.769085:0:90704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901079040:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784290349.769091:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901079168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290349.769098:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00010000:00010000:0.0:1784290349.769104:0:90704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b3074447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307444e expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.769115:0:90704:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b3074447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307444e expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290349.769116:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901079168:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1784290349.769483:0:90705:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1784290349.769605:0:90704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901079296:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1784290349.769633:0:90704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290349.769652:0:90704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a77b540 going to sleep for 11 seconds 00000100:00100000:1.0:1784290349.769698:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901079296 00000100:00100000:1.0:1784290349.769704:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901079296 00000100:00100000:1.0:1784290349.769747:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784290349.769756:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:90704:x1870961901079296:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1784290349.769769:0:90710:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1784290349.769783:0:90710:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784290349.769786:0:90710:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1784290349.769788:0:90710:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1784290349.769790:0:90710:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 115 00000100:00100000:1.0:1784290349.769862:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:90704:x1870961901079296:12345-0@lo:256:mount.lustre.0 Request processed in 106us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290349.769873:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784290349.769873:0:90704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901079296:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1784290349.770362:0:90704:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784290349.770372:0:90704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b3074447 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307444e expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.770379:0:90704:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b3074447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307444e expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290349.770384:0:90704:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c247036f800 from 1 10000000:01000000:0.0:1784290349.770386:0:90704:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784290349.770400:0:90704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246dd26800/0x5953bbf6b3074455 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.770404:0:90704:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c246dd26800/0x5953bbf6b3074455 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.770409:0:90704:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c246dd26800/0x5953bbf6b3074455 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290349.770417:0:90704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901079424:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784290349.770436:0:90704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290349.770456:0:90704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a77b540 going to sleep for 11 seconds 00000100:00100000:1.0:1784290349.770471:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901079424 00000100:00100000:1.0:1784290349.770475:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901079424 00000100:00100000:1.0:1784290349.770497:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784290349.770503:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:90704:x1870961901079424:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784290349.770508:0:90711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290349.770516:0:90711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236da00/0x5953bbf6b307445c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074455 expref: -99 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290349.770528:0:90711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236da00/0x5953bbf6b307445c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074455 expref: 10 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290349.770535:0:90711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236da00/0x5953bbf6b307445c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074455 expref: 10 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290349.770539:0:90711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236da00, rc 0) 00000100:00100000:1.0:1784290349.770564:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:90704:x1870961901079424:12345-0@lo:101:mount.lustre.0 Request processed in 62us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290349.770569:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784290349.770591:0:90704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901079424:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784290349.770608:0:90704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c246dd26800/0x5953bbf6b3074455 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307445c expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.770614:0:90704:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c246dd26800/0x5953bbf6b3074455 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307445c expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290349.770645:0:90704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901079552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784290349.770671:0:90704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290349.770691:0:90704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a77b540 going to sleep for 11 seconds 00000100:00100000:2.0:1784290349.770699:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901079552 00000100:00100000:2.0:1784290349.770704:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901079552 00000100:00100000:2.0:1784290349.770740:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784290349.770746:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:90704:x1870961901079552:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784290349.770814:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:90704:x1870961901079552:12345-0@lo:501:mount.lustre.0 Request processed in 68us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290349.770820:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784290349.770833:0:90704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901079552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784290349.770855:0:90704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901079680:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784290349.770885:0:90704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290349.770899:0:90704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a77b540 going to sleep for 11 seconds 00000100:00100000:2.0:1784290349.770908:0:90714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901079680 00000100:00100000:2.0:1784290349.770913:0:90714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901079680 00000100:00100000:2.0:1784290349.770943:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784290349.770952:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:90704:x1870961901079680:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784290349.771015:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:90704:x1870961901079680:12345-0@lo:503:mount.lustre.0 Request processed in 65us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290349.771028:0:90704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901079680:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784290349.771031:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784290349.771217:0:90726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:90726:1870961901079808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290349.771246:0:90726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290349.771260:0:90726:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2447cccd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784290349.771278:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901079808 00000100:00100000:1.0:1784290349.771282:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901079808 00000100:00100000:1.0:1784290349.771304:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784290349.771310:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:90726:x1870961901079808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290349.771555:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:90726:x1870961901079808:12345-0@lo:502:llog_process_th.0 Request processed in 245us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290349.771562:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784290349.771579:0:90726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:90726:1870961901079808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784290349.771604:0:90726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784290349.771610:0:90726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290349.771612:0:90726:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784290349.771618:0:90726:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c247036f800 00000020:00000080:2.0:1784290349.771636:0:90726:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784290349.771643:0:90726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784290349.771647:0:90726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290349.771649:0:90726:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784290349.771652:0:90726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784290349.771655:0:90726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290349.771656:0:90726:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784290349.771660:0:90726:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c247036f800 00000020:00000080:2.0:1784290349.771663:0:90726:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784290349.771743:0:90726:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d5a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:90726:1870961901079936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290349.771791:0:90726:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290349.771812:0:90726:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2447cccd80 going to sleep for 11 seconds 00000100:00100000:1.0:1784290349.771827:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901079936 00000100:00100000:1.0:1784290349.771836:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901079936 00000100:00100000:1.0:1784290349.771859:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784290349.771866:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:90726:x1870961901079936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290349.771932:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:90726:x1870961901079936:12345-0@lo:502:llog_process_th.0 Request processed in 66us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290349.771938:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784290349.771952:0:90726:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d5a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:90726:1870961901079936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784290349.771976:0:90726:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784290349.771981:0:90726:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290349.771982:0:90726:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784290349.771984:0:90726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784290349.772026:0:90704:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1784290349.772053:0:90704:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784290349.772063:0:90704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246dd26800/0x5953bbf6b3074455 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307445c expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290349.772070:0:90704:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c246dd26800/0x5953bbf6b3074455 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307445c expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290349.772104:0:90704:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784290349.772107:0:90704:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c247036f800 10000000:01000000:1.0:1784290349.772110:0:90704:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c247036f800 10000000:01000000:1.0:1784290349.772114:0:90704:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784290349.772117:0:90704:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c247036f800 from 1 10000000:01000000:1.0:1784290349.772118:0:90704:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784290349.772134:0:90704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b3074463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290349.772140:0:90704:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b3074463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290349.772146:0:90704:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b3074463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290349.772156:0:90704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901080064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784290349.772188:0:90704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290349.772201:0:90704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343b94840 going to sleep for 11 seconds 00000100:00100000:2.0:1784290349.772211:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901080064 00000100:00100000:2.0:1784290349.772216:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901080064 00000100:00100000:2.0:1784290349.772250:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784290349.772257:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:90704:x1870961901080064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784290349.772264:0:90712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290349.772272:0:90712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ef9c00/0x5953bbf6b307446a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074463 expref: -99 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.772284:0:90712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ef9c00/0x5953bbf6b307446a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074463 expref: 11 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.772291:0:90712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ef9c00/0x5953bbf6b307446a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074463 expref: 11 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.772296:0:90712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef9c00, rc 0) 00000100:00100000:2.0:1784290349.772329:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:90704:x1870961901080064:12345-0@lo:101:mount.lustre.0 Request processed in 73us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290349.772335:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784290349.772365:0:90704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901080064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784290349.772379:0:90704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b3074463 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307446a expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290349.772386:0:90704:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b3074463 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307446a expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290349.772434:0:90704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901080192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784290349.772462:0:90704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290349.772484:0:90714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901080192 00000100:00100000:2.0:1784290349.772489:0:90714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901080192 00000100:00100000:1.0:1784290349.772490:0:90704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343b94840 going to sleep for 11 seconds 00000100:00100000:2.0:1784290349.772516:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784290349.772525:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:90704:x1870961901080192:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784290349.772592:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:90704:x1870961901080192:12345-0@lo:501:mount.lustre.0 Request processed in 69us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290349.772599:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784290349.772606:0:90704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901080192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784290349.772632:0:90704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901080320:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784290349.772663:0:90704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290349.772681:0:90704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343b94840 going to sleep for 11 seconds 00000100:00100000:3.0:1784290349.772741:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901080320 00000100:00100000:3.0:1784290349.772747:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901080320 00000100:00100000:3.0:1784290349.772777:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784290349.772785:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:90704:x1870961901080320:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784290349.772858:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:90704:x1870961901080320:12345-0@lo:503:mount.lustre.0 Request processed in 74us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290349.772865:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784290349.772891:0:90704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d11f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901080320:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784290349.773071:0:90728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d11f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:90728:1870961901080448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290349.773101:0:90728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290349.773117:0:90728:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343b943c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290349.773122:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901080448 00000100:00100000:0.0:1784290349.773127:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901080448 00000100:00100000:0.0:1784290349.773156:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784290349.773163:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:90728:x1870961901080448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290349.773240:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:90728:x1870961901080448:12345-0@lo:502:llog_process_th.0 Request processed in 76us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290349.773248:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784290349.773256:0:90728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d11f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:90728:1870961901080448:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1784290349.773298:0:90728:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1784290349.773306:0:90728:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c246ff68000) 00000020:00000080:1.0:1784290349.773318:0:90728:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1784290349.773444:0:90728:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c247036f800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784290349.773453:0:90728:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c247036f800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784290349.773455:0:90728:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c247036f800 4 00010000:00080000:1.0:1784290349.773485:0:90728:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c24444ae000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:1.0:1784290349.775222:0:90728:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1784290349.775303:0:90728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1784290349.775363:0:90728:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784290349.775372:0:90728:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5953bbf6b3074478 00000100:00080000:1.0:1784290349.775377:0:90728:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784290349.775381:0:90728:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c24444ae000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290349.775397:0:90728:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2445d11f80 x1870961901080576/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784290349.775416:0:90728:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784290349.775428:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901080576:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784290349.775461:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290349.775492:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901080576 00000100:00100000:0.0:1784290349.775497:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901080576 00000100:00100000:0.0:1784290349.775525:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:0.0:1784290349.775530:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901080576:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784290349.775576:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901080576:12345-0@lo:38:llog_process_th.0 Request processed in 45us (115us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784290349.775578:0:90728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:90728:1870961901080704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290349.775591:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1784290349.775623:0:90728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290349.775625:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784290349.775630:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c24444ae000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290349.775634:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784290349.775638:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901080576:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784290349.775651:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901080704 00000100:00100000:1.0:1784290349.775656:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901080704 00000100:00100000:1.0:1784290349.775679:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784290349.775684:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:90728:x1870961901080704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290349.775761:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:90728:x1870961901080704:12345-0@lo:502:llog_process_th.0 Request processed in 76us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290349.775766:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784290349.775811:0:90728:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246d46ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1784290349.775823:0:90728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:90728:1870961901080704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290349.775857:0:90728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:90728:1870961901080832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290349.775889:0:90728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290349.775906:0:90714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901080832 00000100:00100000:1.0:1784290349.775916:0:90714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901080832 00000100:00100000:1.0:1784290349.775945:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784290349.775951:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:90728:x1870961901080832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290349.776022:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:90728:x1870961901080832:12345-0@lo:502:llog_process_th.0 Request processed in 71us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290349.776027:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784290349.776066:0:90728:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246d46ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1784290349.776076:0:90728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:90728:1870961901080832:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784290349.776096:0:90728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1784290349.776150:0:90704:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1784290349.776197:0:90704:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784290349.776210:0:90704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b3074463 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307446a expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.776218:0:90704:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b3074463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307446a expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784290349.776254:0:90704:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784290349.776255:0:90704:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784290349.776257:0:90704:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784290349.776257:0:90704:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784290349.776258:0:90704:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784290349.776259:0:90704:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784290349.776261:0:90704:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784290349.776262:0:90704:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784290349.776263:0:90704:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784290349.776264:0:90704:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784290349.776267:0:90704:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1784290349.776268:0:90704:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784290349.776269:0:90704:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784290349.776270:0:90704:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784290349.776271:0:90704:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784290349.776271:0:90704:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784290349.776272:0:90704:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784290349.776273:0:90704:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784290349.776273:0:90704:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784290349.776274:0:90704:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784290349.776279:0:90704:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784290349.776289:0:90704:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784290349.776297:0:90704:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901080960:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784290349.776325:0:90704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290349.776359:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901080960 00000100:00100000:1.0:1784290349.776364:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901080960 00000100:00100000:0.0:1784290349.776374:0:90704:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dac6180 going to sleep for 11 seconds 00000100:00100000:1.0:1784290349.776389:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784290349.776394:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:90704:x1870961901080960:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784290349.776407:0:90712:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1784290349.776414:0:90712:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784290349.777915:0:90712:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784290349.777931:0:90712:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1784290349.777948:0:90713:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784290349.777953:0:90713:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784290349.777964:0:90713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c246dd27600/0x5953bbf6b307447f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.777973:0:90713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b307444e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074447 expref: 11 pid: 90714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.777978:0:90713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c246dd27600/0x5953bbf6b307447f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.777998:0:90713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b307444e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3074447 expref: 11 pid: 90714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.778011:0:90713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b307444e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3074447 expref: 11 pid: 90714 timeout: 2191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290349.778018:0:90713:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a055c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90713:1870961901081088:0@lo:104: 00000100:00100000:0.0:1784290349.778043:0:90713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290349.778073:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901081088 00000100:00100000:0.0:1784290349.778073:0:90713:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dac6600 going to sleep for 11 seconds 00000100:00100000:2.0:1784290349.778083:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901081088 00000100:00100000:3.0:1784290349.778137:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1784290349.778146:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a054e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:90713:x1870961901081088:12345-0@lo:104: 00010000:00010000:3.0:1784290349.778156:0:7428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b3074447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b307444e expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290349.778189:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:90704:x1870961901080960:12345-0@lo:253:mount.lustre.0 Request processed in 1792us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290349.778197:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784290349.778206:0:90704:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe39500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:90704:1870961901080960:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784290349.778217:0:90704:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784290349.778219:0:90704:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00010000:00010000:3.0:1784290349.778221:0:7428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000020:01000004:2.0:1784290349.778221:0:90704:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784290349.778226:0:90704:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784290349.778228:0:90704:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00010000:00010000:1.0:1784290349.778230:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1784290349.778232:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a054e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:90713:x1870961901081088:12345-0@lo:104: Request processed in 84us (184us total) trans 0 rc 0/0 00000020:01000004:2.0:1784290349.778232:0:90704:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784290349.778236:0:90704:0:(tgt_mount.c:1180:server_mti_print()) flags: 00010000:00010000:1.0:1784290349.778237:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b3074447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b307444e expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784290349.778239:0:90704:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000100:00100000:0.0:1784290349.778242:0:90713:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a055c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90713:1870961901081088:0@lo:104: 00000020:01000004:2.0:1784290349.778243:0:90704:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000100:00100000:3.0:1784290349.778245:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000020:01000004:2.0:1784290349.778247:0:90704:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784290349.778251:0:90704:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1784290349.778257:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236ca00 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:1.0:1784290349.778261:0:8418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b3074447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b307444e expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:2.0:1784290349.778269:0:90704:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1784290349.778269:0:8418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b3074447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b307444e expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290349.778271:0:90713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c246dd27600/0x5953bbf6b307447f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290349.778279:0:8418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b3074447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b307444e expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290349.778304:0:8418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290349.778332:0:8418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b3074447 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307444e expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290349.778338:0:8418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784290349.778378:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b3074447 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307444e expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290349.778384:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c234236ca00/0x5953bbf6b3074447 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307444e expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290349.778393:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901081216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290349.778402:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290349.778406:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290349.778410:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290349.778427:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290349.778679:0:19593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901081216 00000100:00100000:2.0:1784290349.778683:0:19593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901081216 00010000:00010000:2.0:1784290349.778700:0:19593:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b307444e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074447 expref: 11 pid: 90714 timeout: 2191 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290349.778723:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:2.0:1784290349.778746:0:19593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a055c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:3617:x1870961901081216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290349.778756:0:19593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290349.778761:0:19593:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b307444e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074447 expref: 11 pid: 90714 timeout: 2191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.778771:0:19593:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b307444e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3074447 expref: 11 pid: 90714 timeout: 2191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.778782:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ef9400/0x5953bbf6b307444e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3074447 expref: 11 pid: 90714 timeout: 2191 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.778793:0:19593:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c246dd27600/0x5953bbf6b307447f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.778805:0:19593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd27600/0x5953bbf6b307447f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784290349.778813:0:19593:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000860924s 00010000:00010000:2.0:1784290349.778818:0:19593:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c246dd27600/0x5953bbf6b307447f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.778823:0:19593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c246dd27600/0x5953bbf6b307447f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.778828:0:19593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c246dd27600/0x5953bbf6b307447f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.778832:0:19593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c246dd27600/0x5953bbf6b307447f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.778836:0:19593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290349.778839:0:19593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c246dd27600/0x5953bbf6b307447f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.778844:0:19593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c246dd27600/0x5953bbf6b307447f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.778862:0:19593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c246dd27600/0x5953bbf6b307447f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290349.778871:0:19593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290349.778881:0:90713:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c246dd27600/0x5953bbf6b307447f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290349.778890:0:90713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c246dd27600/0x5953bbf6b307447f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290349.778901:0:90713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd27600/0x5953bbf6b307447f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290349.778912:0:19593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a055c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:3617:x1870961901081216:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290349.778921:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00100000:2.0:1784290349.778966:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901081216:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1784290349.781399:0:90704:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444064 00000040:01000000:1.0:1784290349.781506:0:90704:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1784290349.781510:0:90734:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444064 00000020:00080000:3.0:1784290349.781514:0:90734:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444064 00000040:01000000:3.0:1784290349.781605:0:90735:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784290349.781615:0:90704:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1784290349.781773:0:90735:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784290349.781793:0:90736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447ae9c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90736:1870961901081344:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784290349.781828:0:90736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290349.781840:0:90736:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c3a240 going to sleep for 11 seconds 00000100:00100000:3.0:1784290349.782421:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901081344 00000100:00100000:3.0:1784290349.782425:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901081344 00000100:00100000:3.0:1784290349.782485:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3791 00000100:00100000:3.0:1784290349.782491:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90736:x1870961901081344:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784290349.782545:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447aebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90736:x1870961901081344:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 54us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290349.782550:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3791 00000100:00100000:3.0:1784290349.782573:0:90736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447ae9c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90736:1870961901081344:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1784290349.782591:0:90736:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1784290349.782609:0:90736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447ae9c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90736:1870961901081472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784290349.782628:0:90736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290349.782641:0:90736:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c3a240 going to sleep for 11 seconds 00000040:00080000:1.0:1784290349.783569:0:90735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784290349.783622:0:90735:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1784290349.783711:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901081472 00000100:00100000:1.0:1784290349.783714:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901081472 00000100:00100000:1.0:1784290349.783762:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3792 00000100:00100000:1.0:1784290349.783771:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90736:x1870961901081472:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1784290349.783892:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447aeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90736:x1870961901081472:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 123us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290349.783900:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3792 00000100:00100000:3.0:1784290349.783919:0:90736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447ae9c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90736:1870961901081472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784290349.783973:0:90736:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447ae9c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90736:1870961901081600:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784290349.784000:0:90736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290349.784033:0:90736:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c3a240 going to sleep for 11 seconds 00000100:00100000:0.0:1784290349.784044:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901081600 00000100:00100000:0.0:1784290349.784049:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901081600 00000100:00100000:0.0:1784290349.784085:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3793 00000100:00100000:0.0:1784290349.784096:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90736:x1870961901081600:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784290349.784153:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447ae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90736:x1870961901081600:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 62us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290349.784161:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3793 00000100:00100000:3.0:1784290349.784178:0:90736:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447ae9c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90736:1870961901081600:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1784290349.784190:0:90704:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1784290349.784209:0:90736:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784290349.784224:0:90704:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1784290349.787078:0:90704:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1784290349.787094:0:90704:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1784290349.787121:0:90704:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784290349.797191:0:90704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1784290349.804021:0:90704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1784290349.804045:0:90704:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1784290349.804090:0:90704:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784290349.804220:0:90736:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400090a3:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784290349.804260:0:90736:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1784290349.804262:0:90736:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:1.0:1784290349.804448:0:90704:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4d:0x0] (8/32) registered 00010000:00080000:1.0:1784290349.805848:0:90704:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 107374182407 00010000:00080000:1.0:1784290349.806477:0:90737:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 90737 00010000:02000000:1.0:1784290349.806491:0:90737:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1784290349.806495:0:90737:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1784290349.806499:0:90737:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1784290349.806558:0:90704:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784290349.806568:0:90704:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784290349.806582:0:90704:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1784290349.806593:0:90704:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1784290349.807459:0:90704:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784290349.807663:0:90704:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1784290350.247514:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784290350.247535:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784290350.247542:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901081728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290350.247559:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901081856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784290350.247637:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290350.247706:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901081728 00000100:00100000:1.0:1784290350.247715:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901081728 00000100:00100000:0.0:1784290350.247787:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290350.247829:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901081856 00000100:00100000:1.0:1784290350.247836:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901081856 00000100:00100000:0.0:1784290350.247852:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:0.0:1784290350.247871:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901081728:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290350.247887:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00002000:00000024:0.0:1784290350.247902:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290350.247908:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901081856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784290350.247938:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784290350.247992:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901081728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290350.248010:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:1.0:1784290350.248021:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901081856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290350.248033:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:2.0:1784290350.248069:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901081856:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784290350.248096:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901081728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784290350.597826:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290350.597917:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290350.597917:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896236800 00000100:00100000:0.0:1784290350.597952:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896236800 00000100:00100000:1.0:1784290350.598037:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896236928 00000100:00100000:1.0:1784290350.598051:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896236928 00000100:00100000:0.0:1784290350.598064:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 26 00000100:00100000:0.0:1784290350.598083:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2400:x1870961896236800:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290350.598118:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1154 00000020:00080000:0.0:1784290350.598126:0:90711:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.6@tcp 00000100:00100000:1.0:1784290350.598140:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1870961896236928:12345-192.168.202.6@tcp:38:kworker.0 00010000:00080000:1.0:1784290350.598239:0:65990:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'bd808cf4-dd54-45f0-9b2b-1434e8330e5d' at ffff9c2343905800, cookie 0x5953bbf6b30743d0 00010000:00080000:1.0:1784290350.598250:0:65990:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp recovering/t107374182408 exp ffff9c2343905800 cur 2091 last 1784290349 00000100:00100000:0.0:1784290350.598261:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2400:x1870961896236800:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 172us (433us total) trans 0 rc -107/-107 00010000:02000400:1.0:1784290350.598269:0:65990:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1784290350.598294:0:65990:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000100:00100000:0.0:1784290350.598295:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 26 00000004:00100000:1.0:1784290350.598329:0:65990:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1784290350.598584:0:65990:0:(import.c:65:import_set_state_nolock()) ffff9c2344980000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784290350.598643:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447ae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896236928:12345-192.168.202.6@tcp:38:kworker.0 Request processed in 509us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290350.598655:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1154 00000100:00100000:2.0:1784290350.598984:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290350.599041:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290350.599068:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896237056 00000100:00100000:0.0:1784290350.599081:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896237056 00000100:00100000:2.0:1784290350.599097:0:26259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896237312 00000100:00100000:2.0:1784290350.599108:0:26259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896237312 00000100:00100000:0.0:1784290350.599186:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 687 00000100:00100000:2.0:1784290350.599212:0:26259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1560 00000100:00100000:0.0:1784290350.599214:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d5a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2399:x1870961896237056:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290350.599239:0:26259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2399:x1870961896237312:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290350.599257:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290350.599309:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d5a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2399:x1870961896237056:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 104us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290350.599319:0:26259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2399:x1870961896237312:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 85us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290350.599386:0:26259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1560 00000100:00100000:0.0:1784290350.599407:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 687 00000100:00100000:2.0:1784290350.599411:0:26259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896237184 00000100:00100000:2.0:1784290350.599419:0:26259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896237184 00000100:00080000:0.0:1784290350.599464:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784290350.599477:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784290350.599487:0:26259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1561 00000100:00080000:0.0:1784290350.599489:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784290350.599507:0:26259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2400:x1870961896237184:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290350.599568:0:26259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447ae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2400:x1870961896237184:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 69us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290350.599578:0:26259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1561 00000100:00100000:2.0:1784290350.600137:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290350.600217:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896237440 00000100:00100000:3.0:1784290350.600227:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896237440 00000100:00100000:0.0:1784290350.600404:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:0.0:1784290350.600420:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2396:x1870961896237440:12345-192.168.202.6@tcp:250:ptlrpcd_01_01.0 00010000:00080000:0.0:1784290350.600457:0:90712:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from bdffa268-fb6a-4248-991c-0ad16fac303f@192.168.202.6@tcp t0 exp 0000000000000000 cur 2091 last 0 00000020:00000080:0.0:1784290350.600504:0:90712:0:(genops.c:1406:class_connect()) connect: client bdffa268-fb6a-4248-991c-0ad16fac303f, cookie 0x5953bbf6b3074486 00000100:00100000:2.0:1784290350.600668:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290350.600768:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896230400 00000100:00080000:0.0:1784290350.600821:0:90712:0:(import.c:65:import_set_state_nolock()) ffff9c2474f85000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784290350.600869:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896230400 00000100:00100000:0.0:1784290350.600905:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+5:2396:x1870961896237440:12345-192.168.202.6@tcp:250:ptlrpcd_01_01.0 Request processed in 482us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290350.600919:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 27 00000100:00100000:3.0:1784290350.600946:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1155 00000100:00100000:3.0:1784290350.600967:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896230400:12345-192.168.202.6@tcp:36:mcreate.0 00010000:00080000:3.0:1784290350.600989:0:74876:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182408, current: 107374182408, replaying 00000100:00100000:3.0:1784290350.601022:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896230400:12345-192.168.202.6@tcp:36:mcreate.0 Request processed in 65us (360us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784290350.601036:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1155 00010000:00080000:0.0:1784290350.601053:0:90737:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:0.0:1784290350.759484:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784290351.079423:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784290351.079430:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9c247036f800 from 116 10000000:01000000:3.0:1784290351.079434:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784290351.079477:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5de00/0x5953bbf6b307448d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.079488:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2458d5de00/0x5953bbf6b307448d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.079499:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2458d5de00/0x5953bbf6b307448d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290351.079532:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901081984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.079592:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290351.079635:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784290351.079646:0:90714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901081984 00000100:00100000:1.0:1784290351.079655:0:90714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901081984 00000100:00100000:1.0:1784290351.079709:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784290351.079731:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:6485:x1870961901081984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290351.079745:0:90714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290351.079758:0:90714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236ce00/0x5953bbf6b3074494 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307448d expref: -99 pid: 90714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.079781:0:90714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236ce00/0x5953bbf6b3074494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307448d expref: 11 pid: 90714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.079790:0:90714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236ce00/0x5953bbf6b3074494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307448d expref: 11 pid: 90714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.079799:0:90714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236ce00, rc 0) 00000100:00100000:1.0:1784290351.079848:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901081984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290351.079855:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784290351.079893:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901081984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290351.079911:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2458d5de00/0x5953bbf6b307448d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074494 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.079920:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2458d5de00/0x5953bbf6b307448d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074494 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290351.079977:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901082112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.080018:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290351.080039:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784290351.080080:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901082112 00000100:00100000:1.0:1784290351.080086:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901082112 00000100:00100000:1.0:1784290351.080120:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784290351.080127:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901082112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784290351.080141:0:90710:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784290351.080158:0:90710:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784290351.080161:0:90710:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 116 00000100:00100000:1.0:1784290351.080250:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901082112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290351.080259:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784290351.080270:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901082112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784290351.080318:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784290351.080335:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5de00/0x5953bbf6b307448d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074494 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.080373:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2458d5de00/0x5953bbf6b307448d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074494 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290351.080381:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784290351.080384:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c23452c5000 from 52 10000000:01000000:3.0:1784290351.080386:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784290351.080401:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b307449b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.080418:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b307449b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.080424:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b307449b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290351.080434:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901082240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.080462:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290351.080497:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784290351.080511:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901082240 00000100:00100000:1.0:1784290351.080517:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901082240 00000100:00100000:1.0:1784290351.080548:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784290351.080557:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901082240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290351.080564:0:90711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290351.080573:0:90711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236d400/0x5953bbf6b30744a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307449b expref: -99 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.080586:0:90711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236d400/0x5953bbf6b30744a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307449b expref: 12 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.080594:0:90711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236d400/0x5953bbf6b30744a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307449b expref: 12 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.080599:0:90711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236d400, rc 0) 00000100:00100000:1.0:1784290351.080636:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901082240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290351.080642:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784290351.080673:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901082240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290351.080688:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b307449b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30744a2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.080696:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b307449b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30744a2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290351.080786:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901082368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.080810:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290351.080828:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784290351.080855:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901082368 00000100:00100000:1.0:1784290351.080867:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901082368 00000100:00100000:1.0:1784290351.080900:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784290351.080906:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901082368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290351.081022:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a472850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901082368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290351.081029:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784290351.081061:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901082368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.081092:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901082496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.081130:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290351.081149:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784290351.081164:0:90714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901082496 00000100:00100000:1.0:1784290351.081170:0:90714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901082496 00000100:00100000:1.0:1784290351.081200:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784290351.081207:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901082496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290351.081293:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a472450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901082496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290351.081300:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784290351.081318:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901082496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784290351.082054:0:90911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1784290351.082137:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1784290351.082163:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290351.082168:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b307449b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30744a2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.082175:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b307449b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30744a2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290351.082181:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784290351.082182:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9c23452c5000 from 113 10000000:01000000:3.0:1784290351.082184:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784290351.082197:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c000/0x5953bbf6b30744a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.082203:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c000/0x5953bbf6b30744a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.082209:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c000/0x5953bbf6b30744a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290351.082219:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901082624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.082242:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290351.082264:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784290351.082271:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901082624 00000100:00100000:1.0:1784290351.082277:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901082624 00000100:00100000:1.0:1784290351.082305:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784290351.082313:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a470850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901082624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290351.082320:0:90710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290351.082327:0:90710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236cc00/0x5953bbf6b30744b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30744a9 expref: -99 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.082379:0:90710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236cc00/0x5953bbf6b30744b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30744a9 expref: 13 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.082388:0:90710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236cc00/0x5953bbf6b30744b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30744a9 expref: 13 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.082406:0:90710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236cc00, rc 0) 00000100:00100000:1.0:1784290351.082443:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a470850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901082624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290351.082449:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784290351.082460:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901082624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290351.082474:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c000/0x5953bbf6b30744a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30744b0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.082482:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c000/0x5953bbf6b30744a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30744b0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290351.082520:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901082752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.082558:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290351.082591:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901082752 00000100:00100000:3.0:1784290351.082595:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784290351.082596:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901082752 00000100:00100000:1.0:1784290351.082629:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784290351.082636:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901082752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784290351.082647:0:90711:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784290351.082659:0:90711:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784290351.082662:0:90711:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1784290351.082665:0:90711:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1784290351.082667:0:90711:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1784290351.082669:0:90711:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 116 00000100:00100000:1.0:1784290351.082774:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901082752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290351.082781:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784290351.082795:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901082752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784290351.082862:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784290351.082867:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c000/0x5953bbf6b30744a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30744b0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.082874:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c000/0x5953bbf6b30744a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30744b0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290351.082880:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1784290351.082882:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1784290351.082884:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1784290351.082898:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b30744b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.082904:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b30744b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.082910:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b30744b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290351.082921:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901082880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.082952:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290351.082979:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784290351.082990:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901082880 00000100:00100000:1.0:1784290351.082997:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901082880 00000100:00100000:1.0:1784290351.083039:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784290351.083051:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23451dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901082880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290351.083059:0:90712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290351.083067:0:90712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236d000/0x5953bbf6b30744be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30744b7 expref: -99 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.083081:0:90712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236d000/0x5953bbf6b30744be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30744b7 expref: 14 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.083099:0:90712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236d000/0x5953bbf6b30744be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30744b7 expref: 14 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.083105:0:90712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236d000, rc 0) 00000100:00100000:1.0:1784290351.083140:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23451dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901082880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290351.083146:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784290351.083169:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901082880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290351.083180:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b30744b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30744be expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.083197:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b30744b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30744be expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290351.083232:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901083008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.083256:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290351.083274:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784290351.083286:0:90714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901083008 00000100:00100000:1.0:1784290351.083291:0:90714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901083008 00000100:00100000:1.0:1784290351.083319:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784290351.083327:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23451da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901083008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290351.083441:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23451da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901083008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290351.083447:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784290351.083468:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901083008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.083491:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901083136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.083530:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290351.083555:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784290351.083557:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901083136 00000100:00100000:1.0:1784290351.083562:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901083136 00000100:00100000:1.0:1784290351.083591:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784290351.083597:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23451da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901083136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290351.084101:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23451da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901083136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 502us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290351.084109:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784290351.084140:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901083136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784290351.084816:0:90912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1784290351.084885:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1784290351.084908:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1784290351.084914:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b30744b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30744be expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.084931:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b30744b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30744be expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290351.084936:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1784290351.084938:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9c23452c5000 from 1 10000000:01000000:1.0:1784290351.084940:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784290351.084955:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b30744c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.084961:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b30744c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.084967:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b30744c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290351.084980:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901083264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290351.085007:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290351.085038:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e0f600 going to sleep for 11 seconds 00000100:00100000:3.0:1784290351.085050:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901083264 00000100:00100000:3.0:1784290351.085055:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901083264 00000100:00100000:3.0:1784290351.085085:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784290351.085091:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23451d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901083264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290351.085099:0:90711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290351.085108:0:90711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2458d5d200/0x5953bbf6b30744cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30744c5 expref: -99 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.085121:0:90711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2458d5d200/0x5953bbf6b30744cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30744c5 expref: 15 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.085130:0:90711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2458d5d200/0x5953bbf6b30744cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30744c5 expref: 15 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.085147:0:90711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2458d5d200, rc 0) 00000100:00100000:3.0:1784290351.085185:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23451d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:6485:x1870961901083264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290351.085192:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784290351.085204:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901083264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290351.085219:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b30744c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30744cc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.085226:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b30744c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30744cc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290351.085236:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784290351.085240:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b30744c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30744cc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.085258:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b30744c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30744cc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290351.085264:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784290351.085266:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c23452c5000 from 7 10000000:01000000:1.0:1784290351.085268:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784290351.085281:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236d200/0x5953bbf6b30744d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.085287:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c234236d200/0x5953bbf6b30744d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.085293:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c234236d200/0x5953bbf6b30744d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290351.085304:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901083392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290351.085334:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290351.085379:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901083392 00000100:00100000:3.0:1784290351.085384:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901083392 00000100:00100000:1.0:1784290351.085397:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e0f600 going to sleep for 11 seconds 00000100:00100000:3.0:1784290351.085424:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784290351.085431:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23451db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:6485:x1870961901083392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290351.085438:0:90712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290351.085445:0:90712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2458d5ca00/0x5953bbf6b30744da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30744d3 expref: -99 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.085457:0:90712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2458d5ca00/0x5953bbf6b30744da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30744d3 expref: 16 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.085474:0:90712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2458d5ca00/0x5953bbf6b30744da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30744d3 expref: 16 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.085480:0:90712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2458d5ca00, rc 0) 00000100:00100000:3.0:1784290351.085510:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23451db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901083392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290351.085516:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784290351.085525:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901083392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290351.085540:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c234236d200/0x5953bbf6b30744d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30744da expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.085547:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c234236d200/0x5953bbf6b30744d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30744da expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290351.085581:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901083520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290351.085603:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290351.085631:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e0f600 going to sleep for 11 seconds 00000100:00100000:3.0:1784290351.085632:0:90714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901083520 00000100:00100000:3.0:1784290351.085637:0:90714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901083520 00000100:00100000:3.0:1784290351.085665:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784290351.085672:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23451d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901083520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.085758:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23451d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901083520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290351.085770:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901083520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.085782:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784290351.085804:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901083648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290351.085842:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290351.085861:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e0f600 going to sleep for 11 seconds 00000100:00100000:2.0:1784290351.085891:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901083648 00000100:00100000:2.0:1784290351.085906:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901083648 00000100:00100000:2.0:1784290351.085951:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784290351.085961:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23451db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901083648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290351.086047:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23451db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901083648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290351.086054:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784290351.086075:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901083648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784290351.086729:0:90913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784290351.086788:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784290351.086814:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784290351.086820:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236d200/0x5953bbf6b30744d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30744da expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.086828:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c234236d200/0x5953bbf6b30744d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30744da expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290351.086835:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784290351.086836:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c246ff27800 from 52 10000000:01000000:1.0:1784290351.086838:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784290351.086852:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236dc00/0x5953bbf6b30744e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.086859:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c234236dc00/0x5953bbf6b30744e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.086865:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c234236dc00/0x5953bbf6b30744e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290351.086876:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901083776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290351.086901:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290351.086944:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e0f600 going to sleep for 11 seconds 00000100:00100000:2.0:1784290351.086961:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901083776 00000100:00100000:2.0:1784290351.086970:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901083776 00000100:00100000:2.0:1784290351.087014:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784290351.087025:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901083776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290351.087034:0:90711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290351.087047:0:90711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ef9800/0x5953bbf6b30744e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30744e1 expref: -99 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290351.087067:0:90711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ef9800/0x5953bbf6b30744e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30744e1 expref: 17 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290351.087080:0:90711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ef9800/0x5953bbf6b30744e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30744e1 expref: 17 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290351.087089:0:90711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef9800, rc 0) 00000100:00100000:2.0:1784290351.087130:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cb6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901083776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290351.087136:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784290351.087147:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901083776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290351.087162:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c234236dc00/0x5953bbf6b30744e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30744e8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.087170:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c234236dc00/0x5953bbf6b30744e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30744e8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290351.087204:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901083904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290351.087230:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290351.087249:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e0f600 going to sleep for 11 seconds 00000100:00100000:3.0:1784290351.087253:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901083904 00000100:00100000:3.0:1784290351.087259:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901083904 00000100:00100000:3.0:1784290351.087291:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784290351.087297:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901083904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.087398:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cb4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901083904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290351.087405:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784290351.087413:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901083904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290351.087441:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901084032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290351.087487:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290351.087519:0:90714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901084032 00000100:00100000:1.0:1784290351.087523:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e0f600 going to sleep for 11 seconds 00000100:00100000:3.0:1784290351.087524:0:90714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901084032 00000100:00100000:3.0:1784290351.087558:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784290351.087565:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901084032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.087635:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cb4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901084032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290351.087643:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784290351.087651:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901084032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784290351.088370:0:90914:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1784290351.088419:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1784290351.088442:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784290351.088449:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236dc00/0x5953bbf6b30744e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30744e8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.088456:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c234236dc00/0x5953bbf6b30744e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30744e8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290351.088462:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1784290351.088464:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1784290351.088465:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784290351.088486:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236c800/0x5953bbf6b30744ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.088492:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c234236c800/0x5953bbf6b30744ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.088497:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c234236c800/0x5953bbf6b30744ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290351.088508:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901084160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290351.088533:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290351.088568:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901084160 00000100:00100000:1.0:1784290351.088571:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e0f600 going to sleep for 11 seconds 00000100:00100000:2.0:1784290351.088574:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901084160 00000100:00100000:2.0:1784290351.088609:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784290351.088623:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901084160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290351.088630:0:90710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290351.088638:0:90710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ef8800/0x5953bbf6b30744f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30744ef expref: -99 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290351.088651:0:90710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ef8800/0x5953bbf6b30744f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30744ef expref: 18 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290351.088658:0:90710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ef8800/0x5953bbf6b30744f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30744ef expref: 18 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290351.088663:0:90710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef8800, rc 0) 00000100:00100000:2.0:1784290351.088699:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cb5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901084160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290351.088705:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784290351.088731:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901084160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290351.088744:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c234236c800/0x5953bbf6b30744ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30744f6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.088752:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c234236c800/0x5953bbf6b30744ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30744f6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290351.088786:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901084288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290351.088810:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290351.088826:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e0f600 going to sleep for 11 seconds 00000100:00100000:2.0:1784290351.088836:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901084288 00000100:00100000:2.0:1784290351.088841:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901084288 00000100:00100000:2.0:1784290351.088866:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784290351.088873:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901084288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290351.088981:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cb6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901084288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290351.088988:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784290351.089011:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d10e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901084288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.089042:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901084416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.089076:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290351.089095:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8900 going to sleep for 11 seconds 00000100:00100000:1.0:1784290351.089116:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901084416 00000100:00100000:1.0:1784290351.089122:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901084416 00000100:00100000:1.0:1784290351.089154:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784290351.089163:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901084416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290351.089602:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cb6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901084416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 439us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290351.089622:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901084416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290351.089623:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000040:00080000:1.0:1784290351.090266:0:90915:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1784290351.090319:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1784290351.090386:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1784290351.090393:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236c800/0x5953bbf6b30744ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30744f6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.090411:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c234236c800/0x5953bbf6b30744ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30744f6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290351.090418:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784290351.090420:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c246ff27800 from 7 10000000:01000000:3.0:1784290351.090423:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784290351.090438:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d400/0x5953bbf6b30744fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.090454:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d400/0x5953bbf6b30744fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.090460:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d400/0x5953bbf6b30744fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290351.090471:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901084544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.090496:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290351.090525:0:90714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901084544 00000100:00100000:3.0:1784290351.090529:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8900 going to sleep for 11 seconds 00000100:00100000:1.0:1784290351.090531:0:90714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901084544 00000100:00100000:1.0:1784290351.090567:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784290351.090576:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901084544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290351.090583:0:90714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290351.090591:0:90714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236d800/0x5953bbf6b3074504 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30744fd expref: -99 pid: 90714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.090605:0:90714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236d800/0x5953bbf6b3074504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30744fd expref: 19 pid: 90714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.090612:0:90714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236d800/0x5953bbf6b3074504 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30744fd expref: 19 pid: 90714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.090618:0:90714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236d800, rc 0) 00000100:00100000:1.0:1784290351.090655:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cb5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901084544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290351.090661:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784290351.090680:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447aeb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901084544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290351.090695:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d400/0x5953bbf6b30744fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074504 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290351.090703:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d400/0x5953bbf6b30744fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074504 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290351.090776:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901084672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290351.090809:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290351.090831:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b260540 going to sleep for 11 seconds 00000100:00100000:1.0:1784290351.090841:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901084672 00000100:00100000:1.0:1784290351.090846:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901084672 00000100:00100000:1.0:1784290351.090878:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784290351.090885:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901084672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290351.090954:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901084672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290351.090961:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784290351.090977:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901084672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290351.091010:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901084800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290351.091046:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290351.091064:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b260540 going to sleep for 11 seconds 00000100:00100000:3.0:1784290351.091067:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901084800 00000100:00100000:3.0:1784290351.091073:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901084800 00000100:00100000:3.0:1784290351.091104:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784290351.091110:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901084800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.091184:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901084800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290351.091191:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784290351.091195:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901084800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784290351.091833:0:90916:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784290351.091892:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784290351.091914:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784290351.091921:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d400/0x5953bbf6b30744fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074504 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290351.091932:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d400/0x5953bbf6b30744fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074504 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290351.091942:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784290351.091945:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c247d3d2000 from 52 10000000:01000000:2.0:1784290351.091948:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784290351.091963:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ef9200/0x5953bbf6b307450b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290351.091969:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2345ef9200/0x5953bbf6b307450b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290351.091976:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2345ef9200/0x5953bbf6b307450b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290351.091993:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901084928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290351.092020:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290351.092051:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b318cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290351.092064:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901084928 00000100:00100000:3.0:1784290351.092069:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901084928 00000100:00100000:3.0:1784290351.092110:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784290351.092118:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901084928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290351.092125:0:90712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290351.092133:0:90712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2458d5d000/0x5953bbf6b3074512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307450b expref: -99 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.092147:0:90712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2458d5d000/0x5953bbf6b3074512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307450b expref: 20 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.092154:0:90712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2458d5d000/0x5953bbf6b3074512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307450b expref: 20 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.092160:0:90712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2458d5d000, rc 0) 00000100:00100000:3.0:1784290351.092196:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901084928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290351.092202:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784290351.092228:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901084928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290351.092242:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2345ef9200/0x5953bbf6b307450b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074512 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290351.092250:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2345ef9200/0x5953bbf6b307450b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074512 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290351.092286:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901085056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290351.092311:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290351.092328:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b318cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290351.092359:0:90714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901085056 00000100:00100000:3.0:1784290351.092364:0:90714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901085056 00000100:00100000:3.0:1784290351.092394:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784290351.092401:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901085056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.092464:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901085056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 64us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290351.092471:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784290351.092480:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901085056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290351.092506:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901085184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290351.092542:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290351.092575:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901085184 00000100:00100000:3.0:1784290351.092579:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901085184 00000100:00100000:2.0:1784290351.092580:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b318cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290351.092611:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784290351.092619:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901085184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.092686:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901085184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290351.092702:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901085184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.092703:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000040:00080000:3.0:1784290351.093327:0:90917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1784290351.093429:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1784290351.093445:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784290351.093450:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ef9200/0x5953bbf6b307450b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074512 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290351.093456:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2345ef9200/0x5953bbf6b307450b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074512 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290351.093473:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784290351.093474:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1784290351.093476:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784290351.093492:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8000/0x5953bbf6b3074519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290351.093497:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8000/0x5953bbf6b3074519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290351.093504:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8000/0x5953bbf6b3074519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290351.093515:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901085312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290351.093542:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290351.093574:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901085312 00000100:00100000:2.0:1784290351.093577:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b318cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290351.093580:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901085312 00000100:00100000:3.0:1784290351.093614:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784290351.093623:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901085312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290351.093629:0:90711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290351.093636:0:90711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2458d5cc00/0x5953bbf6b3074520 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074519 expref: -99 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.093649:0:90711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2458d5cc00/0x5953bbf6b3074520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074519 expref: 21 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.093656:0:90711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2458d5cc00/0x5953bbf6b3074520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074519 expref: 21 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.093662:0:90711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2458d5cc00, rc 0) 00000100:00100000:3.0:1784290351.093699:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901085312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290351.093706:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784290351.093727:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901085312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290351.093746:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8000/0x5953bbf6b3074519 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074520 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290351.093754:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8000/0x5953bbf6b3074519 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074520 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290351.093803:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901085440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290351.093829:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290351.093848:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b318cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290351.093858:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901085440 00000100:00100000:3.0:1784290351.093863:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901085440 00000100:00100000:3.0:1784290351.093889:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1784290351.093895:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2341e9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901085440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.093976:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2341e9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901085440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290351.093983:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784290351.094006:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901085440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290351.094033:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901085568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290351.094074:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290351.094094:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b318cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290351.094106:0:90714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901085568 00000100:00100000:3.0:1784290351.094111:0:90714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901085568 00000100:00100000:3.0:1784290351.094137:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784290351.094143:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475d5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901085568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.094651:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475d5fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901085568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 507us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290351.094661:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784290351.094680:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901085568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784290351.095363:0:90918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1784290351.095422:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1784290351.095451:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784290351.095459:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8000/0x5953bbf6b3074519 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074520 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.095467:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8000/0x5953bbf6b3074519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074520 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290351.095473:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784290351.095475:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c247d3d2000 from 7 10000000:01000000:3.0:1784290351.095477:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784290351.095491:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074527 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.095497:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074527 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.095503:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074527 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290351.095515:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447aeb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901085696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.095540:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290351.095576:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24586303c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290351.095589:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901085696 00000100:00100000:2.0:1784290351.095595:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901085696 00000100:00100000:2.0:1784290351.095625:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784290351.095631:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475d5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901085696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290351.095639:0:90710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290351.095646:0:90710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ef8600/0x5953bbf6b307452e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074527 expref: -99 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290351.095659:0:90710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ef8600/0x5953bbf6b307452e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074527 expref: 22 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290351.095668:0:90710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ef8600/0x5953bbf6b307452e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074527 expref: 22 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290351.095673:0:90710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef8600, rc 0) 00000100:00100000:2.0:1784290351.095708:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475d5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901085696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290351.095732:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784290351.095742:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447aeb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901085696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290351.095756:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074527 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307452e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.095764:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074527 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307452e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290351.095796:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447aeb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901085824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.095820:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290351.095837:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24586303c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290351.095850:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901085824 00000100:00100000:2.0:1784290351.095855:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901085824 00000100:00100000:2.0:1784290351.095881:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784290351.095891:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234517a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901085824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290351.095977:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234517a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901085824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290351.095986:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447aeb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901085824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290351.095998:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784290351.096016:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447aeb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901085952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290351.096054:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290351.096071:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24586303c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290351.096083:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901085952 00000100:00100000:2.0:1784290351.096088:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901085952 00000100:00100000:2.0:1784290351.096114:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784290351.096121:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23441c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901085952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290351.096192:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23441c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901085952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290351.096201:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784290351.096209:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447aeb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901085952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784290351.096884:0:90919:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784290351.096939:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784290351.096958:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784290351.096964:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074527 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307452e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.096972:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074527 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307452e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290351.096979:0:6485:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784290351.096981:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9c2480260000 from 1 10000000:01000000:1.0:1784290351.096983:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784290351.096998:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236c600/0x5953bbf6b3074535 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.097004:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c234236c600/0x5953bbf6b3074535 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.097011:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c234236c600/0x5953bbf6b3074535 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290351.097024:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901086080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290351.097052:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290351.097084:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e0fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1784290351.097097:0:90714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901086080 00000100:00100000:3.0:1784290351.097102:0:90714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901086080 00000100:00100000:3.0:1784290351.097132:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784290351.097141:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901086080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290351.097148:0:90714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290351.097155:0:90714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2458d5d600/0x5953bbf6b307453c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074535 expref: -99 pid: 90714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.097168:0:90714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2458d5d600/0x5953bbf6b307453c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074535 expref: 23 pid: 90714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.097183:0:90714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2458d5d600/0x5953bbf6b307453c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074535 expref: 23 pid: 90714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.097189:0:90714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2458d5d600, rc 0) 00000100:00100000:3.0:1784290351.097226:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901086080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290351.097234:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784290351.097242:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901086080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290351.097256:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c234236c600/0x5953bbf6b3074535 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307453c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.097263:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c234236c600/0x5953bbf6b3074535 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307453c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290351.097287:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784290351.097291:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236c600/0x5953bbf6b3074535 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307453c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.097296:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c234236c600/0x5953bbf6b3074535 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307453c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290351.097302:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784290351.097303:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9c2480260000 from 1 10000000:01000000:1.0:1784290351.097305:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784290351.097316:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236de00/0x5953bbf6b3074543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.097321:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c234236de00/0x5953bbf6b3074543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.097327:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c234236de00/0x5953bbf6b3074543 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290351.097336:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901086208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290351.097398:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290351.097426:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901086208 00000100:00100000:1.0:1784290351.097430:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e0fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1784290351.097431:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901086208 00000100:00100000:3.0:1784290351.097465:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784290351.097472:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901086208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290351.097478:0:90710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290351.097485:0:90710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2458d5d800/0x5953bbf6b307454a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074543 expref: -99 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.097496:0:90710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2458d5d800/0x5953bbf6b307454a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074543 expref: 24 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.097503:0:90710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2458d5d800/0x5953bbf6b307454a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074543 expref: 24 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.097509:0:90710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2458d5d800, rc 0) 00000100:00100000:3.0:1784290351.097541:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901086208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290351.097548:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784290351.097559:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901086208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290351.097572:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c234236de00/0x5953bbf6b3074543 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307454a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290351.097580:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c234236de00/0x5953bbf6b3074543 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307454a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290351.097627:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901086336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290351.097650:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290351.097667:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e0fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1784290351.097671:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901086336 00000100:00100000:2.0:1784290351.097676:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901086336 00000100:00100000:2.0:1784290351.097708:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784290351.097730:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901086336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290351.097788:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901086336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (135us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784290351.097795:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784290351.097806:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d11c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901086336:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1784290351.097832:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784290351.097844:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236de00/0x5953bbf6b3074543 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307454a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290351.097850:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c234236de00/0x5953bbf6b3074543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307454a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:2.0:1784290351.466279:0:90988:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1784290351.783453:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1784290351.833274:0:91040:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784290351.833526:0:91040:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1784290352.255267:0:91090:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784290352.255638:0:91090:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1784290352.453788:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290352.453880:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896237568 00000100:00100000:1.0:1784290352.453894:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896237568 00000100:00100000:1.0:1784290352.453981:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:1.0:1784290352.453994:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+5:42227:x1870961896237568:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290352.454015:0:90712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290352.454037:0:90712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236ca00/0x5953bbf6b3074551 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2367 expref: -99 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290352.454074:0:90712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236ca00/0x5953bbf6b3074551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2367 expref: 6 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290352.454088:0:90712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236ca00/0x5953bbf6b3074551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2367 expref: 6 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290352.454099:0:90712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236ca00, rc 0) 00000100:00100000:1.0:1784290352.454170:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+6:42227:x1870961896237568:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 178us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290352.454179:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:2.0:1784290352.455933:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290352.456021:0:90714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896237696 00000100:00100000:3.0:1784290352.456031:0:90714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896237696 00000100:00100000:3.0:1784290352.456078:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:3.0:1784290352.456090:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdffa268-fb6a-4248-991c-0ad16fac303f+6:42227:x1870961896237696:12345-192.168.202.6@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784290352.456113:0:90714:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1784290352.456141:0:90714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784290352.456147:0:90714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1784290352.456151:0:90714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1784290352.456154:0:90714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1784290352.456157:0:90714:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 116 00000100:00100000:3.0:1784290352.457440:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468b03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdffa268-fb6a-4248-991c-0ad16fac303f+6:42227:x1870961896237696:12345-192.168.202.6@tcp:256:ll_cfg_requeue.0 Request processed in 1345us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290352.457458:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:2.0:1784290352.458805:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290352.458868:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896237824 00000100:00100000:3.0:1784290352.458876:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896237824 00000100:00100000:3.0:1784290352.458919:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:3.0:1784290352.458928:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdffa268-fb6a-4248-991c-0ad16fac303f+6:42227:x1870961896237824:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290352.458938:0:90710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290352.458950:0:90710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2458d5c200/0x5953bbf6b3074558 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b236e expref: -99 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290352.458971:0:90710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2458d5c200/0x5953bbf6b3074558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b236e expref: 7 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290352.458994:0:90710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2458d5c200/0x5953bbf6b3074558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b236e expref: 7 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290352.459004:0:90710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2458d5c200, rc 0) 00000100:00100000:3.0:1784290352.459048:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468b03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdffa268-fb6a-4248-991c-0ad16fac303f+7:42227:x1870961896237824:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 121us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290352.459056:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:2.0:1784290352.460495:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290352.460599:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896237952 00000100:00100000:1.0:1784290352.460608:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896237952 00000100:00100000:1.0:1784290352.460672:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:1.0:1784290352.460684:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+7:42227:x1870961896237952:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290352.460828:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+8:42227:x1870961896237952:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 147us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290352.460846:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:2.0:1784290352.461927:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290352.462049:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896238080 00000100:00100000:1.0:1784290352.462058:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896238080 00000100:00100000:1.0:1784290352.462105:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:1.0:1784290352.462114:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+8:42227:x1870961896238080:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290352.462228:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468b03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+8:42227:x1870961896238080:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 112us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290352.462237:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:2.0:1784290352.465423:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290352.465503:0:90714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896238208 00000100:00100000:3.0:1784290352.465513:0:90714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896238208 00000100:00100000:3.0:1784290352.465575:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:3.0:1784290352.465680:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475cab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdffa268-fb6a-4248-991c-0ad16fac303f+8:42227:x1870961896238208:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290352.465697:0:90714:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290352.465738:0:90714:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2458d5ce00/0x5953bbf6b307455f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2375 expref: -99 pid: 90714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290352.465764:0:90714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2458d5ce00/0x5953bbf6b307455f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2375 expref: 9 pid: 90714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290352.465777:0:90714:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2458d5ce00/0x5953bbf6b307455f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2375 expref: 9 pid: 90714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290352.465787:0:90714:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2458d5ce00, rc 0) 00000100:00100000:3.0:1784290352.465839:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475cab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896238208:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 252us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290352.465848:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:2.0:1784290352.467325:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290352.467391:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896238336 00000100:00100000:3.0:1784290352.467408:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896238336 00000100:00100000:3.0:1784290352.467449:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:3.0:1784290352.467457:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475cab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896238336:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290352.467556:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475cab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896238336:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 96us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290352.467571:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:2.0:1784290352.468802:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290352.468889:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896238464 00000100:00100000:1.0:1784290352.468900:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896238464 00000100:00100000:1.0:1784290352.468959:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:1.0:1784290352.468974:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475cab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896238464:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290352.469109:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475cab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896238464:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 135us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290352.469124:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:2.0:1784290352.471656:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290352.471808:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896238592 00000100:00100000:1.0:1784290352.471817:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896238592 00000100:00100000:1.0:1784290352.471865:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:1.0:1784290352.471876:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+9:42227:x1870961896238592:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290352.471889:0:90712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290352.471902:0:90712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236c400/0x5953bbf6b3074566 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b237c expref: -99 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290352.471925:0:90712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236c400/0x5953bbf6b3074566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b237c expref: 10 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290352.471953:0:90712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236c400/0x5953bbf6b3074566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b237c expref: 10 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290352.471980:0:90712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236c400, rc 0) 00000100:00100000:1.0:1784290352.472023:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+10:42227:x1870961896238592:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 149us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290352.472031:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:2.0:1784290352.473413:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290352.473505:0:90714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896238720 00000100:00100000:3.0:1784290352.473514:0:90714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896238720 00000100:00100000:3.0:1784290352.473555:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00100000:3.0:1784290352.473564:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dcf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdffa268-fb6a-4248-991c-0ad16fac303f+10:42227:x1870961896238720:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290352.473639:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dcf1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:bdffa268-fb6a-4248-991c-0ad16fac303f+10:42227:x1870961896238720:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 73us (226us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784290352.473649:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 72 00010000:00010000:0.0:1784290352.807555:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290353.831559:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.855487:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784290354.855531:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290354.855536:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1784290354.855540:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1784290354.855541:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290354.855554:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290354.855558:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901086464:0@lo:400:kworker.0 00000100:00100000:3.0:1784290354.855561:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23443bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901086592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784290354.855573:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a42c000 x1870961901086720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290354.855619:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901086720:0@lo:38:kworker.0 00000100:00080000:2.0:1784290354.855653:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290354.855657:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290354.855660:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290354.855664:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290354.855676:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c24483c8a80 x1870961901086976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784290354.855704:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290354.855704:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290354.855710:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784290354.855733:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290354.855736:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290354.855738:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290354.855743:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290354.855753:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c24483c9500 x1870961901087232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784290354.855777:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290354.855779:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290354.855781:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290354.855786:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290354.855793:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901087104:0@lo:400:kworker.0 00000100:00100000:0.0:1784290354.855798:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901086976:0@lo:38:kworker.0 00000100:00100000:1.0:1784290354.855799:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901087488:0@lo:400:kworker.0 00000100:00100000:2.0:1784290354.855800:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c24483cb800 x1870961901087616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784290354.855824:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290354.855847:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290354.855868:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784290354.855869:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901086720 00000100:00100000:0.0:1784290354.855877:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901086720 00000100:00100000:3.0:1784290354.855878:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901087360:0@lo:400:kworker.0 00000100:00080000:2.0:1784290354.855879:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:1.0:1784290354.855882:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00080000:2.0:1784290354.855889:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290354.855891:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c24444ae000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1784290354.855894:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901086848:0@lo:400:kworker.0 00000100:00080000:2.0:1784290354.855899:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c24444ae000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290354.855910:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901087104 00000100:00100000:0.0:1784290354.855914:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901087104 00000100:00100000:2.0:1784290354.855915:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2445d6ce00 x1870961901088000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784290354.855921:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290354.855932:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290354.855959:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901087872:0@lo:400:kworker.0 00000100:00100000:2.0:1784290354.855964:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901086848 00000100:00100000:1.0:1784290354.855966:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901087744:0@lo:400:kworker.0 00000100:00100000:2.0:1784290354.855970:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901086848 00000100:00100000:0.0:1784290354.855971:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:0.0:1784290354.855986:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901087104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290354.855993:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290354.856021:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:2.0:1784290354.856030:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:1.0:1784290354.856035:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901086848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290354.856040:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901086720:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784290354.856045:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901086592 00000100:00100000:3.0:1784290354.856049:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901086592 00000100:00100000:0.0:1784290354.856057:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447aeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901087104:12345-0@lo:400:kworker.0 Request processed in 74us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290354.856063:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00010000:00080000:2.0:1784290354.856068:0:66008:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2096 last 0 00000100:00100000:1.0:1784290354.856087:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901086848:12345-0@lo:400:kworker.0 Request processed in 56us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290354.856093:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3794 00000100:00100000:1.0:1784290354.856097:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:0.0:1784290354.856097:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901087488 00000100:00100000:0.0:1784290354.856103:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901087488 00000100:00100000:3.0:1784290354.856113:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901086592:12345-0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1784290354.856116:0:66008:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5953bbf6b307456d 00000004:00100000:2.0:1784290354.856136:0:66008:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1784290354.856139:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901087360 00000004:00000024:3.0:1784290354.856141:0:8413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:0.0:1784290354.856143:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901087360 00000100:00100000:1.0:1784290354.856144:0:26251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901087872 00000100:00100000:1.0:1784290354.856151:0:26251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901087872 00000100:00100000:0.0:1784290354.856178:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1562 00000100:00100000:3.0:1784290354.856188:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447aeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901086592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290354.856190:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901087488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290354.856204:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3794 00000100:00100000:1.0:1784290354.856205:0:26251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1563 00000100:00100000:1.0:1784290354.856219:0:26251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901087360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290354.856242:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564 00000100:00100000:0.0:1784290354.856245:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901087488:12345-0@lo:400:kworker.0 Request processed in 57us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290354.856254:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901087872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290354.856258:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1562 00000100:00100000:1.0:1784290354.856268:0:26251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901087360:12345-0@lo:400:kworker.0 Request processed in 52us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290354.856277:0:26251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1563 00000100:00080000:0.0:1784290354.856293:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784290354.856299:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784290354.856304:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901087872:12345-0@lo:400:kworker.0 Request processed in 50us (311us total) trans 0 rc 0/0 00000100:00080000:0.0:1784290354.856305:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784290354.856314:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564 00000100:00080000:2.0:1784290354.856328:0:66008:0:(import.c:65:import_set_state_nolock()) ffff9c246d8aa800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784290354.856335:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290354.856371:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290354.856376:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901087872:0@lo:400:kworker.0 00000100:00100000:1.0:1784290354.856382:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901087232:0@lo:38:kworker.0 00000100:00100000:0.0:1784290354.856412:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901087360:0@lo:400:kworker.0 00000100:00100000:3.0:1784290354.856418:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901087488:0@lo:400:kworker.0 00000100:00100000:2.0:1784290354.856423:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1870961901086720:12345-0@lo:38:kworker.0 Request processed in 384us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290354.856435:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1784290354.856435:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901087104:0@lo:400:kworker.0 00000100:00100000:1.0:1784290354.856436:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290354.856449:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901086848:0@lo:400:kworker.0 00000100:00100000:2.0:1784290354.856461:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901086976 00000100:00100000:2.0:1784290354.856466:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901086976 00000100:00100000:0.0:1784290354.856467:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23443bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901086592:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1784290354.856485:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c246a42c000 x1870961901086720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290354.856489:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901087744 00000100:00100000:3.0:1784290354.856495:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901087744 00000100:00080000:1.0:1784290354.856497:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 26 00000100:00100000:2.0:1784290354.856498:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:2.0:1784290354.856505:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901086976:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1784290354.856517:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784290354.856518:0:66008:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2096 last 0 00000100:00100000:3.0:1784290354.856536:0:26262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1565 00000100:00100000:3.0:1784290354.856545:0:26262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901087744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290354.856552:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901087232 00000020:00000080:2.0:1784290354.856557:0:66008:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5953bbf6b3074574 00000004:00100000:2.0:1784290354.856567:0:66008:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1784290354.856568:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901087232 00000100:00100000:3.0:1784290354.856580:0:26262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901087744:12345-0@lo:400:kworker.0 Request processed in 37us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290354.856586:0:26262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1565 00000100:00080000:2.0:1784290354.856590:0:66008:0:(import.c:65:import_set_state_nolock()) ffff9c246d8ac000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290354.856602:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3795 00000100:00100000:0.0:1784290354.856609:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901087232:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784290354.856620:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901087744:0@lo:400:kworker.0 00010000:00080000:0.0:1784290354.856625:0:8412:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9c2444aa2000, cookie 0x5953bbf6b30743d7 00010000:00080000:0.0:1784290354.856631:0:8412:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9c2444aa2000 cur 2096 last 1784290349 00000100:00100000:2.0:1784290354.856641:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1870961901086976:12345-0@lo:38:kworker.0 Request processed in 133us (308us total) trans 0 rc 0/0 00000004:00100000:0.0:1784290354.856643:0:8412:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1784290354.856653:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00080000:0.0:1784290354.856669:0:8412:0:(import.c:65:import_set_state_nolock()) ffff9c244c90c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784290354.856671:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901086464 00000100:00100000:3.0:1784290354.856676:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901086464 00010000:00080000:2.0:1784290354.856720:0:90737:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1784290354.856726:0:90737:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 107374182408 00000100:00100000:3.0:1784290354.856729:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784290354.856731:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1870961901087232:12345-0@lo:38:kworker.0 Request processed in 118us (297us total) trans 0 rc 0/0 00000020:00080000:2.0:1784290354.856733:0:90737:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290354.856738:0:90737:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 107374182408, next_transno: 107374182408 00000100:00100000:3.0:1784290354.856739:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3617:x1870961901086464:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1784290354.856743:0:90737:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (107374182408) 00000020:00080000:2.0:1784290354.856747:0:90737:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00000100:00100000:0.0:1784290354.856748:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3795 00010000:00080000:2.0:1784290354.856759:0:90737:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896230400 t107374182408 from 192.168.202.6@tcp req@ffff9c246a42ce00 x1870961896230400/t0(107374182408) o36->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:371/0 lens 528/0 e 0 to 0 dl 1784290361 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290354.856793:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3617:x1870961901086464:12345-0@lo:400:kworker.0 Request processed in 56us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290354.856799:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784290354.856837:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901086464:0@lo:400:kworker.0 00000100:00080000:1.0:1784290354.857288:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9c246a42c000 x1870961901086720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290379 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784290354.857296:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1784290354.857299:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1784290354.857303:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000004:00080000:2.0:1784290354.857307:0:90737:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 505us 00000100:00100000:1.0:1784290354.860644:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901086720:0@lo:38:kworker.0 00000100:00100000:1.0:1784290354.860660:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901087616:0@lo:38:kworker.0 00000100:00100000:1.0:1784290354.860699:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290354.860721:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901088000:0@lo:38:kworker.0 00000100:00100000:1.0:1784290354.860744:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290354.860753:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901087616 00000100:00100000:0.0:1784290354.860759:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901087616 00000100:00100000:1.0:1784290354.860768:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901088000 00000100:00100000:1.0:1784290354.860773:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901088000 00000100:00100000:0.0:1784290354.860789:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1784290354.860795:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901087616:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784290354.860801:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:1.0:1784290354.860806:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1870961901088000:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1784290354.860814:0:65989:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2096 last 0 00010000:00080000:1.0:1784290354.860833:0:65988:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2096 last 0 00000020:00000080:0.0:1784290354.860844:0:65989:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5953bbf6b307457b 00000004:00100000:0.0:1784290354.860853:0:65989:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000080:1.0:1784290354.860859:0:65988:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5953bbf6b3074582 00000004:00100000:1.0:1784290354.860869:0:65988:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784290354.860873:0:65989:0:(import.c:65:import_set_state_nolock()) ffff9c2474f86000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1784290354.860892:0:65988:0:(import.c:65:import_set_state_nolock()) ffff9c246dcff800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290354.860914:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1870961901087616:12345-0@lo:38:kworker.0 Request processed in 117us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290354.860928:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:1.0:1784290354.860932:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1870961901088000:12345-0@lo:38:kworker.0 Request processed in 124us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290354.860940:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00010000:00080000:0.0:1784290354.860970:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2445d6ce00 x1870961901088000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290354.860994:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 26 00000100:00080000:0.0:1784290354.860999:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784290354.861002:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784290354.861004:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c24444ae000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784290354.861010:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901088000:0@lo:38:kworker.0 00010000:00080000:0.0:1784290354.861021:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c24483c8a80 x1870961901086976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290354.861027:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 26 00000100:00080000:0.0:1784290354.861874:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9c24483c8a80 x1870961901086976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290379 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290354.861880:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784290354.861883:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784290354.861885:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784290354.861888:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901086976:0@lo:38:kworker.0 00000100:00080000:0.0:1784290354.861900:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 26 00000100:00080000:0.0:1784290354.861906:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1784290354.861908:0:3616:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1784290354.861910:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 77309411339 gen 3 00000100:00080000:0.0:1784290354.861913:0:3616:0:(recover.c:53:ptlrpc_replay_next()) import ffff9c246dd98000 from lustre-MDT0000_UUID committed 77309411339 last 0 00000100:00080000:0.0:1784290354.861915:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1784290354.862043:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901087232:0@lo:38:kworker.0 00010000:00080000:0.0:1784290354.862075:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c24483cb800 x1870961901087616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290354.862083:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 26 00010000:00080000:1.0:1784290354.862314:0:91103:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1784290354.862318:0:91103:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1784290354.862322:0:91103:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00010000:00010000:2.0:1784290354.863036:0:90737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9600/0x5953bbf6b3074589 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.863069:0:90737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9600/0x5953bbf6b3074589 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.863092:0:90737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9600/0x5953bbf6b3074589 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.863113:0:90737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074590 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.863125:0:90737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074590 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.863137:0:90737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074590 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.863603:0:90737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9600/0x5953bbf6b3074589 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.863612:0:90737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9600/0x5953bbf6b3074589 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.863619:0:90737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9600/0x5953bbf6b3074589 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.863626:0:90737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290354.863630:0:90737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9600/0x5953bbf6b3074589 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.863637:0:90737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9600/0x5953bbf6b3074589 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.863652:0:90737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2458ba5200) 00010000:00010000:2.0:1784290354.863656:0:90737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290354.863660:0:90737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9600/0x5953bbf6b3074589 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.863667:0:90737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9600/0x5953bbf6b3074589 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784290354.863726:0:90737:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e4bf399c reply state 0000000037e94563 transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074590 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.863736:0:90737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074590 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.863741:0:90737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2458ba5700) 00010000:00010000:2.0:1784290354.863749:0:90737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290354.863751:0:90737:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1784290354.863820:0:90737:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1784290354.863837:0:90737:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290354.863840:0:90737:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000020:00080000:2.0:1784290354.863845:0:90737:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290354.863847:0:90737:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000001:00080000:3.0:1784290354.865124:0:90705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182408 is committed 00010000:00010000:2.0:1784290354.865160:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074590 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865171:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074590 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865177:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074590 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865182:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8a00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290354.865185:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074590 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865190:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074590 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865200:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2458ba5700) 00010000:00010000:2.0:1784290354.865202:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290354.865205:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074590 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865210:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074590 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290354.865490:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290354.865529:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896230912 00000100:00100000:3.0:1784290354.865536:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896230912 00000100:00100000:3.0:1784290354.865580:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1160 00000100:00100000:3.0:1784290354.865589:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896230912:12345-192.168.202.6@tcp:36:rm.0 00010000:00080000:3.0:1784290354.865605:0:66004:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182409, current: 107374182409, replaying 00000100:00100000:3.0:1784290354.865617:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896230912:12345-192.168.202.6@tcp:36:rm.0 Request processed in 29us (130us total) trans 0 rc 0/-999 00000020:00080000:2.0:1784290354.865624:0:90737:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00000100:00100000:3.0:1784290354.865625:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1160 00010000:00080000:2.0:1784290354.865632:0:90737:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 107374182409, next_transno: 107374182409 00010000:00080000:2.0:1784290354.865638:0:90737:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (107374182409) 00000020:00080000:2.0:1784290354.865641:0:90737:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290354.865650:0:90737:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896230912 t107374182409 from 192.168.202.6@tcp req@ffff9c2445d6f480 x1870961896230912/t0(107374182409) o36->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:375/0 lens 512/0 e 0 to 0 dl 1784290365 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1784290354.865728:0:90737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9000/0x5953bbf6b3074597 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865735:0:90737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9000/0x5953bbf6b3074597 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865741:0:90737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9000/0x5953bbf6b3074597 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865747:0:90737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8c00/0x5953bbf6b307459e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865752:0:90737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8c00/0x5953bbf6b307459e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865756:0:90737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8c00/0x5953bbf6b307459e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865789:0:90737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9a00/0x5953bbf6b30745a5 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865794:0:90737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9a00/0x5953bbf6b30745a5 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865798:0:90737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9a00/0x5953bbf6b30745a5 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865911:0:90737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9a00/0x5953bbf6b30745a5 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865917:0:90737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9a00/0x5953bbf6b30745a5 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865921:0:90737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9a00/0x5953bbf6b30745a5 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865924:0:90737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9a00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290354.865926:0:90737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9a00/0x5953bbf6b30745a5 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865930:0:90737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9a00/0x5953bbf6b30745a5 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865936:0:90737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff9c2443b66500) 00010000:00010000:2.0:1784290354.865938:0:90737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784290354.865940:0:90737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9a00/0x5953bbf6b30745a5 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865944:0:90737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9a00/0x5953bbf6b30745a5 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865955:0:90737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9000/0x5953bbf6b3074597 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865959:0:90737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9000/0x5953bbf6b3074597 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865963:0:90737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9000/0x5953bbf6b3074597 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865972:0:90737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290354.865974:0:90737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9000/0x5953bbf6b3074597 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865978:0:90737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9000/0x5953bbf6b3074597 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865983:0:90737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2443b66c00) 00010000:00010000:2.0:1784290354.865984:0:90737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290354.865986:0:90737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9000/0x5953bbf6b3074597 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.865989:0:90737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9000/0x5953bbf6b3074597 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784290354.865996:0:90737:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f72dc03c reply state 00000000d24c6f52 transno 107374182409 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8c00/0x5953bbf6b307459e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.866003:0:90737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8c00/0x5953bbf6b307459e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.866007:0:90737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2443b66300) 00010000:00010000:2.0:1784290354.866008:0:90737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290354.866010:0:90737:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1784290354.866042:0:90737:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1784290354.866051:0:90737:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290354.866055:0:90737:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 107374182410 00000020:00080000:2.0:1784290354.866059:0:90737:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290354.866062:0:90737:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 107374182410 00000100:00100000:2.0:1784290354.866920:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290354.866953:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896231680 00000100:00100000:3.0:1784290354.866959:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896231680 00000100:00100000:3.0:1784290354.867001:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1161 00000100:00100000:3.0:1784290354.867012:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2396:x1870961896231680:12345-192.168.202.6@tcp:36:dd.0 00010000:00080000:3.0:1784290354.867022:0:74876:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182410, current: 107374182412, replaying 00000100:00100000:3.0:1784290354.867036:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2396:x1870961896231680:12345-192.168.202.6@tcp:36:dd.0 Request processed in 28us (115us total) trans 0 rc 0/-999 00000020:00080000:2.0:1784290354.867038:0:90737:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290354.867043:0:90737:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 107374182412, next_transno: 107374182410 00000100:00100000:3.0:1784290354.867049:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1161 00000100:00080000:1.0:1784290354.867820:0:91103:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:0.0:1784290354.867937:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9c24483cb800 x1870961901087616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290379 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290354.867944:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784290354.867948:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784290354.867951:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784290354.867954:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901087616:0@lo:38:kworker.0 00000100:00100000:0.0:1784290354.867971:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901088128:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1784290354.868001:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290354.868037:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901088128 00000100:00100000:1.0:1784290354.868042:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901088128 00000100:00100000:1.0:1784290354.868073:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3796 00000100:00100000:1.0:1784290354.868079:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1870961901088128:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1784290354.868088:0:22091:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9c23443bb100 x1870961901088128/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:375/0 lens 224/0 e 0 to 0 dl 1784290365 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290354.868102:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1870961901088128:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 23us (100us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784290354.868107:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3796 00000020:00080000:2.0:1784290354.868122:0:90737:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290354.868125:0:90737:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182412, next_transno: 107374182410 00010000:00080000:2.0:1784290354.868128:0:90737:0:(ldlm_lib.c:2258:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 107374182410, ql: 1, comp: 1, conn: 2, next: 107374182412, next_update 0 last_committed: 107374182408) 00000020:00080000:2.0:1784290354.868131:0:90737:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290354.868136:0:90737:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896231680 t107374182412 from 192.168.202.6@tcp req@ffff9c2445d6d500 x1870961896231680/t0(107374182412) o36->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:375/0 lens 488/0 e 0 to 0 dl 1784290365 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1784290354.868264:0:90737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9e00/0x5953bbf6b30745ac lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.868272:0:90737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9e00/0x5953bbf6b30745ac lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.868278:0:90737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9e00/0x5953bbf6b30745ac lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784290354.868302:0:90737:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 107374182412 00000004:00010000:2.0:1784290354.868314:0:90737:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f31996d reply state 00000000f715d25d transno 107374182412 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9e00/0x5953bbf6b30745ac lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.868321:0:90737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9e00/0x5953bbf6b30745ac lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.868325:0:90737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2443b66400) 00010000:00010000:2.0:1784290354.868327:0:90737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290354.868329:0:90737:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1784290354.868424:0:90737:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1784290354.868431:0:90737:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000020:00080000:2.0:1784290354.868447:0:90737:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290354.868450:0:90737:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182413 00000020:00080000:2.0:1784290354.868454:0:90737:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290354.868457:0:90737:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182413 00000100:00100000:3.0:1784290354.869327:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290354.869396:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896232064 00000100:00100000:0.0:1784290354.869402:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896232064 00000100:00100000:0.0:1784290354.869439:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1162 00000100:00100000:0.0:1784290354.869448:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:2396:x1870961896232064:12345-192.168.202.6@tcp:101:dd.0 00010000:00080000:0.0:1784290354.869461:0:65989:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 107374182413, current: 107374182413, replaying 00000100:00100000:0.0:1784290354.869473:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:2396:x1870961896232064:12345-192.168.202.6@tcp:101:dd.0 Request processed in 28us (152us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784290354.869480:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1162 00000020:00080000:2.0:1784290354.869499:0:90737:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290354.869504:0:90737:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182413, next_transno: 107374182413 00010000:00080000:2.0:1784290354.869507:0:90737:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (107374182413) 00000020:00080000:2.0:1784290354.869510:0:90737:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290354.869517:0:90737:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896232064 t107374182413 from 192.168.202.6@tcp req@ffff9c2469c88380 x1870961896232064/t0(107374182413) o101->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:375/0 lens 640/0 e 0 to 0 dl 1784290365 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1784290354.869536:0:90737:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290354.869548:0:90737:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8e00/0x5953bbf6b30745b3 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2336 expref: -99 pid: 90737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.869580:0:90737:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9400/0x5953bbf6b30745ba lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.869589:0:90737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9400/0x5953bbf6b30745ba lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.869597:0:90737:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9400/0x5953bbf6b30745ba lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784290354.869712:0:90737:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x683:0x0], count =127 00000004:00080000:2.0:1784290354.869716:0:90737:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x683:0x0]+127 in llog 00000004:00080000:2.0:1784290354.869728:0:90737:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x702:0x0], index 1: 0 00000004:00080000:2.0:1784290354.869733:0:90737:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x703:0x0], index 0: 0 00010000:00010000:2.0:1784290354.869772:0:90737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9400/0x5953bbf6b30745ba lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2336 expref: 14 pid: 90737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.869788:0:90737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2443b66400) 00010000:00010000:2.0:1784290354.869789:0:90737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1784290354.869799:0:90737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8e00/0x5953bbf6b30745b3 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2336 expref: 14 pid: 90737 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.869809:0:90737:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9400/0x5953bbf6b30745ba lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2336 expref: 13 pid: 90737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.869829:0:90737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2443b66400) 00010000:00010000:2.0:1784290354.869830:0:90737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1784290354.869832:0:90737:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef9400, rc 0) 00010000:00080000:2.0:1784290354.869860:0:90737:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1784290354.869870:0:90737:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290354.869873:0:90737:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182414 00000020:00080000:2.0:1784290354.869876:0:90737:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290354.869878:0:90737:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182414 00000100:00100000:3.0:1784290354.871525:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290354.871556:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896238976 00000100:00100000:2.0:1784290354.871562:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896238976 00000100:00100000:2.0:1784290354.871592:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 690 00000100:00100000:2.0:1784290354.871598:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:2396:x1870961896238976:12345-192.168.202.6@tcp:400:ldlm_lock_repla.0 00010000:00080000:2.0:1784290354.871610:0:66008:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9c2469c89500 x1870961896238976/t0(0) o400->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:375/0 lens 224/0 e 0 to 0 dl 1784290365 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290354.871624:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:2396:x1870961896238976:12345-192.168.202.6@tcp:400:ldlm_lock_repla.0 Request processed in 27us (102us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784290354.871629:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 690 00000020:00080000:0.0:1784290354.871659:0:90737:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290354.871663:0:90737:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 107374182414 00010000:00080000:0.0:1784290354.871666:0:90737:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1784290354.871667:0:90737:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290354.871672:0:90737:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1784290354.871673:0:90737:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1784290354.871750:0:90737:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149696 00000001:00100000:3.0:1784290354.872527:0:90705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000001:00100000:3.0:1784290354.872535:0:90705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1784290354.872553:0:90705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182413 is committed 00000001:00080000:2.0:1784290354.872591:0:90737:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:0.0:1784290354.872595:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8c00/0x5953bbf6b307459e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.872609:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8c00/0x5953bbf6b307459e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.872615:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8c00/0x5953bbf6b307459e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1784290354.872619:0:90737:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00010000:0.0:1784290354.872620:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8c00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290354.872625:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8c00/0x5953bbf6b307459e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1784290354.872630:0:90737:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9c23443bb100 x1870961901088128/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:375/0 lens 224/0 e 0 to 0 dl 1784290365 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784290354.872633:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8c00/0x5953bbf6b307459e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.872654:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2443b66300) 00010000:00010000:0.0:1784290354.872657:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290354.872659:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8c00/0x5953bbf6b307459e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.872664:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8c00/0x5953bbf6b307459e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.872697:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9e00/0x5953bbf6b30745ac lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.872703:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9e00/0x5953bbf6b30745ac lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.872708:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9e00/0x5953bbf6b30745ac lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1784290354.872711:0:90737:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.202.6@tcp: req@ffff9c2469c89500 x1870961896238976/t0(0) o400->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:375/0 lens 224/0 e 0 to 0 dl 1784290365 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784290354.872732:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9e00 already unused, calling callback (ffffffffc1aba4f0) 00000100:00080000:1.0:1784290354.872736:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00010000:00010000:0.0:1784290354.872737:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9e00/0x5953bbf6b30745ac lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.872746:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9e00/0x5953bbf6b30745ac lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784290354.872748:0:3616:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9c2468ab8380 x1870961901088128/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290370 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1784290354.872762:0:90737:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00010000:00010000:0.0:1784290354.872765:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2443b66400) 00000100:00080000:1.0:1784290354.872769:0:3616:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9c2468ab8380 x1870961901088128/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290370 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784290354.872770:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290354.872774:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9e00/0x5953bbf6b30745ac lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.872782:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9e00/0x5953bbf6b30745ac lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 90737 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784290354.872793:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1784290354.872809:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1784290354.872814:0:3616:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000124aa97): req@ffff9c2458b60000 x1870961901071488/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290353 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290354.872834:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901088128:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1784290354.872869:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290354.872878:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901088256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784290354.872901:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901071488 00000100:00100000:0.0:1784290354.872907:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901071488 00000100:00100000:0.0:1784290354.872937:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3797 00000100:00100000:1.0:1784290354.872942:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290354.872949:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3617:x1870961901071488:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784290354.872964:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901088256 00000004:00000024:0.0:1784290354.872968:0:23867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444646912 avail 1298407424 00000100:00100000:3.0:1784290354.872969:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901088256 00000100:00100000:3.0:1784290354.873004:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3798 00000100:00100000:3.0:1784290354.873013:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3620:x1870961901088256:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784290354.873020:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3617:x1870961901071488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (151us total) trans 0 rc 0/0 00000004:00000024:3.0:1784290354.873027:0:8413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444646912 avail 1298407424 00000100:00100000:0.0:1784290354.873030:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3797 00000100:00100000:1.0:1784290354.873046:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2458b60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901071488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784290354.873072:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3620:x1870961901088256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290354.873079:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3798 00000100:00100000:0.0:1784290354.873090:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901088256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784290354.873812:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290354.873848:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896238848 00000100:00100000:1.0:1784290354.873853:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896238848 00000100:00100000:1.0:1784290354.873881:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1163 00000100:00100000:1.0:1784290354.873888:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:69637:x1870961896238848:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:1.0:1784290354.873900:0:65990:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444646912 avail 1298407424 00000100:00100000:1.0:1784290354.873939:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:69637:x1870961896238848:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 52us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290354.873944:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1163 00000100:00100000:3.0:1784290354.874668:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290354.874708:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896239104 00000100:00100000:1.0:1784290354.874712:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896239104 00000100:00100000:1.0:1784290354.874749:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1164 00000100:00080000:0.0:1784290354.874753:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784290354.874758:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:69637:x1870961896239104:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:1.0:1784290354.874770:0:65988:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:1.0:1784290354.874797:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:69637:x1870961896239104:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 42us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290354.874810:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1164 00000100:00100000:3.0:1784290354.876113:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290354.876187:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896239232 00000100:00100000:0.0:1784290354.876192:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896239232 00000100:00080000:1.0:1784290354.876247:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784290354.876248:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1182 00000100:00100000:0.0:1784290354.876258:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:69637:x1870961896239232:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:0.0:1784290354.876277:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290354.876308:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:69637:x1870961896239232:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 52us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290354.876314:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1182 00000100:00100000:0.0:1784290354.877139:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290354.877188:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896239360 00000100:00100000:1.0:1784290354.877195:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896239360 00000100:00080000:0.0:1784290354.877234:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784290354.877253:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1183 00000100:00100000:1.0:1784290354.877279:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f98b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:69637:x1870961896239360:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:1.0:1784290354.877306:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784290354.877401:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f98b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:69637:x1870961896239360:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 137us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290354.877413:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1183 00000004:00000080:2.0:1784290354.885625:0:90737:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae5448703e10 00100000:10000000:2.0:1784290354.885640:0:90737:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1784290354.885935:0:90723:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x703:0x0] 00000004:00080000:3.0:1784290354.885938:0:90725:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x702:0x0] 00000100:00100000:3.0:1784290354.885991:0:90725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90725:1870961901088384:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1784290354.885991:0:90723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90723:1870961901088512:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784290354.886071:0:90725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290354.886112:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901088384 00000100:00100000:3.0:1784290354.886113:0:90725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2449ba0240 going to sleep for 11 seconds 00000100:00100000:0.0:1784290354.886121:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901088384 00000100:00100000:1.0:1784290354.886123:0:90723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290354.886159:0:90723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c3a540 going to sleep for 11 seconds 00000100:00100000:3.0:1784290354.886167:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901088512 00000100:00100000:3.0:1784290354.886174:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901088512 00000100:00100000:1.0:1784290354.886209:0:8999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4942 00000100:00100000:1.0:1784290354.886225:0:8999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:90725:x1870961901088384:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784290354.886227:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4943 00000100:00100000:3.0:1784290354.886243:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:90723:x1870961901088512:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1784290354.886263:0:8999:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1825 -> diff = -31 00002000:00080000:3.0:1784290354.886266:0:26250:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1825 -> diff = -30 00002000:02000040:1.0:1784290354.886271:0:8999:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1795 to 0x2c0000401:1825) 00002000:02000040:3.0:1784290354.886273:0:26250:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1796 to 0x280000401:1825) 00002000:00010000:1.0:1784290354.886325:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x721:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290354.886334:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000682c7ab7/0x5953bbf6b30745c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.886389:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x721:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.886395:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x721:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.886403:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000682c7ab7/0x5953bbf6b30745c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.886427:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000682c7ab7/0x5953bbf6b30745c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.886441:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000682c7ab7/0x5953bbf6b30745c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.886450:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000682c7ab7/0x5953bbf6b30745c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.886472:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.886488:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.886495:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000682c7ab7/0x5953bbf6b30745c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.886504:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebe400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.886509:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000682c7ab7/0x5953bbf6b30745c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.886520:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000682c7ab7/0x5953bbf6b30745c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.886535:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000682c7ab7/0x5953bbf6b30745c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.886541:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000682c7ab7/0x5953bbf6b30745c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.886570:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.886572:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.886575:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784290354.886582:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x720:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290354.886590:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000473ae7e0/0x5953bbf6b30745c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.886618:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x720:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.886623:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.886630:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000473ae7e0/0x5953bbf6b30745c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.886643:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000473ae7e0/0x5953bbf6b30745c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.886655:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000473ae7e0/0x5953bbf6b30745c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.886715:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000473ae7e0/0x5953bbf6b30745c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.886735:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.886749:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.886755:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000473ae7e0/0x5953bbf6b30745c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.886761:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebee00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.886764:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000473ae7e0/0x5953bbf6b30745c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.886770:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000473ae7e0/0x5953bbf6b30745c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.886779:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000473ae7e0/0x5953bbf6b30745c8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.886784:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000473ae7e0/0x5953bbf6b30745c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.886793:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.886794:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.886795:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784290354.887026:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290354.887034:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050a3d90a/0x5953bbf6b30745cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887044:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71f:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.887048:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.887052:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050a3d90a/0x5953bbf6b30745cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887063:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050a3d90a/0x5953bbf6b30745cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887072:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050a3d90a/0x5953bbf6b30745cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887080:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050a3d90a/0x5953bbf6b30745cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887099:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.887114:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.887120:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050a3d90a/0x5953bbf6b30745cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887137:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebea00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.887140:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050a3d90a/0x5953bbf6b30745cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887146:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050a3d90a/0x5953bbf6b30745cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.887147:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290354.887160:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007f4f536/0x5953bbf6b30745d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887164:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050a3d90a/0x5953bbf6b30745cf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887176:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050a3d90a/0x5953bbf6b30745cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887194:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71e:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:0.0:1784290354.887199:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.887200:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290354.887202:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.887207:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.887209:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007f4f536/0x5953bbf6b30745d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887222:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007f4f536/0x5953bbf6b30745d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887232:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007f4f536/0x5953bbf6b30745d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887240:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007f4f536/0x5953bbf6b30745d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887261:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290354.887268:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290354.887274:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007f4f536/0x5953bbf6b30745d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.887283:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebe200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290354.887286:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007f4f536/0x5953bbf6b30745d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.887294:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007f4f536/0x5953bbf6b30745d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.887306:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007f4f536/0x5953bbf6b30745d6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.887309:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290354.887312:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007f4f536/0x5953bbf6b30745d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887319:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f3bd2c5/0x5953bbf6b30745dd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.887329:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.887330:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71d:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.887334:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.887362:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f3bd2c5/0x5953bbf6b30745dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887378:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f3bd2c5/0x5953bbf6b30745dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.887388:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290354.887391:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.887405:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f3bd2c5/0x5953bbf6b30745dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887414:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f3bd2c5/0x5953bbf6b30745dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887433:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.887442:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.887448:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f3bd2c5/0x5953bbf6b30745dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887456:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.887458:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f3bd2c5/0x5953bbf6b30745dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887465:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f3bd2c5/0x5953bbf6b30745dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1784290354.887481:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1784290354.887482:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f3bd2c5/0x5953bbf6b30745dd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887491:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f3bd2c5/0x5953bbf6b30745dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.887496:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.887503:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.887504:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a285878c/0x5953bbf6b30745e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887506:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.887508:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.887518:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71c:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.887523:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.887528:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a285878c/0x5953bbf6b30745e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887539:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a285878c/0x5953bbf6b30745e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887548:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a285878c/0x5953bbf6b30745e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887555:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a285878c/0x5953bbf6b30745e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887586:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.887591:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.887595:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a285878c/0x5953bbf6b30745e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887618:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.887622:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a285878c/0x5953bbf6b30745e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887630:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a285878c/0x5953bbf6b30745e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887641:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a285878c/0x5953bbf6b30745e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887649:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a285878c/0x5953bbf6b30745e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.887657:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290354.887674:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017f9c418/0x5953bbf6b30745eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887716:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.887719:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.887722:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.887729:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71b:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.887734:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.887739:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017f9c418/0x5953bbf6b30745eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887750:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017f9c418/0x5953bbf6b30745eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887758:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017f9c418/0x5953bbf6b30745eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887766:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017f9c418/0x5953bbf6b30745eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887782:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.887787:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.887792:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017f9c418/0x5953bbf6b30745eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887797:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebfe00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.887801:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017f9c418/0x5953bbf6b30745eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887807:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017f9c418/0x5953bbf6b30745eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887817:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017f9c418/0x5953bbf6b30745eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887822:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017f9c418/0x5953bbf6b30745eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.887826:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x71a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.887832:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.887834:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b441816/0x5953bbf6b30745f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887836:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.887839:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.887861:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71a:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.887871:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x71a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.887876:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b441816/0x5953bbf6b30745f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887887:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b441816/0x5953bbf6b30745f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887895:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b441816/0x5953bbf6b30745f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887903:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b441816/0x5953bbf6b30745f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887919:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.887923:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.887927:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b441816/0x5953bbf6b30745f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887942:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebe800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.887945:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b441816/0x5953bbf6b30745f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887951:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b441816/0x5953bbf6b30745f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887960:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b441816/0x5953bbf6b30745f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.887965:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x719:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.887965:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b441816/0x5953bbf6b30745f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.887979:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003376f8f6/0x5953bbf6b30745f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.887984:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.887987:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.887991:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.887993:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x719:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.887998:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.888003:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003376f8f6/0x5953bbf6b30745f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888013:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003376f8f6/0x5953bbf6b30745f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888022:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003376f8f6/0x5953bbf6b30745f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888036:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003376f8f6/0x5953bbf6b30745f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888054:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290354.888081:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290354.888089:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003376f8f6/0x5953bbf6b30745f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.888098:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x718:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290354.888099:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebe000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290354.888106:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003376f8f6/0x5953bbf6b30745f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888109:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7565737/0x5953bbf6b3074600 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.888129:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003376f8f6/0x5953bbf6b30745f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888132:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x718:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.888142:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.888147:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7565737/0x5953bbf6b3074600 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.888148:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003376f8f6/0x5953bbf6b30745f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.888171:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003376f8f6/0x5953bbf6b30745f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888175:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7565737/0x5953bbf6b3074600 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888187:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7565737/0x5953bbf6b3074600 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.888188:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290354.888191:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290354.888194:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.888202:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7565737/0x5953bbf6b3074600 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888218:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.888234:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.888238:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7565737/0x5953bbf6b3074600 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.888245:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.888248:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7565737/0x5953bbf6b3074600 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.888255:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7565737/0x5953bbf6b3074600 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.888258:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x717:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290354.888270:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003dd1fce/0x5953bbf6b3074607 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.888277:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7565737/0x5953bbf6b3074600 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.888299:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7565737/0x5953bbf6b3074600 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888304:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x717:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.888309:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x717:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290354.888313:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.888315:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003dd1fce/0x5953bbf6b3074607 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.888317:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.888319:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.888331:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003dd1fce/0x5953bbf6b3074607 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888359:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003dd1fce/0x5953bbf6b3074607 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888366:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003dd1fce/0x5953bbf6b3074607 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888377:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.888384:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.888389:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003dd1fce/0x5953bbf6b3074607 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.888396:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebfa00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.888399:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003dd1fce/0x5953bbf6b3074607 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.888406:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003dd1fce/0x5953bbf6b3074607 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.888413:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x716:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.888414:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003dd1fce/0x5953bbf6b3074607 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888421:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1125135/0x5953bbf6b307460e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.888423:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003dd1fce/0x5953bbf6b3074607 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888438:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x716:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.888441:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.888450:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1125135/0x5953bbf6b307460e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888460:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1125135/0x5953bbf6b307460e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.888462:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.888465:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.888467:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.888480:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1125135/0x5953bbf6b307460e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888485:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1125135/0x5953bbf6b307460e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888496:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.888502:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.888507:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1125135/0x5953bbf6b307460e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.888514:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebec00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.888517:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1125135/0x5953bbf6b307460e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.888523:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1125135/0x5953bbf6b307460e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.888530:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x715:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.888532:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1125135/0x5953bbf6b307460e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888535:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001033465d/0x5953bbf6b3074615 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.888543:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1125135/0x5953bbf6b307460e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888550:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x715:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.888554:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.888557:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001033465d/0x5953bbf6b3074615 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.888558:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.888562:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.888564:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.888571:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001033465d/0x5953bbf6b3074615 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888577:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001033465d/0x5953bbf6b3074615 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888582:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001033465d/0x5953bbf6b3074615 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888626:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.888643:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.888649:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001033465d/0x5953bbf6b3074615 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.888666:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x714:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.888669:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290354.888675:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b94ffa88/0x5953bbf6b307461c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.888676:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001033465d/0x5953bbf6b3074615 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.888711:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001033465d/0x5953bbf6b3074615 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888736:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x714:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:0.0:1784290354.888738:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001033465d/0x5953bbf6b3074615 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888742:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290354.888751:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001033465d/0x5953bbf6b3074615 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888754:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b94ffa88/0x5953bbf6b307461c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.888766:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.888770:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.888771:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b94ffa88/0x5953bbf6b307461c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.888772:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.888782:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b94ffa88/0x5953bbf6b307461c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888788:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b94ffa88/0x5953bbf6b307461c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888800:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290354.888819:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290354.888825:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b94ffa88/0x5953bbf6b307461c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.888831:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x713:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290354.888838:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290354.888839:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028afd70b/0x5953bbf6b3074623 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888846:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x713:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:2.0:1784290354.888851:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b94ffa88/0x5953bbf6b307461c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888858:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.888866:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028afd70b/0x5953bbf6b3074623 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.888871:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b94ffa88/0x5953bbf6b307461c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888875:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028afd70b/0x5953bbf6b3074623 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888896:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028afd70b/0x5953bbf6b3074623 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.888900:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b94ffa88/0x5953bbf6b307461c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888902:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028afd70b/0x5953bbf6b3074623 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.888925:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b94ffa88/0x5953bbf6b307461c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888933:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290354.888939:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290354.888944:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028afd70b/0x5953bbf6b3074623 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.888948:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290354.888952:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebfc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290354.888956:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028afd70b/0x5953bbf6b3074623 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.888962:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028afd70b/0x5953bbf6b3074623 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.888967:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x712:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290354.888970:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028afd70b/0x5953bbf6b3074623 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888972:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078c48985/0x5953bbf6b307462a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.888984:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028afd70b/0x5953bbf6b3074623 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.888987:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x712:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.888989:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.888998:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078c48985/0x5953bbf6b307462a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889010:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078c48985/0x5953bbf6b307462a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.889011:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290354.889014:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290354.889019:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.889020:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078c48985/0x5953bbf6b307462a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889033:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078c48985/0x5953bbf6b307462a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889045:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.889053:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.889058:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078c48985/0x5953bbf6b307462a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.889065:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebe600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.889068:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078c48985/0x5953bbf6b307462a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.889076:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x711:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290354.889084:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5b582ff/0x5953bbf6b3074631 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.889091:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078c48985/0x5953bbf6b307462a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889094:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x711:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.889103:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.889107:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5b582ff/0x5953bbf6b3074631 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.889110:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078c48985/0x5953bbf6b307462a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889117:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5b582ff/0x5953bbf6b3074631 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.889119:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078c48985/0x5953bbf6b307462a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889135:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5b582ff/0x5953bbf6b3074631 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889142:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5b582ff/0x5953bbf6b3074631 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.889144:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.889147:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.889150:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.889161:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290354.889180:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290354.889185:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5b582ff/0x5953bbf6b3074631 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.889187:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x710:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290354.889197:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c14e744/0x5953bbf6b3074638 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.889199:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290354.889202:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5b582ff/0x5953bbf6b3074631 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.889225:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5b582ff/0x5953bbf6b3074631 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889227:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x710:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.889236:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x710:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.889241:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c14e744/0x5953bbf6b3074638 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.889244:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5b582ff/0x5953bbf6b3074631 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889251:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c14e744/0x5953bbf6b3074638 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.889254:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5b582ff/0x5953bbf6b3074631 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889268:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c14e744/0x5953bbf6b3074638 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889275:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c14e744/0x5953bbf6b3074638 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.889277:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290354.889281:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290354.889285:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290354.889290:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784290354.889294:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c14e744/0x5953bbf6b3074638 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.889301:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290354.889312:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450abc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290354.889316:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c14e744/0x5953bbf6b3074638 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.889323:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c14e744/0x5953bbf6b3074638 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.889326:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290354.889331:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a22083ed/0x5953bbf6b307463f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.889333:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c14e744/0x5953bbf6b3074638 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889367:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70f:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:2.0:1784290354.889369:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c14e744/0x5953bbf6b3074638 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889371:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.889379:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a22083ed/0x5953bbf6b307463f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889389:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a22083ed/0x5953bbf6b307463f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.889390:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290354.889393:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290354.889396:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.889408:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a22083ed/0x5953bbf6b307463f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889413:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a22083ed/0x5953bbf6b307463f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889435:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.889444:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.889449:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a22083ed/0x5953bbf6b307463f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.889456:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.889459:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a22083ed/0x5953bbf6b307463f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.889466:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a22083ed/0x5953bbf6b307463f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.889468:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290354.889479:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab0f9698/0x5953bbf6b3074646 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.889481:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a22083ed/0x5953bbf6b307463f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889485:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70e:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.889490:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.889499:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab0f9698/0x5953bbf6b3074646 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.889503:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a22083ed/0x5953bbf6b307463f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889510:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab0f9698/0x5953bbf6b3074646 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889519:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab0f9698/0x5953bbf6b3074646 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.889520:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.889523:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.889526:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.889528:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab0f9698/0x5953bbf6b3074646 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889551:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290354.889568:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290354.889574:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab0f9698/0x5953bbf6b3074646 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.889580:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aae00 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:1.0:1784290354.889582:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290354.889583:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab0f9698/0x5953bbf6b3074646 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889589:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6ee89c3/0x5953bbf6b307464d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.889613:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab0f9698/0x5953bbf6b3074646 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889617:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70d:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.889620:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.889631:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6ee89c3/0x5953bbf6b307464d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889644:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6ee89c3/0x5953bbf6b307464d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.889646:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab0f9698/0x5953bbf6b3074646 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.889710:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab0f9698/0x5953bbf6b3074646 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889715:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6ee89c3/0x5953bbf6b307464d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889730:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6ee89c3/0x5953bbf6b307464d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.889731:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290354.889734:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290354.889737:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.889754:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.889772:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.889777:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6ee89c3/0x5953bbf6b307464d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.889784:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aaa00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.889787:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6ee89c3/0x5953bbf6b307464d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.889791:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.889794:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6ee89c3/0x5953bbf6b307464d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889797:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7305fe5/0x5953bbf6b3074654 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889811:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70c:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:0.0:1784290354.889812:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6ee89c3/0x5953bbf6b307464d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889824:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290354.889826:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6ee89c3/0x5953bbf6b307464d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889829:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7305fe5/0x5953bbf6b3074654 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889841:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7305fe5/0x5953bbf6b3074654 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.889844:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.889847:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.889850:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.889851:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7305fe5/0x5953bbf6b3074654 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889858:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7305fe5/0x5953bbf6b3074654 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889870:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.889877:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.889882:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7305fe5/0x5953bbf6b3074654 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.889889:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.889892:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7305fe5/0x5953bbf6b3074654 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.889898:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7305fe5/0x5953bbf6b3074654 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.889902:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.889909:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7305fe5/0x5953bbf6b3074654 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889910:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b8191fa/0x5953bbf6b307465b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.889933:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7305fe5/0x5953bbf6b3074654 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889934:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70b:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.889942:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.889952:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b8191fa/0x5953bbf6b307465b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.889957:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.889961:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b8191fa/0x5953bbf6b307465b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.889961:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.889963:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.889971:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b8191fa/0x5953bbf6b307465b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889982:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b8191fa/0x5953bbf6b307465b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.889993:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290354.890014:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290354.890019:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b8191fa/0x5953bbf6b307465b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.890026:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x70a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290354.890027:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450abe00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290354.890033:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b8191fa/0x5953bbf6b307465b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890035:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e9f623d/0x5953bbf6b3074662 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.890053:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b8191fa/0x5953bbf6b307465b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890054:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70a:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.890060:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x70a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.890068:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9f623d/0x5953bbf6b3074662 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890078:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e9f623d/0x5953bbf6b3074662 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.890082:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b8191fa/0x5953bbf6b307465b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890087:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e9f623d/0x5953bbf6b3074662 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.890107:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b8191fa/0x5953bbf6b307465b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890107:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e9f623d/0x5953bbf6b3074662 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890139:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.890155:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290354.890157:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.890161:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e9f623d/0x5953bbf6b3074662 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.890162:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290354.890167:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784290354.890172:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x709:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.890172:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.890178:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e9f623d/0x5953bbf6b3074662 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890180:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000849e7e60/0x5953bbf6b3074669 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890205:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x709:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.890208:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x709:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290354.890209:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e9f623d/0x5953bbf6b3074662 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890213:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000849e7e60/0x5953bbf6b3074669 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.890228:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e9f623d/0x5953bbf6b3074662 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890229:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000849e7e60/0x5953bbf6b3074669 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.890249:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e9f623d/0x5953bbf6b3074662 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890254:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000849e7e60/0x5953bbf6b3074669 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.890264:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.890265:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000849e7e60/0x5953bbf6b3074669 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.890266:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.890270:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.890291:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290354.890308:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290354.890313:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000849e7e60/0x5953bbf6b3074669 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.890320:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290354.890323:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000849e7e60/0x5953bbf6b3074669 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.890330:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000849e7e60/0x5953bbf6b3074669 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.890353:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000849e7e60/0x5953bbf6b3074669 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.890359:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000849e7e60/0x5953bbf6b3074669 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.890359:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x708:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290354.890371:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000228f1e82/0x5953bbf6b3074670 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890378:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x708:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:2.0:1784290354.890379:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290354.890383:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.890384:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x708:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290354.890386:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.890388:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000228f1e82/0x5953bbf6b3074670 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890396:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000228f1e82/0x5953bbf6b3074670 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890411:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000228f1e82/0x5953bbf6b3074670 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890416:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000228f1e82/0x5953bbf6b3074670 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890426:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.890436:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.890441:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000228f1e82/0x5953bbf6b3074670 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.890448:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.890452:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000228f1e82/0x5953bbf6b3074670 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.890458:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000228f1e82/0x5953bbf6b3074670 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.890460:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x707:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290354.890471:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe30eacf/0x5953bbf6b3074677 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.890475:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000228f1e82/0x5953bbf6b3074670 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890479:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x707:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.890486:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x707:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.890489:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe30eacf/0x5953bbf6b3074677 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.890515:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000228f1e82/0x5953bbf6b3074670 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890516:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe30eacf/0x5953bbf6b3074677 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890538:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe30eacf/0x5953bbf6b3074677 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890544:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe30eacf/0x5953bbf6b3074677 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.890545:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.890548:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.890551:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.890569:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.890575:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.890580:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe30eacf/0x5953bbf6b3074677 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.890586:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.890590:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe30eacf/0x5953bbf6b3074677 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.890596:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe30eacf/0x5953bbf6b3074677 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.890601:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x706:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.890605:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe30eacf/0x5953bbf6b3074677 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890607:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001913307f/0x5953bbf6b307467e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.890624:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe30eacf/0x5953bbf6b3074677 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890627:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x706:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.890636:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x706:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.890640:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001913307f/0x5953bbf6b307467e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.890642:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.890646:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.890650:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001913307f/0x5953bbf6b307467e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.890651:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.890657:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001913307f/0x5953bbf6b307467e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890663:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001913307f/0x5953bbf6b307467e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890674:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290354.890696:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290354.890701:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001913307f/0x5953bbf6b307467e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.890717:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290354.890719:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001913307f/0x5953bbf6b307467e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.890725:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001913307f/0x5953bbf6b307467e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.890734:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001913307f/0x5953bbf6b307467e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.890738:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x705:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290354.890739:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001913307f/0x5953bbf6b307467e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890752:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053d0fe3d/0x5953bbf6b3074685 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.890760:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.890762:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x705:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:2.0:1784290354.890764:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290354.890765:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.890773:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x705:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.890778:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053d0fe3d/0x5953bbf6b3074685 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890788:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053d0fe3d/0x5953bbf6b3074685 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890798:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053d0fe3d/0x5953bbf6b3074685 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890804:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053d0fe3d/0x5953bbf6b3074685 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890815:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.890826:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.890832:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053d0fe3d/0x5953bbf6b3074685 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.890839:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.890842:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053d0fe3d/0x5953bbf6b3074685 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.890848:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053d0fe3d/0x5953bbf6b3074685 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.890850:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x704:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290354.890860:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b307468c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.890865:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053d0fe3d/0x5953bbf6b3074685 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890867:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x704:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.890875:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x704:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.890887:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b307468c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.890887:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053d0fe3d/0x5953bbf6b3074685 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890916:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b307468c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.890922:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.890923:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b307468c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.890925:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.890927:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.890936:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b307468c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890949:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290354.890968:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290354.890973:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b307468c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290354.890980:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x703:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290354.890981:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aba00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290354.890987:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b307468c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.890989:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8d8b7e0/0x5953bbf6b3074693 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.891007:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b307468c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.891008:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x703:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.891010:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x703:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.891013:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8d8b7e0/0x5953bbf6b3074693 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.891038:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8d8b7e0/0x5953bbf6b3074693 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.891042:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b307468c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.891044:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8d8b7e0/0x5953bbf6b3074693 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.891066:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8d8b7e0/0x5953bbf6b3074693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.891067:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b307468c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.891085:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.891094:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290354.891099:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.891100:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8d8b7e0/0x5953bbf6b3074693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290354.891105:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1784290354.891106:0:8999:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1794 00010000:00010000:0.0:1784290354.891108:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290354.891110:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.891114:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8d8b7e0/0x5953bbf6b3074693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.891130:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8d8b7e0/0x5953bbf6b3074693 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.891140:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8d8b7e0/0x5953bbf6b3074693 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.891146:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8d8b7e0/0x5953bbf6b3074693 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290354.891164:0:8999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:90725:x1870961901088384:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4944us (5092us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290354.891166:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.891169:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.891171:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290354.891180:0:8999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4942 00000100:00100000:2.0:1784290354.891190:0:90725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90725:1870961901088384:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1784290354.891204:0:90725:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x721:0x0] from OST, last_created [0x2c0000401:0x721:0x0]last_used is [0x2c0000401:0x702:0x0] 00000100:00100000:2.0:1784290354.891262:0:90725:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90725:1870961901088768:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1784290354.891264:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784290354.891277:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901088640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290354.891290:0:90725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290354.891312:0:26254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901088768 00000100:00100000:2.0:1784290354.891314:0:90725:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b318cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290354.891316:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290354.891320:0:26254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901088768 00000100:00100000:2.0:1784290354.891377:0:26263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4944 00000100:00100000:0.0:1784290354.891377:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901088640 00000100:00100000:0.0:1784290354.891383:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901088640 00000100:00100000:2.0:1784290354.891390:0:26263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:90725:x1870961901088768:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1784290354.891419:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00002000:00080000:2.0:1784290354.891420:0:26263:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1826 00000100:00100000:0.0:1784290354.891432:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901088640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784290354.891445:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 896 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784290354.891490:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901088640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290354.891496:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:1.0:1784290354.891512:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901088640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290354.892398:0:26263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:90725:x1870961901088768:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1011us (1108us total) trans 4294968630 rc 0/0 00000100:00100000:2.0:1784290354.892404:0:26263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4944 00000100:00100000:0.0:1784290354.892419:0:90725:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90725:1870961901088768:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784290354.892446:0:90725:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x721:0x0]-[0x2c0000401:0x741:0x0] 00002000:00010000:3.0:1784290354.898793:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x721:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290354.898804:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c438605/0x5953bbf6b307469a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.898819:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x721:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:3.0:1784290354.898834:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x721:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290354.898841:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c438605/0x5953bbf6b307469a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.898856:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c438605/0x5953bbf6b307469a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.898867:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c438605/0x5953bbf6b307469a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.898875:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c438605/0x5953bbf6b307469a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.898897:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.898911:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.898918:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c438605/0x5953bbf6b307469a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.898927:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.898931:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c438605/0x5953bbf6b307469a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.898938:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c438605/0x5953bbf6b307469a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.898950:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c438605/0x5953bbf6b307469a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.898956:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c438605/0x5953bbf6b307469a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x721:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.898972:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.898974:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.898976:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784290354.898988:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x720:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290354.898997:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036f2784a/0x5953bbf6b30746a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.899007:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x720:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:3.0:1784290354.899011:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x720:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290354.899016:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036f2784a/0x5953bbf6b30746a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.899028:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036f2784a/0x5953bbf6b30746a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.899037:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036f2784a/0x5953bbf6b30746a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.899055:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036f2784a/0x5953bbf6b30746a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.899075:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.899089:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.899094:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036f2784a/0x5953bbf6b30746a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.899101:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482044200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.899103:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036f2784a/0x5953bbf6b30746a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.899121:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036f2784a/0x5953bbf6b30746a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.899129:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036f2784a/0x5953bbf6b30746a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.899135:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036f2784a/0x5953bbf6b30746a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x720:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.899146:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.899147:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.899148:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784290354.899498:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290354.899507:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049f9a593/0x5953bbf6b30746a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.899519:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71f:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:3.0:1784290354.899524:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290354.899530:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049f9a593/0x5953bbf6b30746a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.899543:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049f9a593/0x5953bbf6b30746a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.899553:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049f9a593/0x5953bbf6b30746a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.899564:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049f9a593/0x5953bbf6b30746a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.899587:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.899612:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.899617:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049f9a593/0x5953bbf6b30746a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.899624:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.899627:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f9a593/0x5953bbf6b30746a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.899634:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f9a593/0x5953bbf6b30746a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.899642:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049f9a593/0x5953bbf6b30746a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.899654:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290354.899667:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b30746af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.899672:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049f9a593/0x5953bbf6b30746a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.899702:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.899706:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71e:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:0.0:1784290354.899706:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.899709:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.899713:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290354.899720:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b30746af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.899733:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b30746af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.899743:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b30746af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.899752:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b30746af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.899774:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290354.899801:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290354.899811:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b30746af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.899822:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290354.899823:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290354.899830:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b30746af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.899833:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b30746b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.899856:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b30746af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.899857:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71d:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:3.0:1784290354.899867:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290354.899878:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b30746b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.899886:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b30746af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.899892:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b30746b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.899901:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b30746af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.899924:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b30746b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.899931:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.899935:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b30746b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.899936:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.899942:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784290354.899949:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1784290354.899961:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.899977:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.899982:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b30746b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.899989:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.899992:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b30746b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.899998:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b30746b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900008:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b30746b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.900011:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.900016:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b30746b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900021:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b30746bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900027:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.900030:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.900034:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71c:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:0.0:1784290354.900039:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.900041:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290354.900048:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b30746bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900060:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b30746bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900069:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b30746bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900077:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b30746bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900110:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.900122:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.900127:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b30746bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900134:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.900137:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b30746bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900143:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b30746bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900152:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b30746bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.900157:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.900158:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b30746bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900171:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b30746c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900176:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.900179:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.900181:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.900188:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71b:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:3.0:1784290354.900192:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290354.900197:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b30746c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900208:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b30746c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900217:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b30746c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900227:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b30746c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900244:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.900248:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.900252:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b30746c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900258:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482044c00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.900260:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b30746c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900276:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b30746c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900286:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b30746c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.900287:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x71a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290354.900301:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e4863df/0x5953bbf6b30746cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900302:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b30746c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900327:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71a:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:0.0:1784290354.900327:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.900330:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.900331:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.900370:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x71a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290354.900376:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e4863df/0x5953bbf6b30746cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900389:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e4863df/0x5953bbf6b30746cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900399:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e4863df/0x5953bbf6b30746cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900408:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e4863df/0x5953bbf6b30746cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900423:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.900429:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.900434:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e4863df/0x5953bbf6b30746cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900441:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482044a00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.900444:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e4863df/0x5953bbf6b30746cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900450:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e4863df/0x5953bbf6b30746cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900459:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e4863df/0x5953bbf6b30746cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900473:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e4863df/0x5953bbf6b30746cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x71a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.900478:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x719:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.900485:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.900486:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000390eda51/0x5953bbf6b30746d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900488:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.900491:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.900500:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x719:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:3.0:1784290354.900504:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x719:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290354.900508:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000390eda51/0x5953bbf6b30746d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900519:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000390eda51/0x5953bbf6b30746d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900528:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000390eda51/0x5953bbf6b30746d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900545:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000390eda51/0x5953bbf6b30746d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900563:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290354.900579:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290354.900584:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000390eda51/0x5953bbf6b30746d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.900597:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cba00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290354.900600:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000390eda51/0x5953bbf6b30746d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.900604:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x718:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290354.900607:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000390eda51/0x5953bbf6b30746d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900612:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ca690c2/0x5953bbf6b30746d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.900620:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000390eda51/0x5953bbf6b30746d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900623:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x718:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:3.0:1784290354.900633:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x718:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.900634:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000390eda51/0x5953bbf6b30746d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x719:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900640:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ca690c2/0x5953bbf6b30746d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.900648:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.900651:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.900653:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.900654:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ca690c2/0x5953bbf6b30746d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900666:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ca690c2/0x5953bbf6b30746d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900675:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ca690c2/0x5953bbf6b30746d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900706:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.900723:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.900728:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ca690c2/0x5953bbf6b30746d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900734:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8ca800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.900737:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ca690c2/0x5953bbf6b30746d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.900744:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x717:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.900744:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ca690c2/0x5953bbf6b30746d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900756:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e71acd/0x5953bbf6b30746e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900761:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ca690c2/0x5953bbf6b30746d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900783:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ca690c2/0x5953bbf6b30746d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x718:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900787:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x717:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:3.0:1784290354.900791:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x717:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290354.900795:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.900797:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e71acd/0x5953bbf6b30746e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900798:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.900806:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.900809:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006e71acd/0x5953bbf6b30746e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900820:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e71acd/0x5953bbf6b30746e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900828:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006e71acd/0x5953bbf6b30746e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900844:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.900850:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.900855:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006e71acd/0x5953bbf6b30746e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900861:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cb200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.900864:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e71acd/0x5953bbf6b30746e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900870:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e71acd/0x5953bbf6b30746e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900880:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006e71acd/0x5953bbf6b30746e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.900885:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006e71acd/0x5953bbf6b30746e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x717:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.900893:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x716:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.900895:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.900899:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.900901:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.900902:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c7d4e35/0x5953bbf6b30746e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900913:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x716:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:3.0:1784290354.900917:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x716:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290354.900921:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c7d4e35/0x5953bbf6b30746e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900929:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c7d4e35/0x5953bbf6b30746e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900944:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c7d4e35/0x5953bbf6b30746e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900950:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c7d4e35/0x5953bbf6b30746e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.900962:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.900981:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.900988:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c7d4e35/0x5953bbf6b30746e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.900994:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x715:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.900998:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cbc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290354.901000:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000217dd2a1/0x5953bbf6b30746ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.901005:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c7d4e35/0x5953bbf6b30746e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901008:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x715:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:3.0:1784290354.901015:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x715:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290354.901022:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000217dd2a1/0x5953bbf6b30746ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901031:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000217dd2a1/0x5953bbf6b30746ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901051:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000217dd2a1/0x5953bbf6b30746ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.901055:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c7d4e35/0x5953bbf6b30746e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901057:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000217dd2a1/0x5953bbf6b30746ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.901084:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c7d4e35/0x5953bbf6b30746e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.901093:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c7d4e35/0x5953bbf6b30746e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x716:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901098:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.901105:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.901109:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000217dd2a1/0x5953bbf6b30746ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.901114:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8ca600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290354.901118:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.901118:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000217dd2a1/0x5953bbf6b30746ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.901127:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000217dd2a1/0x5953bbf6b30746ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.901134:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000217dd2a1/0x5953bbf6b30746ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.901139:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000217dd2a1/0x5953bbf6b30746ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x715:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.901140:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x714:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290354.901151:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d97c4c11/0x5953bbf6b30746f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901173:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x714:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:0.0:1784290354.901174:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.901178:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x714:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290354.901178:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.901181:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.901202:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d97c4c11/0x5953bbf6b30746f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901217:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d97c4c11/0x5953bbf6b30746f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901228:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d97c4c11/0x5953bbf6b30746f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901238:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d97c4c11/0x5953bbf6b30746f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901258:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290354.901272:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290354.901278:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d97c4c11/0x5953bbf6b30746f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.901286:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cae00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290354.901289:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d97c4c11/0x5953bbf6b30746f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.901307:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x713:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290354.901308:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d97c4c11/0x5953bbf6b30746f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901321:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001768be1c/0x5953bbf6b30746fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.901327:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d97c4c11/0x5953bbf6b30746f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.901367:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d97c4c11/0x5953bbf6b30746f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x714:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901369:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x713:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:3.0:1784290354.901384:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x713:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290354.901391:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001768be1c/0x5953bbf6b30746fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.901391:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.901395:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.901399:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.901413:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001768be1c/0x5953bbf6b30746fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901424:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001768be1c/0x5953bbf6b30746fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901433:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001768be1c/0x5953bbf6b30746fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901450:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.901459:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.901464:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001768be1c/0x5953bbf6b30746fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.901471:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cbe00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.901475:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001768be1c/0x5953bbf6b30746fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.901482:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001768be1c/0x5953bbf6b30746fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.901492:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001768be1c/0x5953bbf6b30746fc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.901497:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001768be1c/0x5953bbf6b30746fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x713:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.901499:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x712:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290354.901514:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d89df833/0x5953bbf6b3074703 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.901518:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.901521:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.901524:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.901531:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x712:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:3.0:1784290354.901536:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x712:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290354.901541:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d89df833/0x5953bbf6b3074703 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901553:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d89df833/0x5953bbf6b3074703 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901564:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d89df833/0x5953bbf6b3074703 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901581:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d89df833/0x5953bbf6b3074703 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901615:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.901619:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.901623:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d89df833/0x5953bbf6b3074703 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.901639:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8caa00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.901642:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d89df833/0x5953bbf6b3074703 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.901651:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d89df833/0x5953bbf6b3074703 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.901661:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x711:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.901664:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d89df833/0x5953bbf6b3074703 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901670:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005caf552d/0x5953bbf6b307470a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.901693:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d89df833/0x5953bbf6b3074703 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x712:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901705:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x711:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:3.0:1784290354.901711:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x711:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290354.901716:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.901717:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005caf552d/0x5953bbf6b307470a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.901719:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.901722:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.901733:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005caf552d/0x5953bbf6b307470a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901744:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005caf552d/0x5953bbf6b307470a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901752:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005caf552d/0x5953bbf6b307470a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901772:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290354.901798:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290354.901804:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005caf552d/0x5953bbf6b307470a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.901812:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cac00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290354.901816:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005caf552d/0x5953bbf6b307470a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.901817:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x710:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290354.901831:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042cb9976/0x5953bbf6b3074711 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.901833:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005caf552d/0x5953bbf6b307470a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.901853:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005caf552d/0x5953bbf6b307470a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901857:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x710:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:3.0:1784290354.901867:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x710:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290354.901873:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042cb9976/0x5953bbf6b3074711 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.901897:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005caf552d/0x5953bbf6b307470a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x711:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901901:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042cb9976/0x5953bbf6b3074711 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901919:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042cb9976/0x5953bbf6b3074711 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.901939:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.901943:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.901948:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.901949:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042cb9976/0x5953bbf6b3074711 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.901974:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.901990:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.901995:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042cb9976/0x5953bbf6b3074711 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.902001:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8ca200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.902005:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042cb9976/0x5953bbf6b3074711 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.902012:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042cb9976/0x5953bbf6b3074711 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.902028:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042cb9976/0x5953bbf6b3074711 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.902030:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.902041:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042cb9976/0x5953bbf6b3074711 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x710:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902045:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cadb06b/0x5953bbf6b3074718 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902060:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70f:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:0.0:1784290354.902060:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.902063:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.902066:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.902069:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290354.902077:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cadb06b/0x5953bbf6b3074718 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902089:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cadb06b/0x5953bbf6b3074718 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902115:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cadb06b/0x5953bbf6b3074718 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902124:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cadb06b/0x5953bbf6b3074718 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902145:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290354.902169:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290354.902176:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cadb06b/0x5953bbf6b3074718 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.902185:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cb800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290354.902190:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cadb06b/0x5953bbf6b3074718 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.902196:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290354.902201:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cadb06b/0x5953bbf6b3074718 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902205:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186a9c14/0x5953bbf6b307471f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902226:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70e:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.902228:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cadb06b/0x5953bbf6b3074718 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902230:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290354.902242:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000186a9c14/0x5953bbf6b307471f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.902246:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cadb06b/0x5953bbf6b3074718 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902267:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000186a9c14/0x5953bbf6b307471f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.902277:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.902281:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000186a9c14/0x5953bbf6b307471f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.902282:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.902293:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.902295:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000186a9c14/0x5953bbf6b307471f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902333:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784290354.902464:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.902467:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290354.902472:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009368b628/0x5953bbf6b3074726 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.902473:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000186a9c14/0x5953bbf6b307471f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.902499:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cb000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290354.902503:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70d:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:0.0:1784290354.902504:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000186a9c14/0x5953bbf6b307471f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902513:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290354.902518:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000186a9c14/0x5953bbf6b307471f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902522:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009368b628/0x5953bbf6b3074726 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.902531:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000186a9c14/0x5953bbf6b307471f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902540:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009368b628/0x5953bbf6b3074726 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.902541:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000186a9c14/0x5953bbf6b307471f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902568:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009368b628/0x5953bbf6b3074726 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902592:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009368b628/0x5953bbf6b3074726 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.902595:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.902598:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.902601:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.902632:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.902638:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.902643:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009368b628/0x5953bbf6b3074726 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.902650:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cb600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.902654:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009368b628/0x5953bbf6b3074726 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.902664:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009368b628/0x5953bbf6b3074726 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.902676:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.902687:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009368b628/0x5953bbf6b3074726 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902703:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b7dec93/0x5953bbf6b307472d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.902704:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009368b628/0x5953bbf6b3074726 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902731:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70c:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:3.0:1784290354.902743:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290354.902749:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b7dec93/0x5953bbf6b307472d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.902752:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.902755:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.902757:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.902767:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b7dec93/0x5953bbf6b307472d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902778:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b7dec93/0x5953bbf6b307472d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902786:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b7dec93/0x5953bbf6b307472d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902805:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290354.902832:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290354.902839:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b7dec93/0x5953bbf6b307472d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.902849:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cb400 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:3.0:1784290354.902850:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290354.902853:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b7dec93/0x5953bbf6b307472d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902858:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074734 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.902871:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b7dec93/0x5953bbf6b307472d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902879:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70b:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:3.0:1784290354.902886:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.902891:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b7dec93/0x5953bbf6b307472d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902892:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.902919:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b7dec93/0x5953bbf6b307472d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902922:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902946:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074734 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.902953:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.902958:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.902961:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.902968:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.902988:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.903003:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.903008:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.903022:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8ca000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.903025:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074734 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.903032:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074734 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.903035:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x70a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.903042:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074734 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903043:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007423540f/0x5953bbf6b307473b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.903060:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074734 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903065:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70a:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:3.0:1784290354.903071:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x70a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290354.903073:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.903076:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.903077:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007423540f/0x5953bbf6b307473b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.903078:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.903092:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007423540f/0x5953bbf6b307473b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903101:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007423540f/0x5953bbf6b307473b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903109:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007423540f/0x5953bbf6b307473b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903127:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290354.903154:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290354.903161:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007423540f/0x5953bbf6b307473b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.903170:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8ca400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290354.903174:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007423540f/0x5953bbf6b307473b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.903180:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x709:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290354.903187:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7f3cfe4/0x5953bbf6b3074742 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.903198:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007423540f/0x5953bbf6b307473b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903218:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x709:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:3.0:1784290354.903224:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x709:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.903225:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007423540f/0x5953bbf6b307473b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903232:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7f3cfe4/0x5953bbf6b3074742 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.903239:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007423540f/0x5953bbf6b307473b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x70a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903254:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7f3cfe4/0x5953bbf6b3074742 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.903262:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.903266:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.903267:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7f3cfe4/0x5953bbf6b3074742 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.903269:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.903279:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7f3cfe4/0x5953bbf6b3074742 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903298:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.903314:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.903318:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7f3cfe4/0x5953bbf6b3074742 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.903324:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c262600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.903327:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7f3cfe4/0x5953bbf6b3074742 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.903334:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7f3cfe4/0x5953bbf6b3074742 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.903366:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x708:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.903367:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7f3cfe4/0x5953bbf6b3074742 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903378:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d746d73/0x5953bbf6b3074749 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.903378:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7f3cfe4/0x5953bbf6b3074742 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x709:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903407:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x708:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:3.0:1784290354.903412:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x708:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290354.903413:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.903416:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.903419:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.903421:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d746d73/0x5953bbf6b3074749 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903435:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d746d73/0x5953bbf6b3074749 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903457:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d746d73/0x5953bbf6b3074749 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903465:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d746d73/0x5953bbf6b3074749 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903482:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.903496:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.903500:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d746d73/0x5953bbf6b3074749 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.903507:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c262e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.903510:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d746d73/0x5953bbf6b3074749 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.903516:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d746d73/0x5953bbf6b3074749 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.903525:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d746d73/0x5953bbf6b3074749 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.903529:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x707:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290354.903530:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d746d73/0x5953bbf6b3074749 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x708:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903540:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f87c3db2/0x5953bbf6b3074750 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903568:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x707:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:0.0:1784290354.903572:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.903574:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x707:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290354.903576:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.903580:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.903582:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f87c3db2/0x5953bbf6b3074750 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903595:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f87c3db2/0x5953bbf6b3074750 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903605:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f87c3db2/0x5953bbf6b3074750 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903613:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f87c3db2/0x5953bbf6b3074750 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903645:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290354.903668:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290354.903675:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f87c3db2/0x5953bbf6b3074750 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.903697:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c263e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290354.903702:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f87c3db2/0x5953bbf6b3074750 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.903703:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x706:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290354.903716:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d00d8ec4/0x5953bbf6b3074757 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.903719:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f87c3db2/0x5953bbf6b3074750 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903737:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x706:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:3.0:1784290354.903743:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x706:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.903746:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f87c3db2/0x5953bbf6b3074750 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903749:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d00d8ec4/0x5953bbf6b3074757 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903768:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d00d8ec4/0x5953bbf6b3074757 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.903783:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f87c3db2/0x5953bbf6b3074750 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x707:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903788:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d00d8ec4/0x5953bbf6b3074757 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903803:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d00d8ec4/0x5953bbf6b3074757 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.903806:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.903809:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.903812:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.903829:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.903851:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.903858:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d00d8ec4/0x5953bbf6b3074757 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.903867:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c262a00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.903871:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d00d8ec4/0x5953bbf6b3074757 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290354.903873:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x705:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290354.903886:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099bb238c/0x5953bbf6b307475e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.903890:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d00d8ec4/0x5953bbf6b3074757 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903908:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x705:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:0.0:1784290354.903915:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d00d8ec4/0x5953bbf6b3074757 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903921:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x705:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290354.903932:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d00d8ec4/0x5953bbf6b3074757 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x706:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903933:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099bb238c/0x5953bbf6b307475e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.903956:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.903957:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099bb238c/0x5953bbf6b307475e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.903959:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.903962:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.903973:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099bb238c/0x5953bbf6b307475e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.903983:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099bb238c/0x5953bbf6b307475e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.904002:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290354.904028:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290354.904035:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099bb238c/0x5953bbf6b307475e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.904044:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c262c00 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:3.0:1784290354.904049:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x704:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290354.904050:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099bb238c/0x5953bbf6b307475e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.904062:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e858fe5e/0x5953bbf6b3074765 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.904065:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099bb238c/0x5953bbf6b307475e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.904090:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x704:0x0].0x0 since=2096s v=(0 0) 00010000:00010000:1.0:1784290354.904093:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099bb238c/0x5953bbf6b307475e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.904096:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x704:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290354.904110:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099bb238c/0x5953bbf6b307475e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x705:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.904111:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e858fe5e/0x5953bbf6b3074765 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.904135:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.904137:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e858fe5e/0x5953bbf6b3074765 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290354.904138:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290354.904146:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290354.904151:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e858fe5e/0x5953bbf6b3074765 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.904187:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e858fe5e/0x5953bbf6b3074765 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290354.904208:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290354.904233:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290354.904241:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e858fe5e/0x5953bbf6b3074765 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1784290354.904245:0:26250:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1795 00010000:00010000:0.0:1784290354.904266:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c262200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290354.904271:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e858fe5e/0x5953bbf6b3074765 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.904281:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e858fe5e/0x5953bbf6b3074765 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.904292:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e858fe5e/0x5953bbf6b3074765 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.904298:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e858fe5e/0x5953bbf6b3074765 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x704:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290354.904312:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.904313:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290354.904315:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290354.904336:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:90723:x1870961901088512:12345-0@lo:5:osp-pre-0-0.0 Request processed in 18093us (18210us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290354.904380:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4943 00000100:00100000:1.0:1784290354.904396:0:90723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90723:1870961901088512:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1784290354.904415:0:90723:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x721:0x0] from OST, last_created [0x280000401:0x721:0x0]last_used is [0x280000401:0x703:0x0] 00000100:00100000:1.0:1784290354.904485:0:90723:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90723:1870961901089024:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1784290354.904486:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901088896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784290354.904525:0:90723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290354.904544:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290354.904556:0:90723:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c3a540 going to sleep for 11 seconds 00000100:00100000:3.0:1784290354.904580:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901089024 00000100:00100000:3.0:1784290354.904589:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901089024 00000100:00100000:2.0:1784290354.904618:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901088896 00000100:00100000:2.0:1784290354.904625:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901088896 00000100:00100000:3.0:1784290354.904651:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4945 00000100:00100000:3.0:1784290354.904662:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:90723:x1870961901089024:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784290354.904669:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:2.0:1784290354.904704:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f98a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901088896:12345-0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1784290354.904711:0:26252:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1826 00002000:00000024:2.0:1784290354.904718:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 896 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784290354.904760:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f98a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901088896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290354.904767:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:0.0:1784290354.904789:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901088896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784290354.905845:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:90723:x1870961901089024:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1186us (1321us total) trans 4294968629 rc 0/0 00000100:00100000:3.0:1784290354.905851:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4945 00000100:00100000:1.0:1784290354.905884:0:90723:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90723:1870961901089024:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1784290354.905895:0:90723:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x721:0x0]-[0x280000401:0x741:0x0] 00000100:00100000:1.0:1784290355.367518:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901089152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290355.367519:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901089280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784290355.367634:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290355.367727:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290355.367742:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901089280 00000100:00100000:0.0:1784290355.367752:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901089280 00000100:00100000:2.0:1784290355.367766:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901089152 00000100:00100000:2.0:1784290355.367771:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901089152 00000100:00100000:0.0:1784290355.367810:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:2.0:1784290355.367819:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:0.0:1784290355.367825:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901089280:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784290355.367831:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901089152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784290355.367852:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00002000:00000024:2.0:1784290355.367853:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290355.367920:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901089280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290355.367927:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901089152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290355.367931:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:2.0:1784290355.367940:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:1.0:1784290355.367963:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901089280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784290355.367997:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901089152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784290355.717430:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290355.717464:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290355.717468:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896239488 00000100:00100000:1.0:1784290355.717478:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896239488 00000100:00100000:3.0:1784290355.717486:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290355.717504:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896239744 00000100:00100000:0.0:1784290355.717512:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896239744 00000100:00100000:3.0:1784290355.717516:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290355.717530:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 74 00000100:00100000:1.0:1784290355.717545:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24686f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+10:2398:x1870961896239488:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290355.717547:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290355.717561:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896239616 00000100:00100000:0.0:1784290355.717567:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896239616 00000100:00100000:2.0:1784290355.717572:0:26260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896240000 00000100:00100000:2.0:1784290355.717579:0:26260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896240000 00000100:00100000:3.0:1784290355.717593:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 691 00000100:00100000:0.0:1784290355.717611:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 692 00000100:00100000:3.0:1784290355.717612:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896239744:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290355.717616:0:26260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896239872 00000100:00100000:1.0:1784290355.717619:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24686f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+10:2398:x1870961896239488:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 77us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290355.717622:0:26260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896239872 00000100:00100000:0.0:1784290355.717631:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2398:x1870961896239616:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290355.717635:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 74 00000100:00100000:2.0:1784290355.717650:0:26260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1566 00000100:00100000:3.0:1784290355.717659:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896239744:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 57us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290355.717662:0:26260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896240000:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290355.717698:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 691 00000100:00100000:0.0:1784290355.717698:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2398:x1870961896239616:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 70us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290355.717711:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 692 00000100:00100000:2.0:1784290355.717722:0:26260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896240000:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 63us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290355.717730:0:26260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1566 00000100:00100000:3.0:1784290355.717745:0:26259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1567 00000100:00100000:3.0:1784290355.717757:0:26259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2398:x1870961896239872:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290355.717797:0:26259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2398:x1870961896239872:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 45us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290355.717803:0:26259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1567 00010000:00010000:0.0:1784290355.879524:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784290355.880632:0:75386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:02000400:0.0:1784290356.714285:0:91285:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:1.0:1784290356.903494:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784290357.278633:0:91333:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:0.0:1784290357.927538:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290358.575222:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290358.575323:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896240128 00000100:00100000:0.0:1784290358.575335:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896240128 00000100:00100000:0.0:1784290358.575470:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1165 00000100:00100000:0.0:1784290358.575484:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:70106:x1870961896240128:12345-192.168.202.6@tcp:101:lfs.0 00000100:00080000:1.0:1784290358.575500:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784290358.575508:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290358.575534:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b307476c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2383 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290358.575600:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b3074773 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290358.575628:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b3074773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290358.575640:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b3074773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290358.575736:0:65989:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784290358.575741:0:65989:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784290358.575766:0:65989:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b3074773 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290358.575792:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b307476c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2383 expref: 9 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290358.575813:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b3074773 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2383 expref: 8 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290358.575821:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2461de5d00) 00010000:00010000:0.0:1784290358.575824:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784290358.575827:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27600, rc 0) 00000100:00100000:0.0:1784290358.575883:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:70106:x1870961896240128:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 403us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290358.575891:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1165 00000100:00100000:1.0:1784290358.578001:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290358.578080:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896240256 00000100:00100000:2.0:1784290358.578086:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896240256 00000100:00100000:2.0:1784290358.578126:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1166 00000100:00100000:2.0:1784290358.578134:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:70106:x1870961896240256:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:2.0:1784290358.578154:0:65990:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444646912 avail 1298407424 00000100:00100000:2.0:1784290358.578188:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:70106:x1870961896240256:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 57us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290358.578194:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1166 00000100:00100000:3.0:1784290358.578891:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290358.578927:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896240384 00000100:00100000:0.0:1784290358.578933:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896240384 00000100:00100000:0.0:1784290358.578971:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1167 00000100:00100000:0.0:1784290358.578979:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:70106:x1870961896240384:12345-192.168.202.6@tcp:41:lfs.0 00000100:00080000:1.0:1784290358.578995:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:0.0:1784290358.578999:0:66004:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:0.0:1784290358.579040:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:70106:x1870961896240384:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 63us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290358.579046:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1167 00000100:00100000:3.0:1784290358.580143:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290358.580225:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896240512 00000100:00100000:1.0:1784290358.580230:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896240512 00000100:00080000:0.0:1784290358.580283:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290358.580288:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1188 00000100:00100000:1.0:1784290358.580296:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:70106:x1870961896240512:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:1.0:1784290358.580316:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290358.580389:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:70106:x1870961896240512:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 95us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290358.580395:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1188 00000100:00100000:1.0:1784290358.581171:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290358.581206:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896240640 00000100:00100000:0.0:1784290358.581212:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896240640 00000100:00100000:0.0:1784290358.581248:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1189 00000100:00080000:1.0:1784290358.581252:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290358.581257:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:70106:x1870961896240640:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:0.0:1784290358.581272:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784290358.581302:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:70106:x1870961896240640:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 48us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290358.581307:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1189 00000100:00100000:0.0:1784290358.594100:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290358.594164:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896240896 00000100:00100000:2.0:1784290358.594173:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896240896 00000100:00100000:2.0:1784290358.594227:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1168 00000100:00100000:2.0:1784290358.594239:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:70123:x1870961896240896:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1784290358.594259:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290358.594278:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9e00/0x5953bbf6b307477a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b238a expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594368:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8e00/0x5953bbf6b3074781 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594383:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8e00/0x5953bbf6b3074781 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594394:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8e00/0x5953bbf6b3074781 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594408:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9000/0x5953bbf6b3074788 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594417:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9000/0x5953bbf6b3074788 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594424:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9000/0x5953bbf6b3074788 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594512:0:65988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8e00/0x5953bbf6b3074781 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594521:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8e00/0x5953bbf6b3074781 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594529:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8e00/0x5953bbf6b3074781 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594537:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8e00/0x5953bbf6b3074781 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594544:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8e00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290358.594549:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8e00/0x5953bbf6b3074781 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594557:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8e00/0x5953bbf6b3074781 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594571:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2461de5d00) 00010000:00010000:2.0:1784290358.594574:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290358.594579:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8e00/0x5953bbf6b3074781 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594587:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8e00/0x5953bbf6b3074781 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594602:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9000/0x5953bbf6b3074788 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594609:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9000/0x5953bbf6b3074788 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594622:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9000/0x5953bbf6b3074788 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594629:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290358.594633:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9000/0x5953bbf6b3074788 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594639:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9000/0x5953bbf6b3074788 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594664:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c2443b66500) 00010000:00010000:2.0:1784290358.594668:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290358.594672:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9000/0x5953bbf6b3074788 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594679:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9000/0x5953bbf6b3074788 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594713:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9e00/0x5953bbf6b307477a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b238a expref: 9 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594724:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2461de5d00) 00010000:00010000:2.0:1784290358.594727:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784290358.594732:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9e00/0x5953bbf6b307477a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b238a expref: 9 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.594743:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ef9e00, rc 0) 00000100:00100000:2.0:1784290358.594797:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:70123:x1870961896240896:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 561us (705us total) trans 0 rc 301/301 00000100:00100000:2.0:1784290358.594814:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1168 00000100:00100000:3.0:1784290358.596164:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290358.596211:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896241024 00000100:00100000:2.0:1784290358.596217:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896241024 00000100:00100000:2.0:1784290358.596255:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1169 00000100:00100000:2.0:1784290358.596264:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:70123:x1870961896241024:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:2.0:1784290358.596299:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9a00/0x5953bbf6b307478f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596311:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9a00/0x5953bbf6b307478f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596322:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9a00/0x5953bbf6b307478f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596334:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074796 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596366:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074796 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596375:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074796 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596411:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9600/0x5953bbf6b307479d lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596421:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9600/0x5953bbf6b307479d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596429:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9600/0x5953bbf6b307479d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784290358.596480:0:66008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 1048576 00000004:00200000:2.0:1784290358.596484:0:66008:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784290358.596495:0:66008:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9600/0x5953bbf6b307479d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596507:0:66008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9a00/0x5953bbf6b307478f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596514:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9a00/0x5953bbf6b307478f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596521:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9a00/0x5953bbf6b307478f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596528:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9a00/0x5953bbf6b307478f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596533:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9a00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290358.596537:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9a00/0x5953bbf6b307478f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596543:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9a00/0x5953bbf6b307478f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596552:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2461de5d00) 00010000:00010000:2.0:1784290358.596555:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290358.596558:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9a00/0x5953bbf6b307478f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596566:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9a00/0x5953bbf6b307478f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596586:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074796 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596594:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074796 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596600:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074796 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596605:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8a00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290358.596608:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074796 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596614:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074796 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596622:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c2443b66c00) 00010000:00010000:2.0:1784290358.596625:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290358.596628:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074796 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596634:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef8a00/0x5953bbf6b3074796 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596661:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9600/0x5953bbf6b307479d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596669:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9600/0x5953bbf6b307479d lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596676:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9600/0x5953bbf6b307479d lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596689:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290358.596693:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9600/0x5953bbf6b307479d lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596700:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9600/0x5953bbf6b307479d lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596710:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2443b66400) 00010000:00010000:2.0:1784290358.596713:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290358.596716:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9600/0x5953bbf6b307479d lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290358.596723:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9600/0x5953bbf6b307479d lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290358.596773:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:70123:x1870961896241024:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 509us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290358.596783:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1169 00000100:00100000:1.0:1784290358.608025:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290358.608073:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896241280 00000100:00100000:3.0:1784290358.608082:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896241280 00000100:00100000:3.0:1784290358.608126:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1170 00000100:00100000:3.0:1784290358.608134:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:70126:x1870961896241280:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1784290358.608149:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290358.608166:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263000/0x5953bbf6b30747a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2391 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608219:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263800/0x5953bbf6b30747ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608246:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263800/0x5953bbf6b30747ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608255:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263800/0x5953bbf6b30747ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608287:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263600/0x5953bbf6b30747b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608296:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263600/0x5953bbf6b30747b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608306:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263600/0x5953bbf6b30747b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608403:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263800/0x5953bbf6b30747ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608410:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263800/0x5953bbf6b30747ab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608415:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263800/0x5953bbf6b30747ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608419:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c263800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290358.608422:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263800/0x5953bbf6b30747ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608428:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263800/0x5953bbf6b30747ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608438:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2461de5d00) 00010000:00010000:3.0:1784290358.608440:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290358.608443:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263800/0x5953bbf6b30747ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608448:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263800/0x5953bbf6b30747ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608466:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263600/0x5953bbf6b30747b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608471:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263600/0x5953bbf6b30747b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608476:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263600/0x5953bbf6b30747b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608479:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c263600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290358.608481:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263600/0x5953bbf6b30747b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608486:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263600/0x5953bbf6b30747b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608491:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c2442ffea00) 00010000:00010000:3.0:1784290358.608492:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290358.608494:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263600/0x5953bbf6b30747b2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608498:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263600/0x5953bbf6b30747b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608522:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263000/0x5953bbf6b30747a4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2391 expref: 9 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608529:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2461de5d00) 00010000:00010000:3.0:1784290358.608531:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784290358.608539:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263000/0x5953bbf6b30747a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2391 expref: 9 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.608547:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247c263000, rc 0) 00000100:00100000:3.0:1784290358.608595:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:70126:x1870961896241280:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 461us (576us total) trans 0 rc 301/301 00000100:00100000:3.0:1784290358.608601:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1170 00000100:00100000:0.0:1784290358.609810:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290358.609847:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896241408 00000100:00100000:3.0:1784290358.609853:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896241408 00000100:00100000:3.0:1784290358.609914:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1171 00000100:00100000:3.0:1784290358.609924:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f98bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:70126:x1870961896241408:12345-192.168.202.6@tcp:34:lfs.0 00010000:00010000:3.0:1784290358.609984:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263400/0x5953bbf6b30747b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.609992:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263400/0x5953bbf6b30747b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.609997:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263400/0x5953bbf6b30747b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610005:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262000/0x5953bbf6b30747c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610009:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262000/0x5953bbf6b30747c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610014:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262000/0x5953bbf6b30747c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610039:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262400/0x5953bbf6b30747c7 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610055:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262400/0x5953bbf6b30747c7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610060:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262400/0x5953bbf6b30747c7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290358.610091:0:65989:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 1048576 00000004:00200000:3.0:1784290358.610094:0:65989:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784290358.610103:0:65989:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262400/0x5953bbf6b30747c7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610111:0:65989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263400/0x5953bbf6b30747b9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610115:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263400/0x5953bbf6b30747b9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610120:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263400/0x5953bbf6b30747b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610124:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263400/0x5953bbf6b30747b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610127:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c263400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290358.610129:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263400/0x5953bbf6b30747b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610133:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263400/0x5953bbf6b30747b9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610138:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2461de5d00) 00010000:00010000:3.0:1784290358.610143:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290358.610146:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263400/0x5953bbf6b30747b9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610150:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263400/0x5953bbf6b30747b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610158:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262000/0x5953bbf6b30747c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610162:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262000/0x5953bbf6b30747c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610166:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262000/0x5953bbf6b30747c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610169:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c262000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290358.610171:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262000/0x5953bbf6b30747c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610174:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262000/0x5953bbf6b30747c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610179:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c2442ffe100) 00010000:00010000:3.0:1784290358.610180:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290358.610182:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262000/0x5953bbf6b30747c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610185:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262000/0x5953bbf6b30747c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610193:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262400/0x5953bbf6b30747c7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610201:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262400/0x5953bbf6b30747c7 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610205:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262400/0x5953bbf6b30747c7 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610208:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c262400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290358.610209:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262400/0x5953bbf6b30747c7 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610213:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262400/0x5953bbf6b30747c7 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610218:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2443b66400) 00010000:00010000:3.0:1784290358.610219:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290358.610221:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262400/0x5953bbf6b30747c7 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290358.610224:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262400/0x5953bbf6b30747c7 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290358.610277:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f98bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:70126:x1870961896241408:12345-192.168.202.6@tcp:34:lfs.0 Request processed in 354us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290358.610285:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1171 00000100:00100000:2.0:1784290358.621991:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290358.622084:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896241664 00000100:00100000:1.0:1784290358.622091:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896241664 00000100:00100000:1.0:1784290358.622133:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1172 00000100:00100000:1.0:1784290358.622141:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:70132:x1870961896241664:12345-192.168.202.6@tcp:101:md5sum.0 00010000:00010000:1.0:1784290358.622155:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290358.622168:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b30747ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2398 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622213:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b30747d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622223:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b30747d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622233:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b30747d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622242:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30747dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622260:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30747dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622265:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30747dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622337:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b30747e3 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622365:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b30747e3 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622371:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b30747e3 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290358.622378:0:65990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 1048576 00010000:00010000:1.0:1784290358.622472:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b30747d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622478:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b30747d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622483:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b30747d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622487:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290358.622490:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b30747d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622495:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b30747d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622514:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2461de5d00) 00010000:00010000:1.0:1784290358.622516:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290358.622520:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b30747d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622525:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b30747d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622534:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30747dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622538:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30747dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622544:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30747dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622551:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290358.622555:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30747dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622562:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30747dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622587:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9c2475807500) 00010000:00010000:1.0:1784290358.622590:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290358.622593:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30747dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622600:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30747dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622680:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b30747ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2398 expref: 11 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622708:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b30747e3 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2398 expref: 10 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290358.622713:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2443b66400) 00010000:00010000:1.0:1784290358.622714:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784290358.622716:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aaa00, rc 0) 00000100:00100000:1.0:1784290358.622754:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:70132:x1870961896241664:12345-192.168.202.6@tcp:101:md5sum.0 Request processed in 614us (773us total) trans 111669149697 rc 0/0 00000100:00100000:1.0:1784290358.622760:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1172 00000100:00100000:1.0:1784290358.627887:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290358.627934:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896241792 00000100:00100000:3.0:1784290358.627939:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896241792 00002000:00100000:3.0:1784290358.627965:0:8409:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x702:0x0] (0->32767) req@ffff9c2345c24000 x1870961896241792/t0(0) o3->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:379/0 lens 488/0 e 0 to 0 dl 1784290369 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784290358.627973:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345c24000 with x1870961896241792 ext(0->32767) 00002000:00010000:3.0:1784290358.627983:0:8409:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2345c24000 00000100:00100000:3.0:1784290358.628003:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 355 00000100:00100000:3.0:1784290358.628008:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2400:x1870961896241792:12345-192.168.202.6@tcp:3:md5sum.0 00000100:00100000:3.0:1784290358.628894:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2400:x1870961896241792:12345-192.168.202.6@tcp:3:md5sum.0 Request processed in 883us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290358.628902:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 355 00002000:00100000:3.0:1784290358.628908:0:8409:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x702:0x0] (0->32767) req@ffff9c2345c24000 x1870961896241792/t0(0) o3->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:379/0 lens 488/440 e 0 to 0 dl 1784290369 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784290358.628916:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345c24000 with x1870961896241792 ext(0->32767) 00002000:00010000:3.0:1784290358.628919:0:8409:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2345c24000 00000100:00100000:2.0:1784290358.636146:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290358.636236:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896241920 00000100:00100000:3.0:1784290358.636242:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896241920 00002000:00100000:3.0:1784290358.636263:0:8408:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x702:0x0] (32768->1048575) req@ffff9c2445d6dc00 x1870961896241920/t0(0) o3->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:379/0 lens 488/0 e 0 to 0 dl 1784290369 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784290358.636275:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2445d6dc00 with x1870961896241920 ext(32768->1048575) 00000100:00100000:0.0:1784290358.636301:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00002000:00010000:3.0:1784290358.636327:0:8408:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2445d6dc00 00000100:00100000:3.0:1784290358.636378:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896242048 00000100:00100000:3.0:1784290358.636382:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896242048 00000100:00100000:1.0:1784290358.636388:0:25102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 356 00002000:00100000:3.0:1784290358.636405:0:8408:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x702:0x0] (1048576->2097151) req@ffff9c2345d01500 x1870961896242048/t0(0) o3->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:379/0 lens 488/0 e 0 to 0 dl 1784290369 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290358.636406:0:25102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2397:x1870961896241920:12345-192.168.202.6@tcp:3:md5sum.0 00002000:00100000:3.0:1784290358.636422:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345d01500 with x1870961896242048 ext(1048576->2097151) 00002000:00010000:3.0:1784290358.636425:0:8408:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c2345d01500 00000100:00100000:3.0:1784290358.636444:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 357 00000100:00100000:3.0:1784290358.636451:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896242048:12345-192.168.202.6@tcp:3:md5sum.0 00000100:00100000:1.0:1784290358.637597:0:25102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2397:x1870961896241920:12345-192.168.202.6@tcp:3:md5sum.0 Request processed in 1198us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290358.637608:0:25102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 356 00002000:00100000:1.0:1784290358.637618:0:25102:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x702:0x0] (32768->1048575) req@ffff9c2445d6dc00 x1870961896241920/t0(0) o3->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:379/0 lens 488/440 e 0 to 0 dl 1784290369 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784290358.637629:0:25102:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2445d6dc00 with x1870961896241920 ext(32768->1048575) 00002000:00010000:1.0:1784290358.637634:0:25102:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2445d6dc00 00000100:00100000:3.0:1784290358.641546:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2398:x1870961896242048:12345-192.168.202.6@tcp:3:md5sum.0 Request processed in 5093us (5245us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1784290358.641553:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 357 00002000:00100000:3.0:1784290358.641559:0:8408:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x702:0x0] (1048576->2097151) req@ffff9c2345d01500 x1870961896242048/t0(0) o3->bd808cf4-dd54-45f0-9b2b-1434e8330e5d@192.168.202.6@tcp:379/0 lens 488/440 e 0 to 0 dl 1784290369 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784290358.641567:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345d01500 with x1870961896242048 ext(1048576->2097151) 00002000:00010000:3.0:1784290358.641571:0:8408:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c2345d01500 00000100:00100000:3.0:1784290358.647628:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290358.647737:0:68995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896242304 00000100:00100000:2.0:1784290358.647744:0:68995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896242304 00000100:00100000:2.0:1784290358.647779:0:68995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 225 00000100:00100000:2.0:1784290358.647786:0:68995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c208850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:70132:x1870961896242304:12345-192.168.202.6@tcp:35:md5sum.0 00000100:00100000:2.0:1784290358.648003:0:68995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c208850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:70132:x1870961896242304:12345-192.168.202.6@tcp:35:md5sum.0 Request processed in 214us (374us total) trans 111669149698 rc 0/0 00000100:00100000:2.0:1784290358.648013:0:68995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 225 00010000:00010000:2.0:1784290358.952466:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290359.975508:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290359.975627:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1870961901089536:0@lo:400:kworker.0 00000100:00100000:1.0:1784290359.975670:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1870961901089792:0@lo:400:kworker.0 00000100:00100000:2.0:1784290359.975728:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290359.975730:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1870961901089664:0@lo:400:kworker.0 00000100:00100000:1.0:1784290359.975780:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290359.975794:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901090048:0@lo:400:kworker.0 00000100:00100000:1.0:1784290359.975815:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901090176:0@lo:400:kworker.0 00000100:00100000:0.0:1784290359.975830:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901089536 00000100:00100000:0.0:1784290359.975838:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901089536 00000100:00100000:2.0:1784290359.975839:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290359.975855:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290359.975872:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901090560:0@lo:400:kworker.0 00000100:00100000:1.0:1784290359.975885:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901090688:0@lo:400:kworker.0 00000100:00100000:0.0:1784290359.975892:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901089664 00000100:00100000:0.0:1784290359.975896:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901089664 00000100:00100000:2.0:1784290359.975912:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290359.975920:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290359.975930:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1784290359.975944:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1870961901089536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290359.975954:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1784290359.975954:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784290359.975964:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901090304:0@lo:400:kworker.0 00000100:00100000:2.0:1784290359.975970:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901089408:0@lo:400:kworker.0 00000100:00100000:1.0:1784290359.976004:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290359.976030:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901090816:0@lo:400:kworker.0 00000100:00100000:0.0:1784290359.976044:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1870961901089536:12345-0@lo:400:kworker.0 Request processed in 100us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290359.976046:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290359.976056:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290359.976061:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1784290359.976088:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:0.0:1784290359.976097:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1870961901089664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290359.976112:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1870961901089920:0@lo:400:kworker.0 00000100:00100000:1.0:1784290359.976127:0:26251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901090176 00000100:00100000:1.0:1784290359.976132:0:26251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901090176 00000100:00100000:0.0:1784290359.976153:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1870961901089664:12345-0@lo:400:kworker.0 Request processed in 55us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290359.976155:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290359.976167:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:1.0:1784290359.976174:0:26251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901090688 00000100:00100000:1.0:1784290359.976177:0:26251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901090688 00000100:00100000:2.0:1784290359.976191:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1870961901090432:0@lo:400:kworker.0 00000100:00100000:0.0:1784290359.976191:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901089920 00000100:00100000:0.0:1784290359.976197:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901089920 00000100:00100000:1.0:1784290359.976209:0:26251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901090304 00000100:00100000:1.0:1784290359.976213:0:26251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901090304 00000100:00100000:2.0:1784290359.976232:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290359.976239:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1784290359.976244:0:26251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901090816 00000100:00100000:1.0:1784290359.976247:0:26251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901090816 00000100:00100000:0.0:1784290359.976251:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1870961901089920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290359.976256:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1870961901090944:0@lo:400:kworker.0 00000100:00100000:1.0:1784290359.976275:0:26251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1568 00000100:00100000:1.0:1784290359.976284:0:26251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901090176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290359.976300:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1870961901089920:12345-0@lo:400:kworker.0 Request processed in 51us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290359.976304:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290359.976312:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1784290359.976334:0:26251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901090176:12345-0@lo:400:kworker.0 Request processed in 50us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290359.976334:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901090432 00000100:00100000:2.0:1784290359.976380:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467dedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1870961901089536:0@lo:400:kworker.0 00000100:00100000:1.0:1784290359.976392:0:26251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1568 00000100:00100000:0.0:1784290359.976402:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901090432 00000100:00100000:1.0:1784290359.976418:0:26251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1569 00000100:00100000:2.0:1784290359.976420:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1870961901089920:0@lo:400:kworker.0 00000100:00100000:1.0:1784290359.976431:0:26251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901090688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290359.976433:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901090944 00000100:00100000:0.0:1784290359.976437:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901090944 00000100:00100000:0.0:1784290359.976466:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1784290359.976474:0:26251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901090688:12345-0@lo:400:kworker.0 Request processed in 48us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290359.976479:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:0.0:1784290359.976479:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1870961901090432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290359.976495:0:26251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1569 00000100:00100000:2.0:1784290359.976499:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1870961901090944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290359.976517:0:26251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1570 00000100:00100000:1.0:1784290359.976530:0:26251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901090304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290359.976533:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1870961901090432:12345-0@lo:400:kworker.0 Request processed in 59us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290359.976542:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:2.0:1784290359.976562:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1870961901090944:12345-0@lo:400:kworker.0 Request processed in 68us (260us total) trans 0 rc 0/0 00000100:00080000:0.0:1784290359.976565:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784290359.976571:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784290359.976576:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00080000:0.0:1784290359.976576:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784290359.976581:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784290359.976586:0:26251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901090304:12345-0@lo:400:kworker.0 Request processed in 58us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290359.976594:0:26251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1570 00000100:00100000:0.0:1784290359.976600:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1571 00000100:00100000:0.0:1784290359.976611:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901090816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290359.976613:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901090048 00000100:00100000:2.0:1784290359.976624:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901090048 00000100:00100000:0.0:1784290359.976655:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901090816:12345-0@lo:400:kworker.0 Request processed in 48us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290359.976662:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1571 00000100:00100000:2.0:1784290359.976686:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901090560 00000100:00100000:2.0:1784290359.976692:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901090560 00000100:00100000:1.0:1784290359.976697:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901090304:0@lo:400:kworker.0 00000100:00100000:1.0:1784290359.976718:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901090816:0@lo:400:kworker.0 00000100:00100000:2.0:1784290359.976733:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3799 00000100:00100000:1.0:1784290359.976735:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1870961901089664:0@lo:400:kworker.0 00000100:00100000:2.0:1784290359.976746:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1870961901090048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290359.976760:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901090176:0@lo:400:kworker.0 00000100:00100000:1.0:1784290359.976776:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901090688:0@lo:400:kworker.0 00000100:00100000:0.0:1784290359.976794:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3800 00000100:00100000:2.0:1784290359.976804:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3618:x1870961901090048:12345-0@lo:400:kworker.0 Request processed in 63us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290359.976813:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901090560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290359.976814:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3799 00000100:00100000:1.0:1784290359.976825:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d95ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901091200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290359.976844:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901089408 00000100:00100000:2.0:1784290359.976849:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901089408 00000100:00100000:0.0:1784290359.976862:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901090560:12345-0@lo:400:kworker.0 Request processed in 54us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290359.976868:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3800 00000100:00100000:1.0:1784290359.976876:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290359.976883:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784290359.976893:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24686fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3618:x1870961901089408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290359.976898:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d95ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901091456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784290359.976905:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784290359.976914:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d95fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901091328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784290359.976942:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24686fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3618:x1870961901089408:12345-0@lo:400:kworker.0 Request processed in 51us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290359.976950:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290359.976955:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784290359.976980:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901091072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784290359.977004:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901091456 00000100:00100000:0.0:1784290359.977009:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901091456 00000100:00100000:1.0:1784290359.977016:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290359.977030:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901091200 00000100:00100000:2.0:1784290359.977037:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901091200 00000100:00100000:0.0:1784290359.977039:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3801 00000100:00100000:0.0:1784290359.977049:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3617:x1870961901091456:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784290359.977059:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467def800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901089408:0@lo:400:kworker.0 00000004:00000024:0.0:1784290359.977071:0:8412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444646912 avail 1298407424 00000100:00100000:2.0:1784290359.977073:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901091072 00000100:00100000:2.0:1784290359.977077:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901091072 00000100:00100000:1.0:1784290359.977083:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1870961901090432:0@lo:400:kworker.0 00000100:00100000:1.0:1784290359.977103:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1870961901090944:0@lo:400:kworker.0 00000100:00100000:3.0:1784290359.977109:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290359.977112:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:0.0:1784290359.977119:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3617:x1870961901091456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290359.977125:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901091200:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784290359.977127:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901090048:0@lo:400:kworker.0 00000100:00100000:0.0:1784290359.977130:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3801 00002000:00000024:2.0:1784290359.977146:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784290359.977154:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901090560:0@lo:400:kworker.0 00000100:00100000:0.0:1784290359.977184:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d95ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901091456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290359.977191:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901091200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290359.977198:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:1.0:1784290359.977209:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:0.0:1784290359.977215:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290359.977224:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901091072:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784290359.977252:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901089792 00000100:00100000:2.0:1784290359.977256:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901089792 00002000:00000024:1.0:1784290359.977257:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290359.977260:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d95ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901091200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784290359.977292:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901091328 00000100:00100000:2.0:1784290359.977296:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:0.0:1784290359.977297:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901091328 00000100:00100000:1.0:1784290359.977307:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901091072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290359.977314:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1870961901089792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290359.977315:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:0.0:1784290359.977328:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3802 00000100:00100000:0.0:1784290359.977337:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901091328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784290359.977373:0:23867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:1.0:1784290359.977387:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901091072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784290359.977395:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1870961901089792:12345-0@lo:400:kworker.0 Request processed in 81us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290359.977403:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:0.0:1784290359.977419:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901091328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290359.977427:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3802 00000100:00100000:1.0:1784290359.977437:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d95fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901091328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784290359.977444:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1870961901089792:0@lo:400:kworker.0 00000100:00080000:0.0:1784290359.977472:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784290360.487609:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2446e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901091584:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784290360.487745:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290360.487803:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901091584 00000100:00100000:0.0:1784290360.487815:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901091584 00000100:00100000:0.0:1784290360.487889:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:0.0:1784290360.487907:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901091584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784290360.487939:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290360.488016:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901091584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290360.488027:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00100000:3.0:1784290360.488083:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2446e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901091584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784290360.488539:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901091712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784290360.488601:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290360.488717:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901091712 00000100:00100000:3.0:1784290360.488727:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901091712 00000100:00100000:3.0:1784290360.488806:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:3.0:1784290360.488827:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901091712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784290360.488849:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16013376 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784290360.488969:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901091712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 146us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290360.488987:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1784290360.489036:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474ecdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901091712:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1784290360.491234:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968630 is committed 00000001:00080000:0.0:1784290360.491967:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968629 is committed 00000100:00100000:2.0:1784290360.838678:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290360.838722:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290360.838759:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290360.838778:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896242432 00000100:00100000:1.0:1784290360.838794:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896242432 00000100:00100000:3.0:1784290360.838800:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896242688 00000100:00100000:2.0:1784290360.838802:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290360.838813:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896242688 00000100:00100000:0.0:1784290360.838871:0:26255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896242944 00000100:00100000:2.0:1784290360.838872:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290360.838899:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:0.0:1784290360.838904:0:26255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896242944 00000100:00100000:1.0:1784290360.838920:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+10:2397:x1870961896242432:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290360.838925:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896242560 00000100:00100000:3.0:1784290360.838933:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896242560 00000100:00080000:2.0:1784290360.838947:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784290360.838956:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784290360.838965:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784290360.839007:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 699 00000100:00100000:0.0:1784290360.839010:0:26255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896242816 00000100:00100000:0.0:1784290360.839022:0:26255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896242816 00000100:00100000:2.0:1784290360.839038:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 700 00000100:00100000:3.0:1784290360.839039:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2397:x1870961896242688:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290360.839040:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bdffa268-fb6a-4248-991c-0ad16fac303f+10:2397:x1870961896242432:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 121us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290360.839053:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:2.0:1784290360.839067:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:2397:x1870961896242560:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290360.839108:0:26255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1572 00000100:00100000:3.0:1784290360.839125:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2397:x1870961896242688:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 101us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290360.839139:0:8999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1573 00000100:00100000:0.0:1784290360.839139:0:26255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2397:x1870961896242944:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290360.839141:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 699 00000100:00100000:2.0:1784290360.839163:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:2397:x1870961896242560:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 99us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290360.839164:0:8999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2397:x1870961896242816:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290360.839201:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 700 00000100:00100000:0.0:1784290360.839246:0:26255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2397:x1870961896242944:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 102us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290360.839260:0:8999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2397:x1870961896242816:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 105us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290360.839272:0:26255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1572 00000100:00080000:2.0:1784290360.839274:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290360.839296:0:8999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1573 00010000:00010000:0.0:1784290360.999675:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784290361.453932:0:91528:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 133: check resend of ongoing requests for lwp during failover ========================================================== 08:12:41 (1784290361) 00000100:00100000:0.0:1784290361.484386:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290361.484445:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896243200 00000100:00100000:1.0:1784290361.484458:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896243200 00000100:00100000:1.0:1784290361.484532:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1173 00000100:00100000:1.0:1784290361.484545:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:70704:x1870961896243200:12345-192.168.202.6@tcp:36:mkdir.0 00000100:00100000:1.0:1784290361.484690:0:74876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433daa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID:74876:1870961901091840:0@lo:900:mdt00_005.0 00000100:00100000:1.0:1784290361.484751:0:74876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290361.484786:0:74876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345634cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290361.484798:0:66000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901091840 00000100:00100000:2.0:1784290361.484806:0:66000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901091840 00000100:00100000:2.0:1784290361.484848:0:66000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784290361.484860:0:66000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:74876:x1870961901091840:12345-0@lo:900:mdt00_005.0 00000100:00100000:2.0:1784290361.484927:0:66000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:74876:x1870961901091840:12345-0@lo:900:mdt00_005.0 Request processed in 71us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290361.484947:0:66000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784290361.484965:0:74876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433daa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID:74876:1870961901091840:0@lo:900:mdt00_005.0 00000100:00100000:1.0:1784290361.485031:0:74876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d66300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901091968:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1784290361.485088:0:74876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290361.485116:0:74876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23456349c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290361.485136:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901091968 00000100:00100000:0.0:1784290361.485143:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901091968 00000100:00100000:0.0:1784290361.485189:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3803 00000100:00100000:0.0:1784290361.485212:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:74876:x1870961901091968:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1784290361.485297:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:74876:x1870961901091968:12345-0@lo:1000:mdt00_005.0 Request processed in 91us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290361.485307:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3803 00000100:00100000:1.0:1784290361.485331:0:74876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d66300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901091968:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1784290361.485435:0:74876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d66300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901092096:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1784290361.485466:0:74876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290361.485488:0:74876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23456349c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290361.485503:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901092096 00000100:00100000:0.0:1784290361.485509:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901092096 00000100:00100000:0.0:1784290361.485550:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3804 00000100:00100000:0.0:1784290361.485563:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:74876:x1870961901092096:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1784290361.485673:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:74876:x1870961901092096:12345-0@lo:1000:mdt00_005.0 Request processed in 114us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290361.485681:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3804 00000100:00100000:1.0:1784290361.485712:0:74876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d66300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901092096:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1784290361.485760:0:74876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d66300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901092224:0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1784290361.485791:0:74876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290361.485813:0:74876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23456349c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290361.485829:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901092224 00000100:00100000:0.0:1784290361.485835:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901092224 00000100:00100000:0.0:1784290361.485866:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3805 00000100:00100000:0.0:1784290361.485875:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:74876:x1870961901092224:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1784290361.485967:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:74876:x1870961901092224:12345-0@lo:1000:mdt00_005.0 Request processed in 93us (174us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784290361.485974:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3805 00000100:00100000:1.0:1784290361.485979:0:74876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d66300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901092224:0@lo:1000:mdt00_005.0 00010000:00010000:1.0:1784290361.486037:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.486048:0:74876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.486058:0:74876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290361.486079:0:74876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d66300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901092352:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1784290361.486109:0:74876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290361.486129:0:74876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345634cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290361.486151:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901092352 00000100:00100000:3.0:1784290361.486157:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901092352 00000100:00100000:3.0:1784290361.486195:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3806 00000100:00100000:3.0:1784290361.486206:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:74876:x1870961901092352:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1784290361.486220:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290361.486240:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262400/0x5953bbf6b30747f8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30747f1 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.486273:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b3074773 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2383 expref: 10 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.486289:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262400/0x5953bbf6b30747f8 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30747f1 expref: 7 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.486323:0:8413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b3074773 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2383 expref: 10 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.486336:0:8413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b3074773 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2383 expref: 10 pid: 65989 timeout: 2202 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290361.486430:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474ecd180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8413:1870961901092480:192.168.202.6@tcp:104: 00000100:00100000:3.0:1784290361.486509:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23422e1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784290361.487531:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474ecd180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8413:1870961901092480:192.168.202.6@tcp:104: 00010000:00010000:0.0:1784290361.487550:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262400/0x5953bbf6b30747f8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30747f1 expref: 7 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.487578:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2461de5d00) 00010000:00010000:0.0:1784290361.487581:0:8413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290361.487585:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262400/0x5953bbf6b30747f8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30747f1 expref: 7 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.487611:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247c262400, rc 0) 00000100:00100000:0.0:1784290361.487698:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:74876:x1870961901092352:12345-0@lo:101:mdt00_005.0 Request processed in 1492us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290361.487710:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3806 00000100:00100000:1.0:1784290361.487728:0:74876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d66300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901092352:0@lo:101:mdt00_005.0 00010000:00010000:1.0:1784290361.487747:0:74876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30747f8 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.487757:0:74876:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30747f8 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290361.487800:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290361.487839:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896243328 00000100:00100000:1.0:1784290361.487844:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896243328 00010000:00010000:1.0:1784290361.487863:0:19591:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b3074773 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2383 expref: 11 pid: 65989 timeout: 2202 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290361.487898:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2583 00000100:00100000:1.0:1784290361.487908:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474ece680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:2399:x1870961896243328:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784290361.487919:0:19591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290361.487925:0:19591:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b3074773 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2383 expref: 11 pid: 65989 timeout: 2202 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.487936:0:19591:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b3074773 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2383 expref: 11 pid: 65989 timeout: 2202 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.487954:0:19591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b3074773 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2383 expref: 11 pid: 65989 timeout: 2202 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.487999:0:19591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2461de5d00) 00010000:00010000:1.0:1784290361.488005:0:19591:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262400/0x5953bbf6b30747f8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30747f1 expref: 6 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.488015:0:19591:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262400/0x5953bbf6b30747f8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x5953bbf6b30747f1 expref: 6 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.488023:0:19591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262400/0x5953bbf6b30747f8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x5953bbf6b30747f1 expref: 6 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.488051:0:19591:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262400/0x5953bbf6b30747f8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30747f1 expref: 6 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290361.488062:0:19591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d64700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000_UUID:19591:1870961901092608:0@lo:105: 00000100:00100000:1.0:1784290361.488098:0:19591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290361.488132:0:19591:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345634cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290361.488151:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901092608 00000100:00100000:0.0:1784290361.488157:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901092608 00000100:00100000:0.0:1784290361.488198:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1784290361.488213:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:19591:x1870961901092608:12345-0@lo:105: 00010000:00010000:0.0:1784290361.488241:0:6517:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30747f8 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.488255:0:6517:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30747f8 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.488265:0:6517:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30747f8 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.488273:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x5953bbf6b30747f8 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.488279:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x5953bbf6b30747f8 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.488289:0:6517:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x5953bbf6b30747f8 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.488323:0:6517:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9c23450aba00) 00010000:00010000:1.0:1784290361.488394:0:74876:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30747f8 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.488404:0:74876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30747f8 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784290361.488424:0:74876:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1784290361.488425:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:19591:x1870961901092608:12345-0@lo:105: Request processed in 213us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290361.488439:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1784290361.488449:0:19591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d64700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0000_UUID:19591:1870961901092608:0@lo:105: 00010000:00010000:1.0:1784290361.488453:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aa600/0x5953bbf6b30747ff lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.488462:0:74876:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aa600/0x5953bbf6b30747ff lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.488469:0:19591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290361.488482:0:74876:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aa600/0x5953bbf6b30747ff lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290361.488496:0:74876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d66300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901092736:0@lo:101:mdt00_005.0 00000100:00100000:3.0:1784290361.488521:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474ece680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:2399:x1870961896243328:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 612us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290361.488541:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2583 00000100:00100000:1.0:1784290361.488541:0:74876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290361.488570:0:74876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23456349c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290361.488600:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901092736 00000100:00100000:1.0:1784290361.488604:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901092736 00000100:00100000:1.0:1784290361.488664:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3807 00000100:00100000:1.0:1784290361.488679:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:74876:x1870961901092736:12345-0@lo:101:mdt00_005.0 00010000:00010000:1.0:1784290361.488693:0:8412:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290361.488709:0:8412:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b3074806 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30747ff expref: -99 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.488732:0:8412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b3074806 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30747ff expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.488742:0:8412:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b3074806 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30747ff expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.488750:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9c2475807200) 00010000:00010000:1.0:1784290361.488753:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290361.488756:0:8412:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aa800, rc 0) 00000100:00100000:1.0:1784290361.488806:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:74876:x1870961901092736:12345-0@lo:101:mdt00_005.0 Request processed in 132us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290361.488814:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3807 00000100:00100000:0.0:1784290361.488864:0:74876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d66300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901092736:0@lo:101:mdt00_005.0 00010000:00010000:0.0:1784290361.488890:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aa600/0x5953bbf6b30747ff lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074806 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.488905:0:74876:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aa600/0x5953bbf6b30747ff lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074806 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784290361.488925:0:74876:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1784290361.488957:0:74876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d95ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901092864:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1784290361.489009:0:74876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290361.489042:0:74876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e78300 going to sleep for 11 seconds 00000100:00100000:1.0:1784290361.489052:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901092864 00000100:00100000:1.0:1784290361.489063:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901092864 00000100:00100000:1.0:1784290361.489097:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3808 00000100:00100000:1.0:1784290361.489105:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:74876:x1870961901092864:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1784290361.489160:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:74876:x1870961901092864:12345-0@lo:1000:mdt00_005.0 Request processed in 56us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290361.489167:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3808 00000100:00100000:0.0:1784290361.489195:0:74876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d95ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901092864:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1784290361.489241:0:74876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d95ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901092992:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1784290361.489277:0:74876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290361.489305:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901092992 00000100:00100000:1.0:1784290361.489310:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901092992 00000100:00100000:0.0:1784290361.489310:0:74876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e78300 going to sleep for 11 seconds 00000100:00100000:1.0:1784290361.489365:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3809 00000100:00100000:1.0:1784290361.489375:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:74876:x1870961901092992:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1784290361.489441:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:74876:x1870961901092992:12345-0@lo:1000:mdt00_005.0 Request processed in 68us (162us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784290361.489449:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3809 00000100:00100000:0.0:1784290361.489479:0:74876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d95ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901092992:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1784290361.489550:0:74876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475818e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901093120:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1784290361.489583:0:74876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290361.489610:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901093120 00000100:00100000:0.0:1784290361.489613:0:74876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e78300 going to sleep for 11 seconds 00000100:00100000:1.0:1784290361.489615:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901093120 00000100:00100000:1.0:1784290361.489674:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3810 00000100:00100000:1.0:1784290361.489686:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:74876:x1870961901093120:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1784290361.489786:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:74876:x1870961901093120:12345-0@lo:1000:mdt00_005.0 Request processed in 103us (202us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784290361.489795:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3810 00000100:00100000:0.0:1784290361.489811:0:74876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2475818e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901093120:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1784290361.489874:0:74876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475818e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901093248:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1784290361.489905:0:74876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290361.489933:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901093248 00000100:00100000:0.0:1784290361.489933:0:74876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e78300 going to sleep for 11 seconds 00000100:00100000:1.0:1784290361.489939:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901093248 00000100:00100000:1.0:1784290361.489969:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3811 00000100:00100000:1.0:1784290361.489975:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:74876:x1870961901093248:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1784290361.490032:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:74876:x1870961901093248:12345-0@lo:1000:mdt00_005.0 Request processed in 55us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290361.490040:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3811 00000100:00100000:0.0:1784290361.490055:0:74876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2475818e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901093248:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1784290361.490107:0:74876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475818e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901093376:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1784290361.490146:0:74876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290361.490178:0:74876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e78300 going to sleep for 11 seconds 00000100:00100000:3.0:1784290361.490207:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901093376 00000100:00100000:3.0:1784290361.490213:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901093376 00000100:00100000:3.0:1784290361.490255:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3812 00000100:00100000:3.0:1784290361.490267:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:74876:x1870961901093376:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1784290361.490408:0:74876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2475818e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901093376:0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1784290361.490424:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:74876:x1870961901093376:12345-0@lo:1000:mdt00_005.0 Request processed in 159us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290361.490433:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3812 00000100:00100000:0.0:1784290361.490465:0:74876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475818e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901093504:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1784290361.490497:0:74876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290361.490524:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901093504 00000100:00100000:0.0:1784290361.490527:0:74876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e78300 going to sleep for 11 seconds 00000100:00100000:1.0:1784290361.490530:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901093504 00000100:00100000:1.0:1784290361.490579:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3813 00000100:00100000:1.0:1784290361.490587:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:74876:x1870961901093504:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1784290361.490691:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:74876:x1870961901093504:12345-0@lo:1000:mdt00_005.0 Request processed in 101us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290361.490703:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3813 00000100:00100000:0.0:1784290361.490713:0:74876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2475818e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901093504:0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1784290361.490818:0:74876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475818e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901093632:0@lo:700:mdt00_005.0 00000100:00100000:0.0:1784290361.490848:0:74876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290361.490876:0:74876:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e78180 going to sleep for 11 seconds 00000100:00100000:3.0:1784290361.490904:0:80207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901093632 00000100:00100000:3.0:1784290361.490910:0:80207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901093632 00000100:00100000:3.0:1784290361.490953:0:80207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784290361.490966:0:80207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:lustre-MDT0001-mdtlov_UUID+8:74876:x1870961901093632:12345-0@lo:700:mdt00_005.0 00000100:00100000:3.0:1784290361.491028:0:80207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:lustre-MDT0001-mdtlov_UUID+8:74876:x1870961901093632:12345-0@lo:700:mdt00_005.0 Request processed in 65us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290361.491039:0:80207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784290361.491062:0:74876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2475818e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:74876:1870961901093632:0@lo:700:mdt00_005.0 00000040:00080000:0.0:1784290361.491160:0:74876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784290361.491178:0:74876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd3:0x1:0x0].27, 64 off34496 00000004:00080000:0.0:1784290361.491186:0:74876:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c2474e78180 with version 5 00000004:00080000:1.0:1784290361.491222:0:75392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9c2344dd4900 version 5 rpc_version 5 00000020:00100000:1.0:1784290361.491246:0:75392:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784290361.491255:0:75392:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c2347d65f80 x1870961901093888/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00080000:0.0:1784290361.491256:0:74876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784290361.491275:0:75392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d65f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75392:1870961901093888:0@lo:1000:osp_up0-1.0 00000040:00080000:0.0:1784290361.491277:0:74876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd3:0x1:0x0].28, 64 off34560 00000004:00080000:0.0:1784290361.491284:0:74876:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c2343398600 with version 6 00000100:00100000:1.0:1784290361.491318:0:75392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290361.491368:0:75392:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345634480 going to sleep for 11 seconds 00000100:00100000:3.0:1784290361.491400:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901093888 00000100:00100000:3.0:1784290361.491407:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901093888 00000100:00100000:3.0:1784290361.491454:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3814 00000100:00100000:3.0:1784290361.491468:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75392:x1870961901093888:12345-0@lo:1000:osp_up0-1.0 00000040:00080000:0.0:1784290361.492171:0:74876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784290361.492241:0:74876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240002340:0x1:0x0].14, 64 off33664 00000040:00080000:0.0:1784290361.492738:0:74876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a4:0x1:0x0].1, 1000 off33768 00000040:00080000:0.0:1784290361.492845:0:74876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000c751:0x1:0x0].1, 1152 off33920 00000004:00080000:0.0:1784290361.492854:0:74876:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c2474e78840 with version 7 00000001:00080000:3.0:1784290361.493604:0:90705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149699 is committed 00000001:00080000:3.0:1784290361.493613:0:90705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149698 is committed 00000100:00100000:1.0:1784290361.493749:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75392:x1870961901093888:12345-0@lo:1000:osp_up0-1.0 Request processed in 2284us (2431us total) trans 111669149699 rc 0/0 00000100:00100000:1.0:1784290361.493761:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3814 00000004:00080000:2.0:1784290361.493784:0:75392:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 111669149699 committed transno 111669149699 00000100:00100000:2.0:1784290361.493791:0:75392:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 111669149699 gen 3 00000100:00100000:2.0:1784290361.493810:0:75392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d65f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75392:1870961901093888:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1784290361.493836:0:75392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9c2344dd4900 version 6 rpc_version 6 00000020:00100000:2.0:1784290361.493854:0:75392:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784290361.493860:0:75392:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c2467deea00 x1870961901094144/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290361.493876:0:75392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467deea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75392:1870961901094144:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784290361.493912:0:75392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290361.493938:0:75392:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2443f2b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290361.493955:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901094144 00000100:00100000:1.0:1784290361.493960:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901094144 00000100:00100000:1.0:1784290361.493995:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3815 00000100:00100000:1.0:1784290361.494004:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75392:x1870961901094144:12345-0@lo:1000:osp_up0-1.0 00000001:00080000:3.0:1784290361.496071:0:90705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149700 is committed 00000100:00100000:1.0:1784290361.496187:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75392:x1870961901094144:12345-0@lo:1000:osp_up0-1.0 Request processed in 2184us (2273us total) trans 111669149700 rc 0/0 00000100:00100000:1.0:1784290361.496195:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3815 00000004:00080000:2.0:1784290361.496254:0:75392:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 111669149700 committed transno 111669149700 00000100:00100000:2.0:1784290361.496260:0:75392:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 111669149700 gen 3 00000100:00100000:2.0:1784290361.496272:0:75392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467deea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75392:1870961901094144:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1784290361.496290:0:75392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9c2344dd4900 version 7 rpc_version 7 00000020:00100000:2.0:1784290361.496314:0:75392:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784290361.496319:0:75392:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c2467deea00 x1870961901094400/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290361.496337:0:75392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467deea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75392:1870961901094400:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784290361.496415:0:75392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290361.496446:0:75392:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2443f2b000 going to sleep for 11 seconds 00000100:00100000:1.0:1784290361.496454:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901094400 00000100:00100000:1.0:1784290361.496460:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901094400 00000100:00100000:1.0:1784290361.496501:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3816 00000100:00100000:1.0:1784290361.496517:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75392:x1870961901094400:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784290361.498531:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75392:x1870961901094400:12345-0@lo:1000:osp_up0-1.0 Request processed in 2014us (2114us total) trans 111669149701 rc 0/0 00000100:00100000:1.0:1784290361.498541:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3816 00000100:00100000:3.0:1784290361.498597:0:75392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467deea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75392:1870961901094400:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1784290361.498671:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27000/0x5953bbf6b307480d lrc: 3/0,1 mode: --/PW res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.498687:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27000/0x5953bbf6b307480d lrc: 3/0,1 mode: PW/PW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.498702:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27000/0x5953bbf6b307480d lrc: 3/0,1 mode: PW/PW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290361.498719:0:74876:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009a746a34 reply state 000000005713d242 transno 81604378743 ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27000/0x5953bbf6b307480d lrc: 3/0,1 mode: PW/PW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.498734:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27000/0x5953bbf6b307480d lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.498744:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2461de5e00) 00010000:00010000:0.0:1784290361.498748:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290361.498752:0:74876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784290361.498758:0:74876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0x9:0x0]: returning size 4096 00000004:00080000:0.0:1784290361.498765:0:74876:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784290361.498776:0:74876:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30747f8 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.498788:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x5953bbf6b30747f8 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.498798:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x5953bbf6b30747f8 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.498821:0:74876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1784290361.498832:0:74876:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784290361.498837:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aa600/0x5953bbf6b30747ff lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074806 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.498841:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290361.498844:0:74876:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aa600/0x5953bbf6b30747ff lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074806 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.498849:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x5953bbf6b30747f8 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.498859:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aba00 already unused, calling callback (ffffffffc1ac6ed0) 00010000:00010000:1.0:1784290361.498864:0:8418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x5953bbf6b30747f8 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784290361.498872:0:8418:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x5953bbf6b30747f8 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.498899:0:8418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5953bbf6b30747f8 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.498905:0:8418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784290361.498925:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5953bbf6b30747f8 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290361.498927:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:70704:x1870961896243200:12345-192.168.202.6@tcp:36:mkdir.0 Request processed in 14380us (14548us total) trans 81604378743 rc 0/0 00010000:00010000:1.0:1784290361.498943:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aba00/0x5953bbf6b30747f1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5953bbf6b30747f8 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290361.498951:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1173 00010000:00010000:1.0:1784290361.498987:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290361.498991:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290361.498994:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290361.499009:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901094528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290361.499056:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290361.499094:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901094528 00000100:00100000:0.0:1784290361.499101:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901094528 00000100:00100000:0.0:1784290361.499152:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:0.0:1784290361.499165:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3620:x1870961901094528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290361.499178:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290361.499195:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c262400/0x5953bbf6b30747f8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30747f1 expref: 9 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.499214:0:9491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2461de5d00) 00010000:00010000:0.0:1784290361.499224:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784290361.499274:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3620:x1870961901094528:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290361.499282:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:1.0:1784290361.499305:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901094528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784290361.507158:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290361.507243:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896243456 00000100:00100000:1.0:1784290361.507250:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896243456 00000100:00100000:1.0:1784290361.507290:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1174 00000100:00100000:1.0:1784290361.507298:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:70709:x1870961896243456:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1784290361.507310:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290361.507323:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b3074814 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b239f expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.507394:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abe00/0x5953bbf6b307481b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.507402:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abe00/0x5953bbf6b307481b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.507410:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abe00/0x5953bbf6b307481b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290361.507433:0:65989:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784290361.507435:0:65989:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784290361.507448:0:65989:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abe00/0x5953bbf6b307481b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.507465:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b3074814 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b239f expref: 10 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.507477:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abe00/0x5953bbf6b307481b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b239f expref: 9 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.507496:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475807300) 00010000:00010000:1.0:1784290361.507498:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784290361.507501:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450abe00, rc 0) 00000100:00100000:1.0:1784290361.507538:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:70709:x1870961896243456:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 241us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290361.507544:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1174 00000100:00100000:3.0:1784290361.508538:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290361.508573:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896243584 00000100:00100000:1.0:1784290361.508580:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896243584 00000100:00100000:1.0:1784290361.508636:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1175 00000100:00100000:1.0:1784290361.508645:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:70709:x1870961896243584:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1784290361.508655:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290361.508666:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b3074822 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b23a6 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.508700:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3074829 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.508709:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3074829 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.508716:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3074829 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.508725:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b3074830 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.508732:0:66008:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b3074806 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30747ff expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.508750:0:66008:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b3074830 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.508772:0:66008:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b3074806 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b30747ff expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290361.508783:0:66008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2347d64700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:66008:1870961901094656:0@lo:104: 00000100:00100000:1.0:1784290361.508819:0:66008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290361.508852:0:66008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345634e40 going to sleep for 11 seconds 00000100:00100000:3.0:1784290361.508867:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901094656 00000100:00100000:3.0:1784290361.508874:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901094656 00000100:00100000:3.0:1784290361.508916:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1784290361.508926:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:66008:x1870961901094656:12345-0@lo:104: 00010000:00010000:3.0:1784290361.508939:0:7428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aa600/0x5953bbf6b30747ff lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074806 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.509004:0:7428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784290361.509013:0:66008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2347d64700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:66008:1870961901094656:0@lo:104: 00000100:00100000:3.0:1784290361.509016:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:66008:x1870961901094656:12345-0@lo:104: Request processed in 88us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290361.509029:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00010000:00010000:1.0:1784290361.509029:0:66008:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b3074830 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290361.509040:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290361.509052:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aa600/0x5953bbf6b30747ff lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074806 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290361.509080:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa600 already unused, calling callback (ffffffffc1ac6ed0) 00010000:00010000:2.0:1784290361.509086:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aa600/0x5953bbf6b30747ff lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3074806 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784290361.509097:0:6476:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aa600/0x5953bbf6b30747ff lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3074806 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290361.509130:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aa600/0x5953bbf6b30747ff lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074806 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290361.509139:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784290361.509172:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aa600/0x5953bbf6b30747ff lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074806 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290361.509181:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901094784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290361.509185:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450aa600/0x5953bbf6b30747ff lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074806 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290361.509213:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290361.509214:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784290361.509220:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290361.509225:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290361.509254:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901094784 00000100:00100000:3.0:1784290361.509261:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901094784 00010000:00010000:3.0:1784290361.509279:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b3074806 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x5953bbf6b30747ff expref: 8 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290361.509314:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584 00000100:00100000:3.0:1784290361.509322:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2347d64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:3617:x1870961901094784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784290361.509333:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:1.0:1784290361.510432:0:90705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149701 is committed 00010000:00010000:0.0:1784290361.510493:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b3074806 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b30747ff expref: 7 pid: 8412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.510510:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9c2475807200) 00010000:00010000:0.0:1784290361.510515:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b3074830 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.510533:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b3074830 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.510541:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b3074830 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.510566:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290361.510573:0:66008:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b3074830 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.510581:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b3074830 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290361.510614:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2347d64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1870961901094784:12345-0@lo:103:ldlm_bl.0 Request processed in 1292us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290361.510641:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584 00000100:00100000:2.0:1784290361.510669:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901094784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290361.510675:0:66008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c244405a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:66008:1870961901094912:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1784290361.510706:0:66008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290361.510725:0:66008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345634240 going to sleep for 11 seconds 00000100:00100000:2.0:1784290361.510736:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901094912 00000100:00100000:2.0:1784290361.510743:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901094912 00000100:00100000:2.0:1784290361.510787:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3817 00000100:00100000:2.0:1784290361.510798:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444058000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66008:x1870961901094912:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1784290361.510887:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444058000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66008:x1870961901094912:12345-0@lo:1000:mdt00_004.0 Request processed in 90us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290361.510892:0:66008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c244405a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:66008:1870961901094912:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1784290361.510909:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3817 00010000:00010000:1.0:1784290361.510942:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab200/0x5953bbf6b3074837 lrc: 3/1,0 mode: --/PR res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.510951:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab200/0x5953bbf6b3074837 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.510959:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab200/0x5953bbf6b3074837 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784290361.510970:0:66008:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab200/0x5953bbf6b3074837 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.510978:0:66008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3074829 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.510984:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3074829 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.510989:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3074829 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.510993:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3074829 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.510997:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450abc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290361.511001:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3074829 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.511006:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3074829 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.511013:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475807300) 00010000:00010000:1.0:1784290361.511015:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290361.511025:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3074829 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.511030:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3074829 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.511039:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b3074830 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.511043:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b3074830 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.511048:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b3074830 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.511053:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290361.511055:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b3074830 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.511059:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b3074830 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.511065:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9c2475807200) 00010000:00010000:1.0:1784290361.511067:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290361.511069:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b3074830 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.511074:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab800/0x5953bbf6b3074830 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.511094:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b3074822 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b23a6 expref: 11 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.511115:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab200/0x5953bbf6b3074837 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b23a6 expref: 10 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.511120:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2469585800) 00010000:00010000:1.0:1784290361.511123:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784290361.511124:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450ab200, rc 0) 00000100:00100000:1.0:1784290361.511156:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:70709:x1870961896243584:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 2513us (2620us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290361.511162:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1175 00000100:00100000:0.0:1784290361.512173:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290361.512215:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896243712 00000100:00100000:2.0:1784290361.512221:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896243712 00000100:00100000:2.0:1784290361.512258:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1176 00000100:00100000:2.0:1784290361.512267:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:70709:x1870961896243712:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1784290361.512280:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290361.512292:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585be400/0x5953bbf6b307483e lrc: 2/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b23ad expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290361.512341:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf000/0x5953bbf6b3074845 lrc: 3/1,0 mode: --/PR res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290361.512349:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf000/0x5953bbf6b3074845 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290361.512384:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf000/0x5953bbf6b3074845 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784290361.512414:0:66004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0x9:0x0]: returning size 4096 00000004:00200000:2.0:1784290361.512417:0:66004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1784290361.512436:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585be400/0x5953bbf6b307483e lrc: 0/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b23ad expref: 10 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290361.512448:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf000/0x5953bbf6b3074845 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b23ad expref: 9 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290361.512453:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2461de5e00) 00010000:00010000:2.0:1784290361.512456:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1784290361.512465:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24585bf000, rc 0) 00000100:00100000:2.0:1784290361.512518:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:70709:x1870961896243712:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 237us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290361.512525:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1176 00000100:00100000:0.0:1784290361.513590:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290361.513631:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896243840 00000100:00100000:1.0:1784290361.513636:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896243840 00000100:00100000:1.0:1784290361.513667:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1177 00000100:00100000:1.0:1784290361.513675:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:70709:x1870961896243840:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1784290361.513684:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290361.513692:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aa400/0x5953bbf6b307484c lrc: 2/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b23b4 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513720:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab000/0x5953bbf6b3074853 lrc: 3/1,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513729:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab000/0x5953bbf6b3074853 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513736:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab000/0x5953bbf6b3074853 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513744:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab600/0x5953bbf6b307485a lrc: 3/1,0 mode: --/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513758:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab600/0x5953bbf6b307485a lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513764:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab600/0x5953bbf6b307485a lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513782:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab000/0x5953bbf6b3074853 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513787:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab000/0x5953bbf6b3074853 lrc: 2/0,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513792:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab000/0x5953bbf6b3074853 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513796:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290361.513799:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab000/0x5953bbf6b3074853 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513804:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab000/0x5953bbf6b3074853 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513811:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2461de5e00) 00010000:00010000:1.0:1784290361.513813:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290361.513816:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab000/0x5953bbf6b3074853 lrc: 2/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513820:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab000/0x5953bbf6b3074853 lrc: 0/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513831:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab600/0x5953bbf6b307485a lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513841:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab600/0x5953bbf6b307485a lrc: 2/0,0 mode: PR/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513846:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab600/0x5953bbf6b307485a lrc: 3/0,0 mode: PR/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513850:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290361.513853:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab600/0x5953bbf6b307485a lrc: 3/0,0 mode: PR/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513857:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab600/0x5953bbf6b307485a lrc: 4/0,0 mode: PR/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513864:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0xf7117594 (ffff9c2469585300) 00010000:00010000:1.0:1784290361.513866:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290361.513868:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab600/0x5953bbf6b307485a lrc: 2/0,0 mode: --/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513873:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab600/0x5953bbf6b307485a lrc: 0/0,0 mode: --/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513896:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aa400/0x5953bbf6b307484c lrc: 1/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b23b4 expref: 10 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513903:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2461de5e00) 00010000:00010000:1.0:1784290361.513905:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290361.513909:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aa400/0x5953bbf6b307484c lrc: 0/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b23b4 expref: 10 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.513926:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aa400, rc 0) 00000100:00100000:1.0:1784290361.513958:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:70709:x1870961896243840:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 283us (369us total) trans 0 rc 301/301 00000100:00100000:1.0:1784290361.513965:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1177 00000100:00100000:0.0:1784290361.515125:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290361.515165:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896243968 00000100:00100000:3.0:1784290361.515171:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896243968 00000100:00100000:3.0:1784290361.515208:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1178 00000100:00100000:3.0:1784290361.515215:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:70709:x1870961896243968:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1784290361.515224:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290361.515240:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263400/0x5953bbf6b3074861 lrc: 2/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b23bb expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515272:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263000/0x5953bbf6b3074868 lrc: 3/1,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515287:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263000/0x5953bbf6b3074868 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515294:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263000/0x5953bbf6b3074868 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515321:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262000/0x5953bbf6b307486f lrc: 3/1,0 mode: --/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515328:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262000/0x5953bbf6b307486f lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515334:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262000/0x5953bbf6b307486f lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515387:0:65988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263000/0x5953bbf6b3074868 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515398:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263000/0x5953bbf6b3074868 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515407:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263000/0x5953bbf6b3074868 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515415:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263000/0x5953bbf6b3074868 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515422:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c263000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290361.515433:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263000/0x5953bbf6b3074868 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515438:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263000/0x5953bbf6b3074868 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515447:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2461de5e00) 00010000:00010000:3.0:1784290361.515449:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290361.515452:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263000/0x5953bbf6b3074868 lrc: 3/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515458:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263000/0x5953bbf6b3074868 lrc: 0/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515469:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262000/0x5953bbf6b307486f lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515474:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262000/0x5953bbf6b307486f lrc: 2/0,0 mode: PR/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515479:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262000/0x5953bbf6b307486f lrc: 3/0,0 mode: PR/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515484:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c262000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290361.515487:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262000/0x5953bbf6b307486f lrc: 3/0,0 mode: PR/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515492:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262000/0x5953bbf6b307486f lrc: 4/0,0 mode: PR/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515499:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0xf7117594 (ffff9c2442ffee00) 00010000:00010000:3.0:1784290361.515501:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290361.515510:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262000/0x5953bbf6b307486f lrc: 2/0,0 mode: --/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515515:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262000/0x5953bbf6b307486f lrc: 0/0,0 mode: --/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515543:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263400/0x5953bbf6b3074861 lrc: 1/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b23bb expref: 10 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515552:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2461de5e00) 00010000:00010000:3.0:1784290361.515554:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290361.515558:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263400/0x5953bbf6b3074861 lrc: 0/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b23bb expref: 10 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.515583:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247c263400, rc 0) 00000100:00100000:3.0:1784290361.515631:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:70709:x1870961896243968:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 401us (495us total) trans 0 rc 301/301 00000100:00100000:3.0:1784290361.515642:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1178 00000100:00100000:3.0:1784290361.516979:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290361.517018:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896244096 00000100:00100000:3.0:1784290361.517023:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896244096 00000100:00100000:3.0:1784290361.517058:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1179 00000100:00100000:3.0:1784290361.517069:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+9:70709:x1870961896244096:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1784290361.517081:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290361.517099:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263600/0x5953bbf6b3074876 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b23c2 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.517133:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263800/0x5953bbf6b307487d lrc: 3/1,0 mode: --/PR res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.517157:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263800/0x5953bbf6b307487d lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.517168:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263800/0x5953bbf6b307487d lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290361.517197:0:74876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0x9:0x0]: returning size 4096 00000004:00200000:3.0:1784290361.517202:0:74876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784290361.517215:0:74876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263800/0x5953bbf6b307487d lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.517240:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263600/0x5953bbf6b3074876 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b23c2 expref: 11 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.517268:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263800/0x5953bbf6b307487d lrc: 3/0,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b23c2 expref: 10 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.517278:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2461de5e00) 00010000:00010000:3.0:1784290361.517281:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784290361.517286:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247c263800, rc 0) 00000100:00100000:3.0:1784290361.517481:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:70709:x1870961896244096:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 413us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290361.517488:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1179 00000100:00100000:0.0:1784290361.519383:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290361.519422:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896244352 00000100:00100000:0.0:1784290361.519428:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896244352 00000100:00100000:0.0:1784290361.519469:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1180 00000100:00100000:0.0:1784290361.519480:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:70709:x1870961896244352:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:0.0:1784290361.519494:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290361.519514:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd26200/0x5953bbf6b3074884 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b23c9 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290361.519593:0:65989:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0x9:0x0]: returning size 4096 00010000:00010000:0.0:1784290361.519703:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd26200/0x5953bbf6b3074884 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b23c9 expref: 12 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.519716:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2461de5d00) 00010000:00010000:0.0:1784290361.519726:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784290361.519733:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd26200/0x5953bbf6b3074884 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b23c9 expref: 12 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.519752:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26200, rc 0) 00000100:00100000:0.0:1784290361.519789:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:70709:x1870961896244352:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 311us (436us total) trans 81604378744 rc 301/301 00000100:00100000:0.0:1784290361.519798:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1180 00000100:00100000:2.0:1784290361.521406:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290361.521440:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896244608 00000100:00100000:3.0:1784290361.521448:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896244608 00000100:00100000:3.0:1784290361.521485:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1181 00000100:00100000:3.0:1784290361.521497:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:70709:x1870961896244608:12345-192.168.202.6@tcp:36:lfs.0 00010000:00010000:3.0:1784290361.521533:0:66008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290361.521553:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263800/0x5953bbf6b307487d lrc: 0/0,0 mode: --/PR res: [0x240006991:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b23c2 expref: 11 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.521565:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2461de5e00) 00010000:00010000:3.0:1784290361.521568:0:66008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290361.521599:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263a00/0x5953bbf6b3074892 lrc: 3/0,1 mode: --/CW res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.521612:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263a00/0x5953bbf6b3074892 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.521638:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263a00/0x5953bbf6b3074892 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.521655:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262800/0x5953bbf6b3074899 lrc: 3/0,1 mode: --/PW res: [0x240006991:0x9:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.521665:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262800/0x5953bbf6b3074899 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.521674:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262800/0x5953bbf6b3074899 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.522199:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263200/0x5953bbf6b30748a0 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.522213:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263200/0x5953bbf6b30748a0 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.522224:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263200/0x5953bbf6b30748a0 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290361.522242:0:66008:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000058e142c6 reply state 000000009b72c960 transno 81604378745 ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263200/0x5953bbf6b30748a0 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.522264:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263200/0x5953bbf6b30748a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.522272:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c2442ffe200) 00010000:00010000:3.0:1784290361.522276:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290361.522279:0:66008:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784290361.522283:0:66008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1784290361.522291:0:66008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263a00/0x5953bbf6b3074892 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.522300:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263a00/0x5953bbf6b3074892 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.522308:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263a00/0x5953bbf6b3074892 lrc: 3/0,0 mode: CW/CW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.522317:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263a00/0x5953bbf6b3074892 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.522324:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c263a00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290361.522329:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263a00/0x5953bbf6b3074892 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.522366:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263a00/0x5953bbf6b3074892 lrc: 5/0,0 mode: CW/CW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.522379:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2461de5e00) 00010000:00010000:3.0:1784290361.522382:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290361.522387:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263a00/0x5953bbf6b3074892 lrc: 3/0,0 mode: --/CW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.522409:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263a00/0x5953bbf6b3074892 lrc: 0/0,0 mode: --/CW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290361.522423:0:66008:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000058e142c6 reply state 000000009b72c960 transno 81604378745 ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262800/0x5953bbf6b3074899 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.522435:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262800/0x5953bbf6b3074899 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.522443:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0xf7117594 (ffff9c2442ffea00) 00010000:00010000:3.0:1784290361.522446:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290361.522450:0:66008:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1784290361.522501:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:70709:x1870961896244608:12345-192.168.202.6@tcp:36:lfs.0 Request processed in 1005us (1095us total) trans 81604378745 rc 0/0 00000100:00100000:3.0:1784290361.522511:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1181 00000100:00100000:0.0:1784290361.523800:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290361.523856:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896244864 00000100:00100000:2.0:1784290361.523863:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896244864 00000100:00100000:2.0:1784290361.523903:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 226 00000100:00100000:2.0:1784290361.523914:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+12:70709:x1870961896244864:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1784290361.524037:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:70709:x1870961896244864:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 123us (237us total) trans 81604378746 rc 0/0 00000100:00100000:2.0:1784290361.524047:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 226 00000100:00100000:3.0:1784290361.549097:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290361.549127:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290361.549156:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290361.549158:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896244992 00000100:00100000:2.0:1784290361.549168:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896244992 00000100:00100000:1.0:1784290361.549203:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896245248 00000100:00100000:1.0:1784290361.549211:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896245248 00000100:00100000:2.0:1784290361.549214:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896245120 00000100:00100000:2.0:1784290361.549218:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896245120 00000100:00100000:0.0:1784290361.549229:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 666 00000100:00100000:3.0:1784290361.549241:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 667 00000100:00100000:0.0:1784290361.549246:0:19593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:bdffa268-fb6a-4248-991c-0ad16fac303f+12:2398:x1870961896244992:12345-192.168.202.6@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1784290361.549257:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 668 00000100:00100000:3.0:1784290361.549259:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245818fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:bdffa268-fb6a-4248-991c-0ad16fac303f+12:2397:x1870961896245120:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784290361.549262:0:19593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1784290361.549270:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdffa268-fb6a-4248-991c-0ad16fac303f+12:2400:x1870961896245248:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784290361.549277:0:19592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290361.549279:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290361.549285:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236ca00/0x5953bbf6b3074551 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2367 expref: 12 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.549297:0:19592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2458d5c200/0x5953bbf6b3074558 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b236e expref: 12 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290361.549297:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2458d5ce00/0x5953bbf6b307455f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2375 expref: 12 pid: 90714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.549300:0:19593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290361.549317:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290361.549322:0:19592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784290361.549378:0:19593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:bdffa268-fb6a-4248-991c-0ad16fac303f+9:2398:x1870961896244992:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 138us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290361.549379:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bdffa268-fb6a-4248-991c-0ad16fac303f+9:2400:x1870961896245248:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 113us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290361.549392:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 666 00000100:00100000:2.0:1784290361.549399:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 668 00000100:00100000:3.0:1784290361.549482:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245818fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:bdffa268-fb6a-4248-991c-0ad16fac303f+7:2397:x1870961896245120:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 227us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290361.549573:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290361.549613:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896245504 00000100:00100000:3.0:1784290361.549614:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 667 00000100:00100000:2.0:1784290361.549635:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896245504 00000100:00100000:2.0:1784290361.549669:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4946 00000100:00100000:2.0:1784290361.549678:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244405a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+6:2396:x1870961896245504:12345-192.168.202.6@tcp:9:umount.0 00000020:00000080:2.0:1784290361.549697:0:26250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073fc4 00000020:00010000:2.0:1784290361.549703:0:26250:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c247d3d7800: total 0 00000100:00080000:2.0:1784290361.549706:0:26250:0:(import.c:65:import_set_state_nolock()) ffff9c2475c2b000 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1784290361.549725:0:7429:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c247d3d7800: total 0 00000001:00000004:2.0:1784290361.549750:0:26250:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968630 00010000:00010000:1.0:1784290361.549773:0:7429:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c247d3d7800, canceled 0 locks, left on hash table 1. 00002000:00010000:1.0:1784290361.549800:0:7429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x702:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:1.0:1784290361.549803:0:7429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x702:0x0] updating lvb atime from disk: 0 -> 1784290333 00002000:00010000:1.0:1784290361.549805:0:7429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x702:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:1.0:1784290361.549821:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000120e7c7/0x5953bbf6b30742cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2344 expref: 6 pid: 26255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.549842:0:7429:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c247d3d7800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1784290361.549853:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290361.549855:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290361.549857:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290361.549876:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244405a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+2:2396:x1870961896245504:12345-192.168.202.6@tcp:9:umount.0 Request processed in 200us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290361.549882:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4946 00000100:00100000:0.0:1784290361.551902:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290361.551934:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896245888 00000100:00100000:3.0:1784290361.551939:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896245888 00000100:00100000:3.0:1784290361.551965:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4947 00000100:00100000:3.0:1784290361.551971:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+7:2396:x1870961896245888:12345-192.168.202.6@tcp:9:umount.0 00000020:00000080:3.0:1784290361.551981:0:26252:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3073fbd 00000020:00010000:3.0:1784290361.551986:0:26252:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c247f8f5800: total 0 00000100:00080000:3.0:1784290361.551988:0:26252:0:(import.c:65:import_set_state_nolock()) ffff9c247d3d1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784290361.552015:0:26252:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968629 00000020:00010000:0.0:1784290361.552018:0:19681:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c247f8f5800: total 0 00010000:00010000:0.0:1784290361.552057:0:19681:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c247f8f5800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1784290361.552090:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5e3e00b/0x5953bbf6b30742c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x702:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b233d expref: 5 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290361.552106:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+4:2396:x1870961896245888:12345-192.168.202.6@tcp:9:umount.0 Request processed in 132us (202us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290361.552116:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000331ccedf/0x5953bbf6b30742d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x703:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b234b expref: 4 pid: 26263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290361.552117:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4947 00010000:00010000:0.0:1784290361.552144:0:19681:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c247f8f5800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1784290361.552156:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290361.552157:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290361.552159:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290361.555644:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290361.555694:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896246400 00000100:00100000:2.0:1784290361.555701:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896246400 00000100:00100000:2.0:1784290361.555738:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1182 00000100:00100000:2.0:1784290361.555746:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+10:2396:x1870961896246400:12345-192.168.202.6@tcp:39:umount.0 00000020:00000080:2.0:1784290361.555764:0:66004:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30743d0 00000020:00010000:2.0:1784290361.555773:0:66004:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2343905800: total 0 00000100:00080000:2.0:1784290361.555775:0:66004:0:(import.c:65:import_set_state_nolock()) ffff9c2344980000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784290361.555792:0:66004:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149701 00000020:00010000:0.0:1784290361.555819:0:6477:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2343905800: total 0 00010000:00010000:0.0:1784290361.555851:0:6477:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2343905800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1784290361.555872:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2443b66400) 00010000:00010000:0.0:1784290361.555875:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1784290361.555881:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ef9400/0x5953bbf6b30745ba lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2336 expref: 8 pid: 90737 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290361.555887:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+8:2396:x1870961896246400:12345-192.168.202.6@tcp:39:umount.0 Request processed in 139us (240us total) trans 111669149702 rc 0/0 00000100:00100000:2.0:1784290361.555898:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1182 00010000:00010000:0.0:1784290361.555904:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2469585800) 00010000:00010000:0.0:1784290361.555908:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784290361.555914:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab200/0x5953bbf6b3074837 lrc: 0/0,0 mode: --/PR res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b23a6 expref: 6 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.555948:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475807300) 00010000:00010000:0.0:1784290361.555952:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784290361.555959:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abe00/0x5953bbf6b307481b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b239f expref: 5 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.555979:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9c2443b66400) 00010000:00010000:0.0:1784290361.555982:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784290361.555987:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b30747e3 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2398 expref: 4 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.556002:0:6477:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2343905800, canceled 4 locks, left on hash table 0. 00010000:00010000:0.0:1784290361.556026:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290361.556029:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290361.556031:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290361.559947:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290361.560005:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896246656 00000100:00100000:0.0:1784290361.560013:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896246656 00000100:00100000:0.0:1784290361.560083:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1183 00000100:00100000:0.0:1784290361.560096:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444058e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+13:2396:x1870961896246656:12345-192.168.202.6@tcp:39:umount.0 00000020:00000080:0.0:1784290361.560125:0:65989:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b306f16d 00000020:00010000:0.0:1784290361.560137:0:65989:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c247e403800: total 0 00000100:00080000:0.0:1784290361.560141:0:65989:0:(import.c:65:import_set_state_nolock()) ffff9c23417db000 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1784290361.560184:0:8418:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c247e403800: total 0 00000001:00000004:0.0:1784290361.560187:0:65989:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378746 00010000:00010000:1.0:1784290361.560193:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290361.560237:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262800/0x5953bbf6b3074899 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.560250:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262800/0x5953bbf6b3074899 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290361.560254:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27000/0x5953bbf6b307480d lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.560256:0:8418:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c247e403800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784290361.560260:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262800/0x5953bbf6b3074899 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290361.560276:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27000/0x5953bbf6b307480d lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.560278:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c262800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290361.560288:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262800/0x5953bbf6b3074899 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290361.560289:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27000/0x5953bbf6b307480d lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.560299:0:8418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2461de5e00) 00010000:00010000:3.0:1784290361.560300:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262800/0x5953bbf6b3074899 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.560304:0:8418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1784290361.560313:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf000/0x5953bbf6b3074845 lrc: 0/0,0 mode: --/PR res: [0x240006991:0x9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b23ad expref: 11 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290361.560314:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290361.560322:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27000/0x5953bbf6b307480d lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290361.560331:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27000/0x5953bbf6b307480d lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.560334:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0xf7117594 (ffff9c2442ffea00) 00000100:00100000:0.0:1784290361.560341:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444058e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd808cf4-dd54-45f0-9b2b-1434e8330e5d+11:2396:x1870961896246656:12345-192.168.202.6@tcp:39:umount.0 Request processed in 244us (390us total) trans 81604378747 rc 0/0 00010000:00010000:3.0:1784290361.560343:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290361.560350:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262800/0x5953bbf6b3074899 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290361.560372:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2461de5e00) 00010000:00010000:2.0:1784290361.560377:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290361.560381:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27000/0x5953bbf6b307480d lrc: 2/0,0 mode: --/TXN res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.560388:0:8418:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c247e403800, canceled 1 locks, left on hash table 0. 00000100:00100000:0.0:1784290361.560390:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1183 00010000:00010000:2.0:1784290361.560397:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27000/0x5953bbf6b307480d lrc: 0/0,0 mode: --/TXN res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.560402:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262800/0x5953bbf6b3074899 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290361.560418:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290361.560422:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290361.560425:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290361.560429:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263200/0x5953bbf6b30748a0 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.560438:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263200/0x5953bbf6b30748a0 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.560446:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263200/0x5953bbf6b30748a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.560453:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c263200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290361.560458:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263200/0x5953bbf6b30748a0 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.560466:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263200/0x5953bbf6b30748a0 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.560477:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c2442ffe200) 00010000:00010000:3.0:1784290361.560480:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290361.560483:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263200/0x5953bbf6b30748a0 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290361.560490:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263200/0x5953bbf6b30748a0 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290361.571328:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290361.571387:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896246912 00000100:00100000:2.0:1784290361.571394:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896246912 00000100:00100000:2.0:1784290361.571434:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:2.0:1784290361.571444:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+7:2396:x1870961896246912:12345-192.168.202.6@tcp:251:umount.0 00000020:00000080:2.0:1784290361.571476:0:90712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074486 00000020:00010000:2.0:1784290361.571483:0:90712:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2474f80000: total 0 00000100:00080000:2.0:1784290361.571486:0:90712:0:(import.c:65:import_set_state_nolock()) ffff9c2474f85000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1784290361.571534:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bdffa268-fb6a-4248-991c-0ad16fac303f+3:2396:x1870961896246912:12345-192.168.202.6@tcp:251:umount.0 Request processed in 91us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290361.571543:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 77 00000020:00010000:0.0:1784290361.571571:0:6476:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2474f80000: total 0 00010000:00010000:0.0:1784290361.571639:0:6476:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2474f80000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784290361.571670:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236c400/0x5953bbf6b3074566 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b237c expref: 2 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290361.571687:0:6476:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2474f80000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1784290361.571700:0:6476:0:(genops.c:906:class_export_put()) final put ffff9c2474f80000/bdffa268-fb6a-4248-991c-0ad16fac303f 00010000:00010000:0.0:1784290361.571718:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290361.571720:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290361.571722:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784290361.571741:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2474f80000/bdffa268-fb6a-4248-991c-0ad16fac303f for MGS 00000020:00000080:2.0:1784290361.571777:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2474f85000 for MGS 00000100:00100000:1.0:1784290362.002540:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290362.002599:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896247040 00000100:00100000:2.0:1784290362.002636:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896247040 00000100:00100000:2.0:1784290362.002683:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 78 00000100:00100000:2.0:1784290362.002693:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2396:x1870961896247040:12345-192.168.202.6@tcp:250:mount.lustre.0 00010000:00080000:2.0:1784290362.002720:0:90711:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f@192.168.202.6@tcp t0 exp 0000000000000000 cur 2103 last 0 00000020:00000080:2.0:1784290362.002747:0:90711:0:(genops.c:1406:class_connect()) connect: client fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f, cookie 0x5953bbf6b30748a7 00000100:00080000:2.0:1784290362.002787:0:90711:0:(import.c:65:import_set_state_nolock()) ffff9c2474f80000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784290362.002850:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+5:2396:x1870961896247040:12345-192.168.202.6@tcp:250:mount.lustre.0 Request processed in 158us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290362.002860:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 78 00000100:00100000:1.0:1784290362.003640:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290362.003673:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896247168 00000100:00100000:3.0:1784290362.003679:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896247168 00000100:00100000:3.0:1784290362.003711:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00100000:3.0:1784290362.003717:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+5:70736:x1870961896247168:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784290362.003725:0:90710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290362.003739:0:90710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247c263200/0x5953bbf6b30748ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b23de expref: -99 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290362.003760:0:90710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247c263200/0x5953bbf6b30748ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b23de expref: 6 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290362.003768:0:90710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247c263200/0x5953bbf6b30748ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b23de expref: 6 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290362.003776:0:90710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247c263200, rc 0) 00000100:00100000:3.0:1784290362.003803:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+6:70736:x1870961896247168:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 86us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290362.003808:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00100000:1.0:1784290362.004554:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290362.004607:0:90714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896247296 00000100:00100000:2.0:1784290362.004627:0:90714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896247296 00000100:00100000:2.0:1784290362.004665:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00100000:2.0:1784290362.004675:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+6:70736:x1870961896247296:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784290362.004775:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+6:70736:x1870961896247296:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 101us (219us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784290362.004784:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00100000:1.0:1784290362.005628:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290362.005679:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896247424 00000100:00100000:2.0:1784290362.005685:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896247424 00000100:00100000:2.0:1784290362.005721:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:2.0:1784290362.005731:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+6:70736:x1870961896247424:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784290362.005739:0:90712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290362.005749:0:90712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c24585bfc00/0x5953bbf6b30748b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b23e5 expref: -99 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290362.005768:0:90712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c24585bfc00/0x5953bbf6b30748b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b23e5 expref: 7 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290362.005793:0:90712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c24585bfc00/0x5953bbf6b30748b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b23e5 expref: 7 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290362.005802:0:90712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24585bfc00, rc 0) 00000100:00100000:2.0:1784290362.005839:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+7:70736:x1870961896247424:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 109us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290362.005848:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:1.0:1784290362.006474:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290362.006525:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896247552 00000100:00100000:2.0:1784290362.006531:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896247552 00000100:00100000:2.0:1784290362.006566:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:2.0:1784290362.006575:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+7:70736:x1870961896247552:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784290362.006690:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70736:x1870961896247552:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 116us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290362.006700:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:1.0:1784290362.007336:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290362.007570:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896247680 00000100:00100000:3.0:1784290362.007576:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896247680 00000100:00100000:3.0:1784290362.007728:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 83 00000100:00100000:3.0:1784290362.007735:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70736:x1870961896247680:12345-192.168.202.6@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784290362.007808:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70736:x1870961896247680:12345-192.168.202.6@tcp:503:mount.lustre.0 Request processed in 73us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290362.007814:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 83 00000100:00100000:1.0:1784290362.008743:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290362.008791:0:90714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896247808 00000100:00100000:2.0:1784290362.008796:0:90714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896247808 00000100:00100000:2.0:1784290362.008824:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 84 00000100:00100000:2.0:1784290362.008831:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70754:x1870961896247808:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784290362.008900:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70754:x1870961896247808:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 68us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290362.008906:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 84 00000100:00100000:1.0:1784290362.018865:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290362.018927:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896247936 00000100:00100000:2.0:1784290362.018936:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896247936 00000100:00100000:2.0:1784290362.018978:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 85 00000100:00100000:2.0:1784290362.018988:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70754:x1870961896247936:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784290362.019092:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70754:x1870961896247936:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 104us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290362.019103:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 85 00000100:00100000:1.0:1784290362.019824:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290362.019874:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896248064 00000100:00100000:2.0:1784290362.019880:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896248064 00000100:00100000:2.0:1784290362.019912:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00100000:2.0:1784290362.019920:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70754:x1870961896248064:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784290362.019977:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70754:x1870961896248064:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 59us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290362.019984:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 86 00000100:00100000:1.0:1784290362.020997:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290362.021026:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896248192 00000100:00100000:3.0:1784290362.021038:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896248192 00000100:00100000:3.0:1784290362.021065:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 87 00000100:00100000:3.0:1784290362.021071:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70736:x1870961896248192:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784290362.021079:0:90710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290362.021090:0:90710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247c262800/0x5953bbf6b30748bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2416 expref: -99 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290362.021108:0:90710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247c262800/0x5953bbf6b30748bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2416 expref: 9 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290362.021116:0:90710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247c262800/0x5953bbf6b30748bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2416 expref: 9 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290362.021123:0:90710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247c262800, rc 0) 00000100:00100000:3.0:1784290362.021151:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70736:x1870961896248192:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 81us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290362.021156:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 87 00000100:00100000:1.0:1784290362.022697:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290362.022755:0:90714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896248320 00000100:00100000:2.0:1784290362.022761:0:90714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896248320 00000100:00100000:2.0:1784290362.022795:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 88 00000100:00100000:2.0:1784290362.022802:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70736:x1870961896248320:12345-192.168.202.6@tcp:256:mount.lustre.0 20000000:01000000:2.0:1784290362.022816:0:90714:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1784290362.022832:0:90714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784290362.022836:0:90714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784290362.022838:0:90714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784290362.022840:0:90714:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1784290362.022842:0:90714:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 116 00010000:00010000:2.0:1784290362.023463:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290362.023509:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70736:x1870961896248320:12345-192.168.202.6@tcp:256:mount.lustre.0 Request processed in 707us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290362.023516:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 88 00000100:00100000:1.0:1784290362.024681:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290362.024734:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896248448 00000100:00100000:2.0:1784290362.024740:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896248448 00000100:00100000:2.0:1784290362.024775:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 89 00000100:00100000:2.0:1784290362.024782:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70736:x1870961896248448:12345-192.168.202.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784290362.024789:0:90712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290362.024798:0:90712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c24585be800/0x5953bbf6b30748c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b241d expref: -99 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290362.024812:0:90712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c24585be800/0x5953bbf6b30748c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b241d expref: 10 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290362.024819:0:90712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c24585be800/0x5953bbf6b30748c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b241d expref: 10 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290362.024824:0:90712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24585be800, rc 0) 00000100:00100000:2.0:1784290362.024850:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70736:x1870961896248448:12345-192.168.202.6@tcp:101:mount.lustre.0 Request processed in 70us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290362.024856:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 89 00000100:00100000:1.0:1784290362.025531:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290362.025627:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896248576 00000100:00100000:2.0:1784290362.025634:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896248576 00000100:00100000:2.0:1784290362.025669:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 90 00000100:00100000:2.0:1784290362.025679:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70736:x1870961896248576:12345-192.168.202.6@tcp:501:mount.lustre.0 00000100:00100000:2.0:1784290362.025771:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a472c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70736:x1870961896248576:12345-192.168.202.6@tcp:501:mount.lustre.0 Request processed in 93us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290362.025778:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 90 00000100:00100000:1.0:1784290362.026473:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290362.026514:0:90710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896248704 00000100:00100000:3.0:1784290362.026519:0:90710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896248704 00000100:00100000:3.0:1784290362.026545:0:90710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 91 00000100:00100000:3.0:1784290362.026550:0:90710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70736:x1870961896248704:12345-192.168.202.6@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784290362.026629:0:90710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70736:x1870961896248704:12345-192.168.202.6@tcp:503:mount.lustre.0 Request processed in 77us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290362.026636:0:90710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 91 00000100:00100000:1.0:1784290362.028151:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290362.028233:0:90714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896248832 00000100:00100000:2.0:1784290362.028239:0:90714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896248832 00000100:00100000:2.0:1784290362.028268:0:90714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 92 00000100:00100000:2.0:1784290362.028275:0:90714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70756:x1870961896248832:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784290362.028368:0:90714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a473c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70756:x1870961896248832:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 91us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290362.028375:0:90714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 92 00000100:00100000:1.0:1784290362.029213:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290362.029315:0:90712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896248960 00000100:00100000:2.0:1784290362.029323:0:90712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896248960 00000100:00100000:2.0:1784290362.029405:0:90712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 93 00000100:00100000:2.0:1784290362.029417:0:90712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70756:x1870961896248960:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784290362.029509:0:90712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70756:x1870961896248960:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 93us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290362.029520:0:90712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 93 00000100:00100000:1.0:1784290362.030776:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290362.030810:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896249088 00000100:00100000:3.0:1784290362.030815:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896249088 00000100:00100000:3.0:1784290362.030878:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1184 00000100:00100000:3.0:1784290362.030883:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1870961896249088:12345-192.168.202.6@tcp:38:mount.lustre.0 00010000:00080000:3.0:1784290362.030909:0:66008:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp t0 exp 0000000000000000 cur 2103 last 0 00000020:00000080:3.0:1784290362.031004:0:66008:0:(genops.c:1406:class_connect()) connect: client 711f3c77-e791-4aa8-86ee-bc854fd0bcc5, cookie 0x5953bbf6b30748ca 00000100:00100000:1.0:1784290362.031014:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000004:00100000:3.0:1784290362.031024:0:66008:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1784290362.031081:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896249344 00000100:00100000:0.0:1784290362.031089:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896249344 00000100:00100000:0.0:1784290362.031131:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1185 00000100:00100000:0.0:1784290362.031139:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244405aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2396:x1870961896249344:12345-192.168.202.6@tcp:38:mount.lustre.0 00000100:00080000:3.0:1784290362.031141:0:66008:0:(import.c:65:import_set_state_nolock()) ffff9c2458bef000 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1784290362.031164:0:74876:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp t0 exp 0000000000000000 cur 2103 last 0 00000100:00100000:3.0:1784290362.031200:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444059f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2396:x1870961896249088:12345-192.168.202.6@tcp:38:mount.lustre.0 Request processed in 312us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290362.031210:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1184 00000020:00000080:0.0:1784290362.031217:0:74876:0:(genops.c:1406:class_connect()) connect: client 711f3c77-e791-4aa8-86ee-bc854fd0bcc5, cookie 0x5953bbf6b30748d1 00000004:00100000:0.0:1784290362.031235:0:74876:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1784290362.031372:0:74876:0:(import.c:65:import_set_state_nolock()) ffff9c2346879000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290362.031417:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244405aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2396:x1870961896249344:12345-192.168.202.6@tcp:38:mount.lustre.0 Request processed in 277us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290362.031445:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1185 00000100:00100000:1.0:1784290362.032378:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290362.032411:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290362.032434:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290362.032464:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896249600 00000100:00100000:3.0:1784290362.032470:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896249600 00000100:00100000:0.0:1784290362.032489:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896249216 00000100:00100000:0.0:1784290362.032498:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896249216 00000100:00100000:2.0:1784290362.032519:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896249472 00000100:00080000:1.0:1784290362.032523:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784290362.032528:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896249472 00000100:00100000:3.0:1784290362.032537:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1186 00000100:00100000:3.0:1784290362.032552:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444058380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:70736:x1870961896249600:12345-192.168.202.6@tcp:41:mount.lustre.0 00000100:00100000:0.0:1784290362.032557:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1187 00000100:00100000:0.0:1784290362.032576:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244405b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:0:x1870961896249216:12345-192.168.202.6@tcp:41:mount.lustre.0 00000100:00080000:1.0:1784290362.032577:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:3.0:1784290362.032588:0:65988:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444605952 avail 1298366464 00000100:00100000:2.0:1784290362.032602:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1188 00000004:00000024:0.0:1784290362.032603:0:65990:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444605952 avail 1298366464 00000100:00100000:2.0:1784290362.032641:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244405b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:0:x1870961896249472:12345-192.168.202.6@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784290362.032684:0:65989:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445097472 avail 1298857984 00000100:00100000:3.0:1784290362.032702:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444058380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:70736:x1870961896249600:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 154us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290362.032708:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244405b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:0:x1870961896249216:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 136us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290362.032719:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1186 00000100:00100000:0.0:1784290362.032727:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1187 00000100:00100000:2.0:1784290362.032745:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244405b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:0:x1870961896249472:12345-192.168.202.6@tcp:41:mount.lustre.0 Request processed in 129us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290362.032757:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1188 00000100:00100000:1.0:1784290362.033468:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290362.033512:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896249728 00000100:00100000:3.0:1784290362.033519:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896249728 00000100:00100000:3.0:1784290362.033553:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1189 00000100:00100000:3.0:1784290362.033560:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23445fd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:70736:x1870961896249728:12345-192.168.202.6@tcp:40:mount.lustre.0 00000100:00100000:3.0:1784290362.033608:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23445fd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:70736:x1870961896249728:12345-192.168.202.6@tcp:40:mount.lustre.0 Request processed in 48us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290362.033636:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1189 00000100:00100000:1.0:1784290362.034584:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290362.034646:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290362.034692:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290362.034703:0:26257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896249856 00000100:00100000:0.0:1784290362.034710:0:26257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896249856 00000100:00100000:1.0:1784290362.034718:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896249984 00000100:00100000:1.0:1784290362.034724:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896249984 00000100:00100000:2.0:1784290362.034733:0:75766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896250112 00000100:00100000:2.0:1784290362.034742:0:75766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896250112 00000100:00100000:0.0:1784290362.034747:0:26257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4948 00000100:00100000:0.0:1784290362.034755:0:26257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244405a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2396:x1870961896249856:12345-192.168.202.6@tcp:8:mount.lustre.0 00000100:00100000:1.0:1784290362.034761:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4949 00000100:00100000:1.0:1784290362.034769:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244405b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2396:x1870961896249984:12345-192.168.202.6@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784290362.034776:0:26257:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp t0 exp 0000000000000000 cur 2103 last 0 00000100:00100000:2.0:1784290362.034789:0:75766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 10 00010000:00080000:1.0:1784290362.034790:0:8403:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp t0 exp 0000000000000000 cur 2103 last 0 00000020:00000080:0.0:1784290362.034803:0:26257:0:(genops.c:1406:class_connect()) connect: client 711f3c77-e791-4aa8-86ee-bc854fd0bcc5, cookie 0x5953bbf6b30748d8 00000100:00100000:2.0:1784290362.034804:0:75766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244405ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:70736:x1870961896250112:12345-192.168.202.6@tcp:900:mount.lustre.0 00002000:00100000:0.0:1784290362.034813:0:26257:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 711f3c77-e791-4aa8-86ee-bc854fd0bcc5/ffff9c234687a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ad ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000020:00000080:1.0:1784290362.034816:0:8403:0:(genops.c:1406:class_connect()) connect: client 711f3c77-e791-4aa8-86ee-bc854fd0bcc5, cookie 0x5953bbf6b30748df 00002000:00100000:1.0:1784290362.034825:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 711f3c77-e791-4aa8-86ee-bc854fd0bcc5/ffff9c244a794800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ad ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784290362.034830:0:26257:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:1.0:1784290362.034839:0:8403:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1784290362.034856:0:75766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244405ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:70736:x1870961896250112:12345-192.168.202.6@tcp:900:mount.lustre.0 Request processed in 55us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290362.034863:0:75766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 10 00002000:00080000:0.0:1784290362.034880:0:26257:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:1.0:1784290362.034885:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784290362.034908:0:26257:0:(import.c:65:import_set_state_nolock()) ffff9c234687f000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1784290362.034916:0:8403:0:(import.c:65:import_set_state_nolock()) ffff9c246dcfe800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290362.034946:0:26257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244405a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2396:x1870961896249856:12345-192.168.202.6@tcp:8:mount.lustre.0 Request processed in 189us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290362.034958:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244405b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2396:x1870961896249984:12345-192.168.202.6@tcp:8:mount.lustre.0 Request processed in 186us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290362.034965:0:26257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4948 00000100:00100000:1.0:1784290362.034977:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4949 00000100:00100000:1.0:1784290362.036010:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290362.036122:0:68995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896250240 00000100:00100000:2.0:1784290362.036130:0:68995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896250240 00000100:00100000:2.0:1784290362.036172:0:68995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 227 00000100:00100000:2.0:1784290362.036181:0:68995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:70736:x1870961896250240:12345-192.168.202.6@tcp:33:mount.lustre.0 00000004:00200000:2.0:1784290362.036244:0:68995:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1784290362.036302:0:68995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444059880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:70736:x1870961896250240:12345-192.168.202.6@tcp:33:mount.lustre.0 Request processed in 121us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290362.036310:0:68995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 227 00010000:00010000:0.0:1784290363.047524:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290363.356464:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290363.356523:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896250368 00000100:00100000:3.0:1784290363.356535:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896250368 00000100:00100000:3.0:1784290363.356617:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1190 00000100:00100000:3.0:1784290363.356647:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:70800:x1870961896250368:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1784290363.356670:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290363.356695:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263a00/0x5953bbf6b30748e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b244e expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.356772:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263800/0x5953bbf6b30748ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.356788:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263800/0x5953bbf6b30748ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.356802:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263800/0x5953bbf6b30748ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290363.356848:0:66008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784290363.356852:0:66008:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784290363.356868:0:66008:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263800/0x5953bbf6b30748ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.356887:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263a00/0x5953bbf6b30748e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b244e expref: 8 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.356902:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263800/0x5953bbf6b30748ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b244e expref: 7 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.356909:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2442ffe200) 00010000:00010000:3.0:1784290363.356911:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784290363.356913:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247c263800, rc 0) 00000100:00100000:3.0:1784290363.356963:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:70800:x1870961896250368:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 322us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290363.356976:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1190 00000100:00100000:1.0:1784290363.359082:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290363.359130:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896250496 00000100:00100000:0.0:1784290363.359135:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896250496 00000100:00100000:0.0:1784290363.359172:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1191 00000100:00100000:0.0:1784290363.359178:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444059180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:70800:x1870961896250496:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:0.0:1784290363.359200:0:74876:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445097472 avail 1298857984 00000100:00100000:0.0:1784290363.359234:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444059180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:70800:x1870961896250496:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 57us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290363.359239:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1191 00000100:00100000:1.0:1784290363.360485:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290363.360534:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896250624 00000100:00100000:0.0:1784290363.360540:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896250624 00000100:00100000:0.0:1784290363.360580:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1194 00000100:00100000:0.0:1784290363.360587:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444058700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:70800:x1870961896250624:12345-192.168.202.6@tcp:13:lfs.0 00000100:00080000:1.0:1784290363.360614:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1784290363.360615:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290363.360653:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444058700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:70800:x1870961896250624:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 66us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290363.360659:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1194 00000100:00100000:1.0:1784290363.361403:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290363.361431:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896250752 00000100:00100000:0.0:1784290363.361437:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896250752 00000100:00080000:1.0:1784290363.361474:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290363.361476:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1195 00000100:00100000:0.0:1784290363.361484:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:70800:x1870961896250752:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:0.0:1784290363.361496:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784290363.361534:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:70800:x1870961896250752:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 49us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290363.361553:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1195 00000100:00100000:3.0:1784290363.698881:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290363.698968:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896250880 00000100:00100000:0.0:1784290363.698978:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896250880 00000100:00100000:0.0:1784290363.699032:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1192 00000100:00100000:0.0:1784290363.699041:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:70834:x1870961896250880:12345-192.168.202.6@tcp:101:cp.0 00010000:00010000:0.0:1784290363.699059:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290363.699076:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b30748f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2455 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699153:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b30748fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699169:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b30748fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699181:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b30748fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699199:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3074902 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699206:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3074902 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699213:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3074902 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699274:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3074909 lrc: 3/1,0 mode: --/PR res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699295:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3074909 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699303:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3074909 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290363.699343:0:65990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3074909 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699391:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b30748fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699410:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b30748fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699417:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b30748fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699424:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290363.699428:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b30748fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699435:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b30748fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699447:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2442ffe200) 00010000:00010000:0.0:1784290363.699450:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290363.699454:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b30748fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699477:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27200/0x5953bbf6b30748fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699501:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3074902 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699508:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3074902 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699515:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3074902 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699520:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290363.699524:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3074902 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699530:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3074902 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699538:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9c2461de5d00) 00010000:00010000:0.0:1784290363.699541:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290363.699544:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3074902 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699550:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3074902 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699631:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b30748f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2455 expref: 9 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699669:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3074909 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2455 expref: 8 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.699683:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2461de5b00) 00010000:00010000:0.0:1784290363.699685:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784290363.699687:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26000, rc 0) 00000100:00100000:0.0:1784290363.699768:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:70834:x1870961896250880:12345-192.168.202.6@tcp:101:cp.0 Request processed in 727us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290363.699776:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1192 00000100:00100000:0.0:1784290363.701119:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290363.701191:0:66000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896251008 00000100:00100000:2.0:1784290363.701197:0:66000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896251008 00000100:00100000:2.0:1784290363.701234:0:66000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:2.0:1784290363.701242:0:66000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2342c35850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:70834:x1870961896251008:12345-192.168.202.6@tcp:900:cp.0 00000100:00100000:2.0:1784290363.701305:0:66000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2342c35850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:70834:x1870961896251008:12345-192.168.202.6@tcp:900:cp.0 Request processed in 61us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290363.701315:0:66000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 11 00000100:00100000:1.0:1784290363.702571:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290363.702639:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896251136 00000100:00100000:3.0:1784290363.702645:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896251136 00000100:00100000:3.0:1784290363.702712:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1193 00000100:00100000:3.0:1784290363.702725:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244405bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:70834:x1870961896251136:12345-192.168.202.6@tcp:101:cp.0 00010000:00010000:3.0:1784290363.702738:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290363.702755:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263a00/0x5953bbf6b3074910 lrc: 2/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b245c expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.702802:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263600/0x5953bbf6b3074917 lrc: 3/1,0 mode: --/PR res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.702813:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263600/0x5953bbf6b3074917 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.702825:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263600/0x5953bbf6b3074917 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290363.702881:0:66004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0x9:0x0]: returning size 4096 00000004:00200000:3.0:1784290363.702884:0:66004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1784290363.702926:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263a00/0x5953bbf6b3074910 lrc: 0/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b245c expref: 8 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.702937:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263600/0x5953bbf6b3074917 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b245c expref: 7 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.702943:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2442ffea00) 00010000:00010000:3.0:1784290363.702951:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1784290363.702953:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247c263600, rc 0) 00000100:00100000:3.0:1784290363.702982:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244405bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:70834:x1870961896251136:12345-192.168.202.6@tcp:101:cp.0 Request processed in 263us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290363.702988:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1193 00000100:00100000:3.0:1784290363.704485:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290363.704552:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896251264 00000100:00100000:2.0:1784290363.704561:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896251264 00000100:00100000:2.0:1784290363.704656:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1194 00000100:00100000:2.0:1784290363.704665:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:70834:x1870961896251264:12345-192.168.202.6@tcp:101:cp.0 00010000:00010000:2.0:1784290363.704673:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290363.704682:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf200/0x5953bbf6b307491e lrc: 2/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2463 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704708:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf400/0x5953bbf6b3074925 lrc: 3/1,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704715:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf400/0x5953bbf6b3074925 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704728:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf400/0x5953bbf6b3074925 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704737:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585be000/0x5953bbf6b307492c lrc: 3/1,0 mode: --/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704742:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585be000/0x5953bbf6b307492c lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704746:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585be000/0x5953bbf6b307492c lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704790:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf800/0x5953bbf6b3074933 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704795:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf800/0x5953bbf6b3074933 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704799:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf800/0x5953bbf6b3074933 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784290363.704816:0:65989:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1784290363.704818:0:65989:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784290363.704830:0:65989:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf800/0x5953bbf6b3074933 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704837:0:65989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf400/0x5953bbf6b3074925 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704842:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf400/0x5953bbf6b3074925 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704855:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf400/0x5953bbf6b3074925 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704859:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf400/0x5953bbf6b3074925 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704863:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585bf400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290363.704876:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf400/0x5953bbf6b3074925 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704880:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf400/0x5953bbf6b3074925 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704886:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2442ffea00) 00010000:00010000:2.0:1784290363.704888:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290363.704890:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf400/0x5953bbf6b3074925 lrc: 3/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704894:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf400/0x5953bbf6b3074925 lrc: 0/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704900:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585be000/0x5953bbf6b307492c lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704904:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585be000/0x5953bbf6b307492c lrc: 2/0,0 mode: PR/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704908:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585be000/0x5953bbf6b307492c lrc: 3/0,0 mode: PR/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704911:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585be000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290363.704917:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585be000/0x5953bbf6b307492c lrc: 3/0,0 mode: PR/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704921:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585be000/0x5953bbf6b307492c lrc: 4/0,0 mode: PR/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704926:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0xf7117594 (ffff9c2449fa5600) 00010000:00010000:2.0:1784290363.704927:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290363.704929:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585be000/0x5953bbf6b307492c lrc: 2/0,0 mode: --/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704933:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585be000/0x5953bbf6b307492c lrc: 0/0,0 mode: --/PR res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704950:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf200/0x5953bbf6b307491e lrc: 0/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2463 expref: 9 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704957:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf800/0x5953bbf6b3074933 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2463 expref: 8 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290363.704962:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c2449fa5100) 00010000:00010000:2.0:1784290363.704964:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784290363.704965:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24585bf800, rc 0) 00000100:00100000:2.0:1784290363.704993:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:70834:x1870961896251264:12345-192.168.202.6@tcp:101:cp.0 Request processed in 330us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290363.704998:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1194 00000100:00100000:1.0:1784290363.706688:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290363.706750:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896251392 00000100:00100000:3.0:1784290363.706758:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896251392 00000100:00100000:3.0:1784290363.706818:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1195 00000100:00100000:3.0:1784290363.706829:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:70834:x1870961896251392:12345-192.168.202.6@tcp:101:cp.0 00010000:00010000:3.0:1784290363.706841:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290363.706869:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263c00/0x5953bbf6b307493a lrc: 2/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b246a expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.706908:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263400/0x5953bbf6b3074941 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.706915:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263400/0x5953bbf6b3074941 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.706921:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263400/0x5953bbf6b3074941 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.706931:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262000/0x5953bbf6b3074948 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.706937:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262000/0x5953bbf6b3074948 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.706941:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262000/0x5953bbf6b3074948 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.706964:0:65988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263400/0x5953bbf6b3074941 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.706969:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263400/0x5953bbf6b3074941 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.706973:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263400/0x5953bbf6b3074941 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.706977:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263400/0x5953bbf6b3074941 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.706981:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c263400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290363.706984:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263400/0x5953bbf6b3074941 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.706988:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263400/0x5953bbf6b3074941 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.706996:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c2449fa5100) 00010000:00010000:3.0:1784290363.706998:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290363.707001:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263400/0x5953bbf6b3074941 lrc: 3/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.707005:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263400/0x5953bbf6b3074941 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.707013:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262000/0x5953bbf6b3074948 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.707017:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262000/0x5953bbf6b3074948 lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.707027:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262000/0x5953bbf6b3074948 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.707032:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c262000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290363.707034:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262000/0x5953bbf6b3074948 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.707038:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262000/0x5953bbf6b3074948 lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.707044:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0xb1bed465 (ffff9c2442ffe100) 00010000:00010000:3.0:1784290363.707046:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290363.707048:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262000/0x5953bbf6b3074948 lrc: 2/0,0 mode: --/PR res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.707052:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c262000/0x5953bbf6b3074948 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.707073:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263c00/0x5953bbf6b307493a lrc: 1/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b246a expref: 9 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.707081:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c2449fa5100) 00010000:00010000:3.0:1784290363.707083:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290363.707086:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263c00/0x5953bbf6b307493a lrc: 0/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b246a expref: 9 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290363.707093:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247c263c00, rc 0) 00000100:00100000:3.0:1784290363.707122:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444059c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:70834:x1870961896251392:12345-192.168.202.6@tcp:101:cp.0 Request processed in 297us (436us total) trans 0 rc 301/301 00000100:00100000:3.0:1784290363.707147:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1195 00000100:00100000:3.0:1784290363.708592:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290363.708668:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896251520 00000100:00100000:0.0:1784290363.708673:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896251520 00000100:00100000:0.0:1784290363.708717:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1196 00000100:00100000:0.0:1784290363.708729:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:70834:x1870961896251520:12345-192.168.202.6@tcp:101:cp.0 00010000:00010000:0.0:1784290363.708739:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290363.708748:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27a00/0x5953bbf6b307494f lrc: 2/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2471 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708776:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27800/0x5953bbf6b3074956 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708784:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27800/0x5953bbf6b3074956 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708790:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27800/0x5953bbf6b3074956 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708798:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27200/0x5953bbf6b307495d lrc: 3/1,0 mode: --/PR res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708804:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27200/0x5953bbf6b307495d lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708814:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27200/0x5953bbf6b307495d lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708830:0:66008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27800/0x5953bbf6b3074956 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708835:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27800/0x5953bbf6b3074956 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708838:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27800/0x5953bbf6b3074956 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708843:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27800/0x5953bbf6b3074956 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708846:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290363.708849:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27800/0x5953bbf6b3074956 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708853:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27800/0x5953bbf6b3074956 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708859:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c2449fa5100) 00010000:00010000:0.0:1784290363.708861:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290363.708863:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27800/0x5953bbf6b3074956 lrc: 3/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708868:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27800/0x5953bbf6b3074956 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708875:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27200/0x5953bbf6b307495d lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708884:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27200/0x5953bbf6b307495d lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708888:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27200/0x5953bbf6b307495d lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708891:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290363.708893:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27200/0x5953bbf6b307495d lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708896:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27200/0x5953bbf6b307495d lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708902:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0xb1bed465 (ffff9c2461de5d00) 00010000:00010000:0.0:1784290363.708903:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290363.708905:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27200/0x5953bbf6b307495d lrc: 2/0,0 mode: --/PR res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708909:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27200/0x5953bbf6b307495d lrc: 0/0,0 mode: --/PR res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708928:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27a00/0x5953bbf6b307494f lrc: 1/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2471 expref: 9 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708934:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c2449fa5100) 00010000:00010000:0.0:1784290363.708936:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290363.708938:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27a00/0x5953bbf6b307494f lrc: 0/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2471 expref: 9 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290363.708952:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27a00, rc 0) 00000100:00100000:0.0:1784290363.708981:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:70834:x1870961896251520:12345-192.168.202.6@tcp:101:cp.0 Request processed in 257us (394us total) trans 0 rc 301/301 00000100:00100000:0.0:1784290363.708986:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1196 00000100:00100000:2.0:1784290363.710654:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290363.710713:0:65997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896251648 00000100:00100000:3.0:1784290363.710721:0:65997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896251648 00000100:00100000:3.0:1784290363.710765:0:65997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 13 00000100:00100000:3.0:1784290363.710776:0:65997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:70834:x1870961896251648:12345-192.168.202.6@tcp:700:cp.0 00000020:02000000:3.0:1784290363.710787:0:65997:0:(tgt_handler.c:884:tgt_request_handle()) *** cfs_fail_loc=123, val=2147483648*** 00000100:00100000:3.0:1784290363.715980:0:65997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:70834:x1870961896251648:12345-192.168.202.6@tcp:700:cp.0 Request processed in 5206us (5326us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784290363.715986:0:65997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 13 00010000:00010000:0.0:1784290364.071525:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290365.095723:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784290365.095744:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d95df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901095040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290365.095806:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290365.095938:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d95e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901095168:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1784290365.095962:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290365.095973:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290365.095995:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901095040 00000100:00100000:3.0:1784290365.096003:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901095040 00000100:00100000:3.0:1784290365.096050:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:3.0:1784290365.096059:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1870961901095040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784290365.096085:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784290365.096107:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901095168 00000100:00100000:2.0:1784290365.096113:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901095168 00000100:00100000:3.0:1784290365.096130:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1870961901095040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290365.096137:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:2.0:1784290365.096145:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3818 00000100:00100000:2.0:1784290365.096153:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1870961901095168:12345-0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1784290365.096158:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00000024:2.0:1784290365.096180:0:8413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1444605952 avail 1298366464 00000100:00100000:3.0:1784290365.096187:0:3617:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968630 gen 2 00000100:00100000:3.0:1784290365.096208:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d95df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901095040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290365.096226:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3619:x1870961901095168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290365.096233:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3818 00000100:00100000:3.0:1784290365.096257:0:3619:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 111669149701 gen 3 00000004:00080000:3.0:1784290365.096262:0:3619:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 111669149701 committed transno 111669149701 00000100:00100000:3.0:1784290365.096312:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d95e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901095168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784290365.096335:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901095296:0@lo:400:kworker.0 00000100:00100000:3.0:1784290365.096364:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1870961901095680:0@lo:400:kworker.0 00000100:00100000:0.0:1784290365.096394:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290365.096418:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290365.096441:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1870961901095808:0@lo:400:kworker.0 00000100:00100000:3.0:1784290365.096450:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961901096192:0@lo:400:kworker.0 00000100:00100000:0.0:1784290365.096470:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290365.096487:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290365.096496:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901096320:0@lo:400:kworker.0 00000100:00100000:3.0:1784290365.096525:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901095680 00000100:00100000:0.0:1784290365.096529:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290365.096531:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901095680 00000100:00100000:3.0:1784290365.096566:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901095808 00000100:00100000:3.0:1784290365.096569:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901095808 00000100:00100000:3.0:1784290365.096604:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901096192 00000100:00100000:3.0:1784290365.096607:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901096192 00000100:00100000:0.0:1784290365.096630:0:90711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901095296 00000100:00100000:3.0:1784290365.096635:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:0.0:1784290365.096647:0:90711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901095296 00000100:00100000:3.0:1784290365.096651:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1870961901095680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290365.096687:0:90711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784290365.096692:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1870961901095680:12345-0@lo:400:kworker.0 Request processed in 41us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290365.096698:0:90711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3620:x1870961901095296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290365.096702:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:3.0:1784290365.096722:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:3.0:1784290365.096730:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1870961901095808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290365.096740:0:90711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3620:x1870961901095296:12345-0@lo:400:kworker.0 Request processed in 43us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290365.096746:0:90711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784290365.096764:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1870961901095808:12345-0@lo:400:kworker.0 Request processed in 36us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290365.096770:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:0.0:1784290365.096779:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1784290365.096788:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1870961901096192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290365.096807:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901095552:0@lo:400:kworker.0 00000100:00100000:0.0:1784290365.096819:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1870961901096192:12345-0@lo:400:kworker.0 Request processed in 32us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290365.096833:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:3.0:1784290365.096839:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290365.096859:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901095552 00000100:00100000:3.0:1784290365.096861:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901096064:0@lo:400:kworker.0 00000100:00100000:0.0:1784290365.096864:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901095552 00000100:00100000:3.0:1784290365.096892:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290365.096900:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1784290365.096909:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901095552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290365.096918:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1870961901096576:0@lo:400:kworker.0 00000100:00100000:0.0:1784290365.096947:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901095552:12345-0@lo:400:kworker.0 Request processed in 40us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290365.096952:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:3.0:1784290365.096964:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290365.096970:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901096320 00000100:00100000:0.0:1784290365.096973:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901096320 00000100:00100000:3.0:1784290365.096997:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901095552:0@lo:400:kworker.0 00000100:00100000:0.0:1784290365.097002:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3819 00000100:00100000:3.0:1784290365.097013:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784290365.097015:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901096320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290365.097022:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1870961901095424:0@lo:400:kworker.0 00000100:00100000:3.0:1784290365.097059:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290365.097070:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901096320:12345-0@lo:400:kworker.0 Request processed in 57us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290365.097077:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901095936:0@lo:400:kworker.0 00000100:00100000:0.0:1784290365.097082:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3819 00000100:00100000:3.0:1784290365.097100:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290365.097117:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901096448:0@lo:400:kworker.0 00000100:00100000:3.0:1784290365.097138:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290365.097176:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901096064 00000100:00100000:3.0:1784290365.097179:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901096064 00000100:00100000:3.0:1784290365.097211:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901095936 00000100:00100000:3.0:1784290365.097214:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901095936 00000100:00100000:3.0:1784290365.097238:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901096448 00000100:00100000:3.0:1784290365.097240:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901096448 00000100:00100000:3.0:1784290365.097261:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1574 00000100:00100000:3.0:1784290365.097268:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901096064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290365.097307:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901096064:12345-0@lo:400:kworker.0 Request processed in 41us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290365.097311:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1574 00000100:00100000:3.0:1784290365.097330:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1575 00000100:00100000:3.0:1784290365.097338:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901095936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290365.097384:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901095936:12345-0@lo:400:kworker.0 Request processed in 50us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290365.097389:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1575 00000100:00100000:3.0:1784290365.097406:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1576 00000100:00100000:3.0:1784290365.097420:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901096448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290365.097439:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901096576 00000100:00100000:0.0:1784290365.097444:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901096576 00000100:00100000:3.0:1784290365.097457:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901096448:12345-0@lo:400:kworker.0 Request processed in 38us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290365.097463:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1576 00000100:00100000:0.0:1784290365.097476:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901095424 00000100:00100000:0.0:1784290365.097479:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901095424 00000100:00100000:0.0:1784290365.097507:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:3.0:1784290365.097514:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:0.0:1784290365.097519:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1870961901096576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290365.097528:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1870961901095424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290365.097559:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1870961901096576:12345-0@lo:400:kworker.0 Request processed in 45us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290365.097565:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:3.0:1784290365.097570:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1870961901095424:12345-0@lo:400:kworker.0 Request processed in 45us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290365.097578:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00080000:3.0:1784290365.097616:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784290365.097617:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d95e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901096832:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784290365.097620:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784290365.097624:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784290365.097628:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784290365.097655:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d95fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901096704:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784290365.097664:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290365.097686:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290365.097717:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1870961901095808:0@lo:400:kworker.0 00000100:00100000:3.0:1784290365.097728:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961901096192:0@lo:400:kworker.0 00000100:00100000:0.0:1784290365.097739:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901096320:0@lo:400:kworker.0 00000100:00100000:3.0:1784290365.097745:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1870961901095680:0@lo:400:kworker.0 00000100:00100000:0.0:1784290365.097762:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901095296:0@lo:400:kworker.0 00000100:00100000:3.0:1784290365.097774:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901096832 00000100:00100000:3.0:1784290365.097778:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901096832 00000100:00100000:3.0:1784290365.097806:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:3.0:1784290365.097813:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901096832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784290365.097828:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290365.097861:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901096832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290365.097866:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:3.0:1784290365.097892:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901096704 00000100:00100000:3.0:1784290365.097895:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901096704 00000100:00100000:3.0:1784290365.097923:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3820 00000100:00100000:3.0:1784290365.097929:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901096704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784290365.097945:0:23867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445097472 avail 1298857984 00000100:00100000:3.0:1784290365.097978:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901096704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290365.097984:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3820 00000100:00100000:3.0:1784290365.098005:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1870961901095424:0@lo:400:kworker.0 00000100:00100000:3.0:1784290365.098011:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901095936:0@lo:400:kworker.0 00000100:00100000:3.0:1784290365.098018:0:3618:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968629 gen 2 00000100:00100000:3.0:1784290365.098026:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901096448:0@lo:400:kworker.0 00000100:00100000:3.0:1784290365.098032:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901096064:0@lo:400:kworker.0 00000100:00100000:3.0:1784290365.098041:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1870961901096576:0@lo:400:kworker.0 00000100:00100000:3.0:1784290365.098067:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d95e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901096832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784290365.098086:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d95fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901096704:0@lo:41:osp-pre-1-0.0 00000020:01000004:3.0:1784290365.351577:0:91721:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1784290365.351671:0:91721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b3074463 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307446a expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.351682:0:91721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b3074463 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307446a expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.351688:0:91721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b3074463 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b307446a expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.351698:0:91721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b3074463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b307446a expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.351714:0:91721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784290365.351718:0:91721:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1784290365.351742:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1784290365.351743:0:91721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784290365.351749:0:91721:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1784290365.351751:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b3074463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b307446a expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784290365.351754:0:91721:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1784290365.351762:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c000 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:0.0:1784290365.351766:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b3074463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b307446a expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290365.351773:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b3074463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b307446a expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784290365.351777:0:91721:0:(import.c:65:import_set_state_nolock()) ffff9c24444ae000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:00010000:0.0:1784290365.351779:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b3074463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b307446a expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290365.351786:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784290365.351789:0:6476:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784290365.351791:0:6476:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784290365.351817:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b3074463 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b307446a expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290365.351822:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784290365.351843:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901096960:0@lo:39:umount.0 00010000:00010000:0.0:1784290365.351917:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b3074463 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b307446a expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290365.351930:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d95f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901097088:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290365.351935:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c234236c000/0x5953bbf6b3074463 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b307446a expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290365.351949:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784290365.351997:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290365.352002:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784290365.352002:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290365.352006:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290365.352022:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901096960 00000100:00100000:2.0:1784290365.352031:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901096960 00000100:00100000:0.0:1784290365.352032:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901097088 00000100:00100000:0.0:1784290365.352037:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901097088 00000100:00100000:0.0:1784290365.352079:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:0.0:1784290365.352087:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3617:x1870961901097088:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290365.352091:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:2.0:1784290365.352103:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1870961901096960:12345-0@lo:39:umount.0 00010000:00010000:0.0:1784290365.352104:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290365.352121:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ef9c00/0x5953bbf6b307446a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074463 expref: 24 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784290365.352128:0:65990:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074582 00010000:00010000:0.0:1784290365.352133:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1784290365.352136:0:65990:0:(import.c:65:import_set_state_nolock()) ffff9c246dcff800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1784290365.352168:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290365.352178:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3617:x1870961901097088:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290365.352184:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00100000:3.0:1784290365.352210:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d95f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901097088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290365.352210:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444059500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3616:x1870961901096960:12345-0@lo:39:umount.0 Request processed in 107us (266us total) trans 0 rc 0/0 00000100:00080000:1.0:1784290365.352219:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c24444ae000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784290365.352224:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000020:00000080:2.0:1784290365.352234:0:65990:0:(genops.c:906:class_export_put()) final put ffff9c246dcfb000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:1.0:1784290365.352236:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901096960:0@lo:39:umount.0 00000100:00080000:0.0:1784290365.352276:0:91721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784290365.352281:0:91721:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000020:00000080:3.0:1784290365.352286:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dcfb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:0.0:1784290365.352287:0:91721:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784290365.352367:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246dcff800 for lustre-MDT0000 00010000:00010000:0.0:1784290365.353343:0:91721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8200/0x5953bbf6b307438a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074391 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290365.353354:0:91721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8200/0x5953bbf6b307438a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074391 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290365.353360:0:91721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8200/0x5953bbf6b307438a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3074391 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290365.353367:0:91721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8200/0x5953bbf6b307438a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3074391 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290365.353417:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290365.353427:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8200/0x5953bbf6b307438a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3074391 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290365.353438:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8200 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:2.0:1784290365.353442:0:19681:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8200/0x5953bbf6b307438a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3074391 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290365.353451:0:19681:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8200/0x5953bbf6b307438a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3074391 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290365.353474:0:19681:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8200/0x5953bbf6b307438a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3074391 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290365.353483:0:19681:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784290365.353487:0:19681:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1784290365.353517:0:19681:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8200/0x5953bbf6b307438a lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074391 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290365.353527:0:19681:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784290365.353549:0:91721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784290365.353558:0:91721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5de00/0x5953bbf6b307448d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074494 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290365.353568:0:91721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5de00/0x5953bbf6b307448d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074494 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290365.353570:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8200/0x5953bbf6b307438a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074391 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290365.353579:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901097216:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290365.353609:0:91721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5de00/0x5953bbf6b307448d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3074494 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290365.353611:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8200/0x5953bbf6b307438a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074391 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290365.353648:0:91721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c2458d5de00/0x5953bbf6b307448d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3074494 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290365.353651:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784290365.353657:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290365.353662:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290365.353665:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c2458d5de00/0x5953bbf6b307448d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3074494 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290365.353669:0:91721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784290365.353671:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5de00 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:2.0:1784290365.353675:0:19681:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c2458d5de00/0x5953bbf6b307448d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3074494 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290365.353681:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901097216 00010000:00010000:0.0:1784290365.353682:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290365.353683:0:19681:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2458d5de00/0x5953bbf6b307448d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3074494 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290365.353687:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901097216 10000000:00010000:2.0:1784290365.353694:0:19681:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2458d5de00/0x5953bbf6b307448d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3074494 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290365.353695:0:91721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246dd26800/0x5953bbf6b3074455 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307445c expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290365.353712:0:91721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246dd26800/0x5953bbf6b3074455 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307445c expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290365.353727:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 10000000:01000000:2.0:1784290365.353735:0:19681:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784290365.353736:0:91721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246dd26800/0x5953bbf6b3074455 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b307445c expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290365.353741:0:19681:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000100:00100000:1.0:1784290365.353744:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3618:x1870961901097216:12345-0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1784290365.353746:0:19681:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1784290365.353755:0:91721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c246dd26800/0x5953bbf6b3074455 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b307445c expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290365.353758:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290365.353765:0:19681:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c2458d5de00/0x5953bbf6b307448d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074494 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290365.353769:0:91721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290365.353772:0:19681:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784290365.353772:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236d600/0x5953bbf6b3074391 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b307438a expref: 23 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.353775:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290365.353784:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c246dd26800/0x5953bbf6b3074455 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b307445c expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290365.353786:0:91721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8400/0x5953bbf6b307437c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074383 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290365.353788:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290365.353793:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c2458d5de00/0x5953bbf6b307448d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074494 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.353806:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26800 already unused, calling callback (ffffffffc14a9c20) 00010000:00010000:0.0:1784290365.353809:0:91721:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8400/0x5953bbf6b307437c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074383 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784290365.353814:0:8418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c246dd26800/0x5953bbf6b3074455 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b307445c expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290365.353815:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2458d5de00/0x5953bbf6b307448d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074494 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290365.353817:0:91721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8400/0x5953bbf6b307437c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3074383 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290365.353825:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:3618:x1870961901097216:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (175us total) trans 0 rc 0/0 00010000:00010000:3.0:1784290365.353866:0:8418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c246dd26800/0x5953bbf6b3074455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b307445c expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290365.353870:0:91721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8400/0x5953bbf6b307437c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3074383 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290365.353871:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290365.353872:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00010000:00010000:2.0:1784290365.353877:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290365.353885:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290365.353921:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901097344:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1784290365.353927:0:8418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c246dd26800/0x5953bbf6b3074455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b307445c expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290365.353935:0:8418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784290365.353938:0:8418:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1784290365.353940:0:91721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784290365.353941:0:8418:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:1.0:1784290365.353946:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901097216:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1784290365.353951:0:91721:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1784290365.353958:0:91721:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:2.0:1784290365.353968:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784290365.353976:0:8418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c246dd26800/0x5953bbf6b3074455 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b307445c expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.353999:0:8418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784290365.354010:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c246dd26800/0x5953bbf6b3074455 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b307445c expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290365.354010:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1784290365.354015:0:10356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901097344 00000100:00100000:2.0:1784290365.354018:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1784290365.354020:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8400/0x5953bbf6b307437c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3074383 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290365.354021:0:10356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901097344 00010000:00010000:3.0:1784290365.354027:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c246dd26800/0x5953bbf6b3074455 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b307445c expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290365.354029:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901097472:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290365.354042:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8400 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:0.0:1784290365.354048:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8400/0x5953bbf6b307437c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3074383 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.354051:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290365.354056:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00010000:00010000:3.0:1784290365.354057:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290365.354062:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290365.354064:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784290365.354066:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8400/0x5953bbf6b307437c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3074383 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290365.354071:0:10356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:3619:x1870961901097344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290365.354084:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:0.0:1784290365.354085:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8400/0x5953bbf6b307437c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3074383 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290365.354087:0:19593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901097472 00000100:00100000:3.0:1784290365.354095:0:19593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901097472 00010000:00010000:1.0:1784290365.354096:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236ce00/0x5953bbf6b3074494 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b307448d expref: 22 pid: 90714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290365.354099:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1784290365.354107:0:6476:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1784290365.354111:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:0.0:1784290365.354118:0:6476:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1784290365.354140:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8400/0x5953bbf6b307437c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074383 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290365.354145:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:1.0:1784290365.354145:0:10356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:3619:x1870961901097344:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (175us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290365.354157:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1784290365.354162:0:19593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:3619:x1870961901097472:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290365.354164:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00010000:00010000:3.0:1784290365.354175:0:19593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1784290365.354179:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901097344:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290365.354180:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8400/0x5953bbf6b307437c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074383 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.354188:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236da00/0x5953bbf6b307445c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074455 expref: 21 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290365.354197:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8400/0x5953bbf6b307437c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074383 expref: -99 pid: 90704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.354200:0:19593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784290365.354200:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d95df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901097600:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290365.354218:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290365.354223:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290365.354227:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290365.354238:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290365.354244:0:19593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:3619:x1870961901097472:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290365.354277:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00100000:2.0:1784290365.354291:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901097472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784290365.354307:0:19593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901097600 00000020:01000004:0.0:1784290365.354312:0:91721:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000100:00100000:3.0:1784290365.354313:0:19593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901097600 00000020:01000000:0.0:1784290365.354322:0:91721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1784290365.354331:0:91721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1784290365.354372:0:91721:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:3.0:1784290365.354393:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1784290365.354406:0:19593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444058e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:3617:x1870961901097600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784290365.354415:0:19593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290365.354428:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd27e00/0x5953bbf6b3074383 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b307437c expref: 20 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.354443:0:19593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784290365.354512:0:19593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444058e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:3617:x1870961901097600:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290365.354522:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:1.0:1784290365.354554:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d95df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901097600:0@lo:103:ldlm_bl.0 00000004:00000080:0.0:1784290365.356220:0:91721:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00100000:1.0:1784290365.357805:0:90705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 711f3c77-e791-4aa8-86ee-bc854fd0bcc5 00000001:00100000:1.0:1784290365.357810:0:90705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000001:00080000:1.0:1784290365.357815:0:90705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149702 is committed 00000020:00000080:1.0:1784290365.357817:0:90705:0:(genops.c:906:class_export_put()) final put ffff9c2343905800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000020:00000080:3.0:1784290365.357929:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343905800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d for lustre-MDT0000 00000020:00000080:0.0:1784290365.357937:0:91721:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/13 00000020:00080000:0.0:1784290365.357948:0:91721:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2458be8800 711f3c77-e791-4aa8-86ee-bc854fd0bcc5 192.168.202.6@tcp 6 (0 0 2) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784290365.357955:0:91721:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c244c90f800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784290365.357960:0:91721:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c246d8ab000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784290365.357966:0:91721:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c246d8ad800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784290365.357971:0:91721:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c2444aa2000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 111669149701 stale:0 00000020:00080000:0.0:1784290365.357976:0:91721:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9c24581b0000) has exports, disconnecting them 00000020:00080000:0.0:1784290365.357997:0:91721:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.6@tcp (ffff9c2458be8800), last request at 1784290363 00000020:00000080:0.0:1784290365.358001:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30748ca 00000020:00000080:3.0:1784290365.358006:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2344980000 for lustre-MDT0000 00000020:00010000:0.0:1784290365.358016:0:91721:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2458be8800: total 0 00000100:00080000:0.0:1784290365.358020:0:91721:0:(import.c:65:import_set_state_nolock()) ffff9c2458bef000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784290365.358037:0:91721:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.6@tcp (ffff9c2458be8800): rc 0 00000020:00080000:0.0:1784290365.358039:0:91721:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c244c90f800), last request at 1784290354 00000020:00000080:0.0:1784290365.358042:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307457b 00000100:00080000:0.0:1784290365.358046:0:91721:0:(import.c:65:import_set_state_nolock()) ffff9c2474f86000 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1784290365.358047:0:7429:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2458be8800: total 0 00000020:00080000:0.0:1784290365.358057:0:91721:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c244c90f800): rc 0 00000020:00000080:0.0:1784290365.358060:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c244c90f800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1784290365.358067:0:91721:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c246d8ab000), last request at 1784290365 00000020:00000080:0.0:1784290365.358069:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074574 00000100:00080000:0.0:1784290365.358072:0:91721:0:(import.c:65:import_set_state_nolock()) ffff9c246d8ac000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1784290365.358081:0:91721:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c246d8ab000): rc 0 00000020:00000080:0.0:1784290365.358084:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c246d8ab000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1784290365.358085:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784290365.358087:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c244c90f800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1784290365.358097:0:7429:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2458be8800, canceled 0 locks, left on hash table 2. 00000020:00080000:0.0:1784290365.358098:0:91721:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c246d8ad800), last request at 1784290365 00010000:00010000:2.0:1784290365.358105:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784290365.358106:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307456d 00000020:00000080:3.0:1784290365.358123:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246d8ab000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1784290365.358125:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b3074909 lrc: 0/0,0 mode: --/PR res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2455 expref: 3 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784290365.358126:0:91721:0:(import.c:65:import_set_state_nolock()) ffff9c246d8aa800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1784290365.358165:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290365.358165:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247c263800/0x5953bbf6b30748ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b244e expref: 2 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784290365.358167:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2474f86000 for lustre-MDT0000 00000020:00000080:3.0:1784290365.358176:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246d8ac000 for lustre-MDT0000 00000020:00080000:0.0:1784290365.358179:0:91721:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c246d8ad800): rc 0 00000020:00000080:0.0:1784290365.358185:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c246d8ad800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:1.0:1784290365.358187:0:7429:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2458be8800, canceled 2 locks, left on hash table 0. 00000020:00080000:0.0:1784290365.358198:0:91721:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c2444aa2000), last request at 1784290349 00000020:00000080:3.0:1784290365.358202:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246d8ad800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1784290365.358204:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30743d7 00000100:00080000:0.0:1784290365.358215:0:91721:0:(import.c:65:import_set_state_nolock()) ffff9c244c90c000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1784290365.358232:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246d8aa800 for lustre-MDT0000 00010000:00010000:0.0:1784290365.358236:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1784290365.358266:0:91721:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2444aa2000): rc 0 00000020:00000080:0.0:1784290365.358271:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c2444aa2000/lustre-MDT0001-mdtlov_UUID 00000004:00000080:0.0:1784290365.358289:0:91721:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae54417d7ae0 00000020:00000080:3.0:1784290365.358295:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2444aa2000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000100:00080000:0.0:1784290365.358313:0:91721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784290365.358319:0:91721:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00000080:3.0:1784290365.358327:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c244c90c000 for lustre-MDT0000 00000100:00080000:0.0:1784290365.364236:0:91721:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1784290365.364263:0:91721:0:(import.c:65:import_set_state_nolock()) ffff9c2344b53800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1784290365.364366:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d95df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901097728:0@lo:39:umount.0 00000100:00100000:2.0:1784290365.364423:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784290365.364462:0:91721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784290365.364467:0:91721:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968629 gen 3 00000004:00080000:0.0:1784290365.364485:0:91721:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784290365.364505:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901097728 00000100:00100000:2.0:1784290365.364512:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901097728 00000100:00100000:2.0:1784290365.364556:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3821 00000100:00100000:2.0:1784290365.364564:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3616:x1870961901097728:12345-0@lo:39:umount.0 00000020:00000080:2.0:1784290365.364613:0:8412:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074416 00000100:00080000:2.0:1784290365.364620:0:8412:0:(import.c:65:import_set_state_nolock()) ffff9c246dce0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784290365.364662:0:8412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378747 00010000:00010000:3.0:1784290365.364670:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290365.364755:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3616:x1870961901097728:12345-0@lo:39:umount.0 Request processed in 192us (337us total) trans 81604378748 rc 0/0 00000100:00100000:2.0:1784290365.364761:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3821 00000100:00080000:3.0:1784290365.364778:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2344b53800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784290365.364785:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d95df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901097728:0@lo:39:umount.0 00000100:00080000:0.0:1784290365.364849:0:91721:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1784290365.364868:0:91721:0:(import.c:65:import_set_state_nolock()) ffff9c247e4b4000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1784290365.364890:0:91721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784290365.364895:0:91721:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968630 gen 3 00000100:00100000:3.0:1784290365.364920:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d95f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901097856:0@lo:9:umount.0 00000004:00080000:0.0:1784290365.364931:0:91721:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784290365.364969:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290365.365018:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901097856 00000100:00100000:2.0:1784290365.365023:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901097856 00000100:00100000:2.0:1784290365.365052:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4950 00000100:00100000:2.0:1784290365.365060:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3616:x1870961901097856:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784290365.365073:0:26258:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307442b 00000100:00080000:2.0:1784290365.365078:0:26258:0:(import.c:65:import_set_state_nolock()) ffff9c23458df800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1784290365.365093:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1784290365.365102:0:26258:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968629 00000100:00100000:2.0:1784290365.365168:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+2:3616:x1870961901097856:12345-0@lo:9:umount.0 Request processed in 110us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290365.365174:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4950 00000100:00080000:3.0:1784290365.365185:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c247e4b4000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1784290365.365194:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1784290365.365196:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784290365.365199:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d95f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901097856:0@lo:9:umount.0 00000100:00080000:0.0:1784290365.365259:0:91721:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1784290365.365270:0:91721:0:(import.c:65:import_set_state_nolock()) ffff9c2458bed800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1784290365.365300:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d95fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901097984:0@lo:9:umount.0 00000020:00080000:0.0:1784290365.365326:0:91721:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c24581b0000) has no exports 00000100:00100000:3.0:1784290365.365366:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290365.365483:0:26254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901097984 00000100:00100000:2.0:1784290365.365490:0:26254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901097984 00000100:00100000:2.0:1784290365.365541:0:26254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4951 00000100:00100000:2.0:1784290365.365555:0:26254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3616:x1870961901097984:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784290365.365574:0:26254:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074440 00000100:00080000:2.0:1784290365.365600:0:26254:0:(import.c:65:import_set_state_nolock()) ffff9c2458117000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784290365.365660:0:26254:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968630 00000020:00080000:0.0:1784290365.365668:0:91721:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c24581b0000) has no exports 00000100:00100000:2.0:1784290365.365754:0:26254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+2:3616:x1870961901097984:12345-0@lo:9:umount.0 Request processed in 203us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290365.365760:0:26254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4951 00000100:00080000:3.0:1784290365.365765:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2458bed800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:2.0:1784290365.365776:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784290365.365782:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1784290365.365786:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784290365.365790:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d95fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901097984:0@lo:9:umount.0 00000020:00000080:1.0:1784290365.438185:0:7429:0:(genops.c:906:class_export_put()) final put ffff9c2458be8800/711f3c77-e791-4aa8-86ee-bc854fd0bcc5 00010000:00010000:1.0:1784290365.438221:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290365.438224:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290365.438227:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784290365.438270:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458be8800/711f3c77-e791-4aa8-86ee-bc854fd0bcc5 for lustre-MDT0000 00000020:00000080:2.0:1784290365.438329:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2458bef000 for lustre-MDT0000 00000020:00000080:0.0:1784290365.450007:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30743ec 00000020:00000080:0.0:1784290365.450022:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c247f8f6000/lustre-QMT0000_UUID 00000020:01000000:0.0:1784290365.450040:0:91721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1784290365.450106:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247f8f6000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1784290365.450128:0:91721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784290365.450139:0:91721:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784290365.450142:0:91721:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9c24581b3380) has no exports 00000020:00000080:2.0:1784290365.450435:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30743e5 00000020:00000080:2.0:1784290365.450441:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c23458df000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784290365.450480:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c23458df000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784290365.450509:0:91721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784290365.450515:0:91721:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784290365.450517:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c23458d9800/lustre-QMT0000_UUID 00000020:00000080:2.0:1784290365.450519:0:91721:0:(genops.c:865:class_export_destroy()) destroying export ffff9c23458d9800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1784290365.450523:0:91721:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1784290365.450692:0:91721:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2345582240 - data ffff9c247577f288/ffff9c2344220800 00000020:01000000:2.0:1784290365.450792:0:91721:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c247f9ac6c0 - data ffff9c2341a21288/ffff9c23439a2800 00000100:00080000:0.0:1784290365.485940:0:91721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1784290365.485949:0:91721:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784290365.485965:0:91721:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c246d95df80 x1870961901097728/t81604378748(81604378748) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290375 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290365.485992:0:91721:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1784290365.487101:0:91721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784290365.487104:0:91721:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968629 gen 4 00000004:00080000:0.0:1784290365.487114:0:91721:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784290365.487116:0:91721:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784290365.487297:0:90722:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784290365.487303:0:90722:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x68:0x0] index 1 count 1 00000040:00080000:3.0:1784290365.487314:0:90722:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 26 count 2 00000100:00080000:0.0:1784290365.487905:0:91721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784290365.487908:0:91721:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968630 gen 4 00000004:00080000:0.0:1784290365.487920:0:91721:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784290365.487921:0:91721:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784290365.488102:0:90724:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784290365.488106:0:90724:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6a:0x0] index 1 count 1 00000040:00080000:3.0:1784290365.488113:0:90724:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 26 count 2 00000020:00000080:0.0:1784290365.488738:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30743a6 00000020:00000080:0.0:1784290365.488746:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c2343832800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784290365.488804:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343832800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784290365.489461:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30743bb 00000020:00000080:0.0:1784290365.489467:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c2469a76800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784290365.489476:0:91721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1784290365.489481:0:91721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784290365.489486:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2469a76800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1784290365.489491:0:91721:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784290365.489497:0:91721:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9c24581b4d40) has no exports 00000004:01000000:0.0:1784290365.489707:0:91721:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1784290365.489715:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074439 00000020:00000080:0.0:1784290365.489721:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c2458bec000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784290365.489732:0:91721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784290365.489735:0:91721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784290365.489748:0:91721:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:3.0:1784290365.489751:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458bec000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00080000:0.0:1784290365.489752:0:91721:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9c2474fd4d40) has no exports 00000020:00000080:0.0:1784290365.489759:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074432 00000020:00000080:0.0:1784290365.489780:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c2343834000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784290365.489795:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343834000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1784290365.490205:0:91721:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784290365.490208:0:91721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784290365.490210:0:91721:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968630 gen 5 00000004:00080000:0.0:1784290365.490214:0:91721:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784290365.490215:0:91721:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784290365.490244:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2458bed800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784290365.490255:0:91721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784290365.490263:0:91721:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784290365.490267:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c247e4b0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784290365.490269:0:91721:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247e4b0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1784290365.490274:0:91721:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784290365.490335:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307441d 00000020:00000080:0.0:1784290365.490362:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c247f8f4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784290365.490374:0:91721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1784290365.490377:0:91721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784290365.490382:0:91721:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784290365.490386:0:91721:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9c2474fd3380) has no exports 00000020:00000080:2.0:1784290365.490388:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247f8f4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784290365.490390:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307440f 00000020:00000080:0.0:1784290365.490401:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c247e4b1000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784290365.490418:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247e4b1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1784290365.490813:0:91721:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1784290365.490816:0:91721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1784290365.490818:0:91721:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968629 gen 5 00000004:00080000:0.0:1784290365.490821:0:91721:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784290365.490822:0:91721:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784290365.490847:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c247e4b4000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784290365.490852:0:91721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784290365.490858:0:91721:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784290365.490861:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c2343835800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784290365.490863:0:91721:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343835800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1784290365.490866:0:91721:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1784290365.490910:0:91721:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1784290365.490915:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074401 00000020:00000080:0.0:1784290365.490918:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c2343836800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1784290365.490927:0:91721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1784290365.490930:0:91721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784290365.490934:0:91721:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1784290365.490937:0:91721:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9c246ff6b380) has no exports 00000020:00000080:2.0:1784290365.490939:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343836800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1784290365.490941:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30743fa 00000020:00000080:0.0:1784290365.490948:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c2344b50800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784290365.490957:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2344b50800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784290365.492402:0:91721:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1784290365.492406:0:91721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784290365.492409:0:91721:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1784290365.492414:0:91721:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784290365.492449:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2344b53800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1784290365.492471:0:91721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784290365.492481:0:91721:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784290365.492485:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c2343830000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784290365.492488:0:91721:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343830000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1784290365.492495:0:91721:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784290365.492671:0:91721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784290365.492677:0:91721:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784290365.492680:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c2343900800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784290365.492682:0:91721:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343900800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1784290365.492685:0:91721:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784290365.492788:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30743c2 00000020:00000080:2.0:1784290365.492791:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c2469a70000/lustre-MDD0000_UUID 00000020:01000000:2.0:1784290365.492802:0:91721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1784290365.492805:0:91721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784290365.492809:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2469a70000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1784290365.492809:0:91721:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784290365.492813:0:91721:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9c24581b19c0) has no exports 00000020:00000080:2.0:1784290365.492837:0:91721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784290365.492841:0:91721:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1784290365.492843:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c2343830800/lustre-MDD0000_UUID 00000020:00000080:2.0:1784290365.492851:0:91721:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343830800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1784290365.492856:0:91721:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1784290365.492885:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30743c9 00000020:00000080:2.0:1784290365.492888:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c2469a70800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784290365.492897:0:91721:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c247036f800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1784290365.492900:0:91721:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c247036f800 3 00000020:00000080:3.0:1784290365.492904:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2469a70800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1784290365.492904:0:91721:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c247036f800 from lustre-MDT0000 00000020:00000080:2.0:1784290365.492928:0:91721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784290365.492932:0:91721:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1784290365.492935:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c2343837800/lustre-MDT0000_UUID 00000020:00000080:2.0:1784290365.492936:0:91721:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343837800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1784290365.492943:0:91721:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1784290365.492999:0:91721:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1784290365.493002:0:91721:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1784290365.493005:0:91721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1784290365.493007:0:91721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784290365.493009:0:91721:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1784290365.493021:0:91721:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c245fd7f800 fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f 192.168.202.6@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784290365.493026:0:91721:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c246ff1b800 2e54cd1c-9dbd-4e31-b60e-998135d46053 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784290365.493031:0:91721:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff9c247d26b380) has exports, disconnecting them 00000020:00080000:2.0:1784290365.493035:0:91721:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.6@tcp (ffff9c245fd7f800), last request at 1784290362 00000020:00000080:2.0:1784290365.493055:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30748a7 00000020:00010000:2.0:1784290365.493059:0:91721:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c245fd7f800: total 0 00000100:00080000:2.0:1784290365.493062:0:91721:0:(import.c:65:import_set_state_nolock()) ffff9c2474f80000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784290365.493075:0:91721:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.6@tcp (ffff9c245fd7f800): rc 0 00000020:00080000:2.0:1784290365.493079:0:91721:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c246ff1b800), last request at 1784290349 00000020:00010000:3.0:1784290365.493081:0:6476:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c245fd7f800: total 0 00000020:00000080:2.0:1784290365.493087:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074367 00000020:00010000:2.0:1784290365.493092:0:91721:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c246ff1b800: total 0 00000100:00080000:2.0:1784290365.493094:0:91721:0:(import.c:65:import_set_state_nolock()) ffff9c246ff1f000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784290365.493111:0:91721:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c246ff1b800): rc 0 00000020:00080000:2.0:1784290365.493114:0:91721:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9c247d26b380) has no exports 00010000:00010000:3.0:1784290365.493150:0:6476:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c245fd7f800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1784290365.493186:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c24585bfc00/0x5953bbf6b30748b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b23e5 expref: 5 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.493204:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247c262800/0x5953bbf6b30748bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2416 expref: 4 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290365.493218:0:90712:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c2444e7a800:90712] 2 exiting: rc = 0 00000100:00100000:1.0:1784290365.493226:0:90710:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c24803b4a00:90710] 0 exiting: rc = 1 00010000:00010000:3.0:1784290365.493228:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247c263200/0x5953bbf6b30748ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b23de expref: 3 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.493251:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c24585be800/0x5953bbf6b30748c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b241d expref: 2 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.493262:0:6476:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c245fd7f800, canceled 4 locks, left on hash table 0. 00000020:00000080:3.0:1784290365.493291:0:6476:0:(genops.c:906:class_export_put()) final put ffff9c245fd7f800/fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f 00000020:00010000:3.0:1784290365.493302:0:6476:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c246ff1b800: total 1 00010000:00010000:3.0:1784290365.493329:0:6476:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c246ff1b800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1784290365.493337:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290365.493345:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2458d5d600/0x5953bbf6b307453c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074535 expref: 14 pid: 90714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784290365.493368:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c245fd7f800/fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f for MGS 00010000:00010000:3.0:1784290365.493387:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2458d5d200/0x5953bbf6b30744cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30744c5 expref: 13 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784290365.493405:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2474f80000 for MGS 00010000:00010000:3.0:1784290365.493415:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2458d5d800/0x5953bbf6b307454a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074543 expref: 12 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.493428:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2458d5ca00/0x5953bbf6b30744da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30744d3 expref: 11 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.493453:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ef8800/0x5953bbf6b30744f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30744ef expref: 10 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.493465:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ef9800/0x5953bbf6b30744e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30744e1 expref: 9 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.493481:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236d400/0x5953bbf6b30744a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b307449b expref: 8 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290365.493482:0:90711:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c247c12b000:90711] 1 exiting: rc = 0 00010000:00010000:3.0:1784290365.493507:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236d800/0x5953bbf6b3074504 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30744fd expref: 7 pid: 90714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.493523:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2458d5d000/0x5953bbf6b3074512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b307450b expref: 6 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.493537:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2458d5cc00/0x5953bbf6b3074520 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074519 expref: 5 pid: 90711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.493558:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236cc00/0x5953bbf6b30744b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30744a9 expref: 4 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.493595:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ef8600/0x5953bbf6b307452e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074527 expref: 3 pid: 90710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290365.493610:0:90714:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9c2444792200:90714] 3 exiting: rc = 0 00010000:00010000:3.0:1784290365.493628:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236d000/0x5953bbf6b30744be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b30744b7 expref: 2 pid: 90712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290365.493649:0:6476:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c246ff1b800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1784290365.493679:0:6476:0:(genops.c:906:class_export_put()) final put ffff9c246ff1b800/2e54cd1c-9dbd-4e31-b60e-998135d46053 00010000:00010000:3.0:1784290365.493693:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290365.493701:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290365.493703:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784290365.493716:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246ff1b800/2e54cd1c-9dbd-4e31-b60e-998135d46053 for MGS 00000100:00100000:2.0:1784290365.493724:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493732:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493744:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1784290365.493749:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246ff1f000 for MGS 00000100:00100000:2.0:1784290365.493773:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493784:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493808:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493814:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493820:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493826:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493832:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493838:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493847:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493854:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493860:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493870:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493876:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493882:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493887:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493893:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493899:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493907:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493916:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493923:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493933:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493942:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493948:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493953:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493959:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493965:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493971:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493974:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493979:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.493988:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494003:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494015:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494025:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494037:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494056:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494066:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494074:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494095:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494103:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494114:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494122:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494129:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494135:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494141:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494148:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494155:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494159:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494163:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494167:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494171:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494176:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494181:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494186:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494191:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494196:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494202:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494207:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494212:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494217:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494222:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784290365.494229:0:91721:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1784290365.495130:0:91721:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2345dd74e0 - data ffff9c247092d948/ffff9c246dde3000 00000020:01000000:2.0:1784290365.495302:0:91721:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c2345dd7ba0 - data ffff9c2470979510/ffff9c247c1a0000 00000020:00000080:2.0:1784290365.495791:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074360 00000020:00000080:2.0:1784290365.495796:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c246ff1d800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784290365.495806:0:91721:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c247036f800 from MGS, refs=2 00000020:01000004:2.0:1784290365.495809:0:91721:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c247036f800 2 00000020:01000004:2.0:1784290365.495811:0:91721:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c247036f800 from MGS 00000020:00000080:3.0:1784290365.495826:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246ff1d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784290365.495828:0:91721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784290365.495834:0:91721:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1784290365.495837:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c2458116800/MGS 00000020:00000080:2.0:1784290365.495845:0:91721:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458116800/MGS for MGS 00000020:01000000:2.0:1784290365.495850:0:91721:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1784290365.495893:0:91721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1784290365.495896:0:91721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784290365.495901:0:91721:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784290365.495905:0:91721:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c24444ad000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784290365.495909:0:91721:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9c246ff68000) has exports, disconnecting them 00000020:00080000:2.0:1784290365.495913:0:91721:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c24444ad000), last request at 1784290349 00000020:00000080:2.0:1784290365.495917:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074478 00000020:00080000:2.0:1784290365.495927:0:91721:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c24444ad000): rc 0 00000020:00000080:2.0:1784290365.495930:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c24444ad000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1784290365.495958:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c24444ad000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1784290365.497367:0:91721:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1784290365.497371:0:91721:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784290365.497373:0:91721:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784290365.497377:0:91721:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784290365.497407:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c24444ae000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1784290365.497510:0:91721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784290365.497523:0:91721:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1784290365.497526:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c24580d8000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1784290365.497529:0:91721:0:(genops.c:865:class_export_destroy()) destroying export ffff9c24580d8000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1784290365.497534:0:91721:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1784290365.497592:0:91721:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c247036f800 1 00000020:00000080:3.0:1784290365.497596:0:91721:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074352 00000020:00000080:3.0:1784290365.497599:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c2458111800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1784290365.497607:0:91721:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1784290365.497610:0:91721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784290365.497614:0:91721:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00000080:0.0:1784290365.497615:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458111800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:3.0:1784290365.497617:0:91721:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9c247d2699c0) has no exports 00000020:00000080:3.0:1784290365.515365:0:91721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784290365.515371:0:91721:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1784290365.515390:0:91721:0:(genops.c:906:class_export_put()) final put ffff9c2470368000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784290365.515393:0:91721:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2470368000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1784290365.515426:0:91721:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1784290365.515600:0:91721:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c247036c800 00000020:02000400:3.0:1784290365.515661:0:91721:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1784290365.607534:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d95df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901098112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290365.607548:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901098240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784290365.607633:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290365.607674:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901098112 00000100:00100000:1.0:1784290365.607693:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901098112 00000100:00100000:0.0:1784290365.607730:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290365.607747:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901098240 00000100:00100000:1.0:1784290365.607759:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901098240 00000100:00100000:0.0:1784290365.607783:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:1.0:1784290365.607791:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:0.0:1784290365.607797:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901098112:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290365.607807:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901098240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784290365.607822:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1784290365.607823:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784290365.607875:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901098112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290365.607885:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901098240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290365.607893:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:1.0:1784290365.607899:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:1.0:1784290365.607955:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901098240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784290365.607956:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d95df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901098112:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784290366.119479:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290367.143555:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1784290367.493495:0:3611:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.6@tcp portal 26 match 1870961896251776 offset 0 length 224: 4 00000100:00100000:2.0:1784290367.493530:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290367.493554:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290367.493595:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896251904 00000100:00100000:2.0:1784290367.493598:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290367.493606:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896251904 00000100:00100000:0.0:1784290367.493616:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896252032 00000100:00100000:0.0:1784290367.493625:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896252032 00000100:00100000:2.0:1784290367.493627:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290367.493651:0:8999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896252160 00000100:00100000:1.0:1784290367.493659:0:8999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896252160 00000100:00100000:2.0:1784290367.493660:0:26261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896252288 00000100:00100000:2.0:1784290367.493666:0:26261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896252288 00000100:00100000:3.0:1784290367.493684:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 707 00000100:00100000:0.0:1784290367.493695:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1198 00000100:00100000:3.0:1784290367.493702:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:2398:x1870961896252032:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290367.493704:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870961896251904:12345-192.168.202.6@tcp:400:kworker.0 00000020:00080000:0.0:1784290367.493718:0:65989:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.6@tcp 00000100:00100000:1.0:1784290367.493728:0:8999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1577 00000100:00100000:2.0:1784290367.493736:0:26261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1578 00000100:00100000:1.0:1784290367.493744:0:8999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2397:x1870961896252160:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290367.493749:0:26261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2398:x1870961896252288:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290367.493781:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:2398:x1870961896252032:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 84us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290367.493782:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1870961896251904:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 76us (247us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784290367.493792:0:26261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2398:x1870961896252288:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 44us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290367.493797:0:8999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2397:x1870961896252160:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 57us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290367.493803:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 707 00000100:00100000:2.0:1784290367.493810:0:26261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1578 00000100:00100000:0.0:1784290367.493815:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1198 00000100:00100000:1.0:1784290367.493822:0:8999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1577 00000100:00080000:3.0:1784290367.493843:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784290367.493848:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784290367.493850:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784290367.494729:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290367.494770:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896252416 00000100:00100000:3.0:1784290367.494775:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896252416 00000100:00100000:3.0:1784290367.494798:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1199 00000100:00100000:3.0:1784290367.494802:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1870961896252416:12345-192.168.202.6@tcp:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1784290367.494820:0:66008:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784290367.494846:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1870961896252416:12345-192.168.202.6@tcp:38:ptlrpcd_00_00.0 Request processed in 44us (119us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784290367.494852:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1199 00000001:00100000:3.0:1784290367.657043:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1784290367.657044:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784290367.657055:0:9482:0:(genops.c:906:class_export_put()) final put ffff9c244a791000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784290367.657073:0:8397:0:(genops.c:906:class_export_put()) final put ffff9c23458dd800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1784290367.657093:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 711f3c77-e791-4aa8-86ee-bc854fd0bcc5 00000020:00000080:1.0:1784290367.657103:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c244a791000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000001:00100000:0.0:1784290367.657106:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 711f3c77-e791-4aa8-86ee-bc854fd0bcc5 00000001:00100000:0.0:1784290367.657120:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000020:00000080:0.0:1784290367.657124:0:8397:0:(genops.c:906:class_export_put()) final put ffff9c247f8f5800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000001:00100000:3.0:1784290367.657131:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000020:00000080:3.0:1784290367.657138:0:9482:0:(genops.c:906:class_export_put()) final put ffff9c247d3d7800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000020:00000080:1.0:1784290367.657207:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c23458dd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1784290367.657233:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247f8f5800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d for lustre-OST0000 00000020:00000080:1.0:1784290367.657259:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247d3d7800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d for lustre-OST0001 00000020:00000080:1.0:1784290367.657301:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2458117000 for lustre-OST0001 00000020:00000080:1.0:1784290367.657306:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c23458df800 for lustre-OST0000 00000020:00000080:1.0:1784290367.657311:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c247d3d1800 for lustre-OST0000 00000020:00000080:1.0:1784290367.657315:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2475c2b000 for lustre-OST0001 00000001:00100000:1.0:1784290367.657774:0:75386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1784290367.657804:0:75386:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378748 is committed 00000020:00000080:1.0:1784290367.657808:0:75386:0:(genops.c:906:class_export_put()) final put ffff9c246dce2800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1784290367.657838:0:75386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 711f3c77-e791-4aa8-86ee-bc854fd0bcc5 00000001:00100000:1.0:1784290367.657843:0:75386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000001:00080000:1.0:1784290367.657848:0:75386:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378747 is committed 00000020:00000080:1.0:1784290367.657857:0:75386:0:(genops.c:906:class_export_put()) final put ffff9c247e403800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d 00000020:00080000:1.0:1784290367.657864:0:75386:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9c2474e78300 refcount 2 committed 0 result 0 batchid 77309411372 00000020:00080000:1.0:1784290367.657869:0:75386:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9c2343b0f900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9c2474e78840 00000020:00080000:1.0:1784290367.657873:0:75386:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x20000c751:0x1:0x0].1 00000020:00080000:1.0:1784290367.657877:0:75386:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9c2343b0f500 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c2345e0c200 00000020:00080000:1.0:1784290367.657880:0:75386:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400090a4:0x1:0x0].1 00000020:00000080:3.0:1784290367.657933:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dce2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00080000:2.0:1784290367.657993:0:75406:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411372 committed batchid 73014444037 00000020:00000080:3.0:1784290367.658022:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247e403800/bd808cf4-dd54-45f0-9b2b-1434e8330e5d for lustre-MDT0001 00000020:00000080:3.0:1784290367.658077:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246dce0800 for lustre-MDT0001 00000020:00000080:3.0:1784290367.658095:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c23417db000 for lustre-MDT0001 00000020:00080000:2.0:1784290367.658113:0:75406:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 73014444037 00010000:00010000:1.0:1784290368.167648:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290369.191670:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290370.215525:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901098368:0@lo:400:kworker.0 00000100:00100000:0.0:1784290370.215577:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901098624:0@lo:400:kworker.0 00000400:00000100:2.0:1784290370.215594:0:3620:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870961901098368 offset 0 length 224: 4 00010000:00010000:3.0:1784290370.215618:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290370.215627:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c244405b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1870961901098752:0@lo:400:kworker.0 00000100:00100000:2.0:1784290370.215644:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c244405b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1870961901098880:0@lo:400:kworker.0 00000100:00100000:3.0:1784290370.215655:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c244405aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1870961901098496:0@lo:400:kworker.0 00000100:00100000:0.0:1784290370.215667:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290370.215706:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290370.215712:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901099136:0@lo:400:kworker.0 00000100:00100000:3.0:1784290370.215739:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901098624 00000100:00100000:1.0:1784290370.215747:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901098880 00000100:00100000:3.0:1784290370.215749:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901098624 00000100:00100000:2.0:1784290370.215751:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901099392:0@lo:400:kworker.0 00000100:00100000:1.0:1784290370.215753:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901098880 00000100:00100000:0.0:1784290370.215789:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290370.215793:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290370.215822:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:1.0:1784290370.215836:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1870961901098880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290370.215843:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:2.0:1784290370.215850:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290370.215860:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901098624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290370.215861:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901098752 00000100:00100000:0.0:1784290370.215867:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901098752 00000100:00100000:2.0:1784290370.215880:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c244405ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901099264:0@lo:400:kworker.0 00000100:00100000:0.0:1784290370.215898:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:1.0:1784290370.215903:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1870961901098880:12345-0@lo:400:kworker.0 Request processed in 70us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290370.215910:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1870961901098752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290370.215916:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000020:00080000:0.0:1784290370.215920:0:65989:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784290370.215926:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290370.215938:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901098624:12345-0@lo:400:kworker.0 Request processed in 82us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290370.215950:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:0.0:1784290370.215963:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3619:x1870961901098752:12345-0@lo:400:kworker.0 Request processed in 55us (115us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784290370.215978:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901098624:0@lo:400:kworker.0 00000100:00100000:3.0:1784290370.215988:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901099136 00000100:00080000:2.0:1784290370.215992:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1784290370.215996:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901099136 00000100:00080000:2.0:1784290370.215997:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:0.0:1784290370.216002:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:02000400:2.0:1784290370.216006:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784290370.216011:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290370.216016:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2096 00000100:00100000:1.0:1784290370.216022:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901099392 00000100:00080000:2.0:1784290370.216023:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290370.216028:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901099392 00000100:00100000:3.0:1784290370.216038:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3822 00000100:00100000:3.0:1784290370.216046:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3618:x1870961901099136:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784290370.216055:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:3.0:1784290370.216056:0:23867:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784290370.216056:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2474e8ea00 x1870961901099648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784290370.216063:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784290370.216064:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901099264 00000100:00100000:1.0:1784290370.216069:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901099264 00000100:00100000:2.0:1784290370.216088:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c244405b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1870961901098752:0@lo:400:kworker.0 00000100:00100000:1.0:1784290370.216112:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1579 00000100:00100000:3.0:1784290370.216115:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468892300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3618:x1870961901099136:12345-0@lo:400:kworker.0 Request processed in 67us (327us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784290370.216119:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901099648:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1784290370.216123:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901099392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290370.216130:0:26259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1580 00000100:00100000:3.0:1784290370.216136:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3822 00000100:00100000:0.0:1784290370.216144:0:26259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901099264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290370.216161:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290370.216176:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901099392:12345-0@lo:400:kworker.0 Request processed in 54us (386us total) trans 0 rc 0/0 00000100:00080000:3.0:1784290370.216194:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1784290370.216195:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1579 00000100:00080000:3.0:1784290370.216203:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1784290370.216212:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1784290370.216212:0:26259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901099264:12345-0@lo:400:kworker.0 Request processed in 68us (287us total) trans 0 rc 0/0 00000100:00080000:3.0:1784290370.216222:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784290370.216223:0:26259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1580 00000100:00080000:3.0:1784290370.216232:0:3618:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2096 00000100:00100000:2.0:1784290370.216235:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c244405b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1870961901098880:0@lo:400:kworker.0 00000100:00100000:1.0:1784290370.216240:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901099648 00000100:00080000:3.0:1784290370.216243:0:3618:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290370.216245:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901099648 00000100:00100000:2.0:1784290370.216250:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901099392:0@lo:400:kworker.0 00000100:00100000:3.0:1784290370.216269:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c24483cc700 x1870961901099776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290370.216274:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c244405ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901099264:0@lo:400:kworker.0 00000100:00100000:1.0:1784290370.216279:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:1.0:1784290370.216290:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901099648:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1784290370.216312:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784290370.216313:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:1.0:1784290370.216319:0:65990:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784290370.216325:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901099136:0@lo:400:kworker.0 00000100:00100000:0.0:1784290370.216335:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901099776:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1784290370.216376:0:3617:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9c246d95df80 x1870961901099008/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290370.216389:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901098496 00000100:00100000:1.0:1784290370.216390:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901099648:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 98us (228us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290370.216391:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1870961901099520:0@lo:400:kworker.0 00000100:00100000:3.0:1784290370.216398:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901098496 00000100:00100000:0.0:1784290370.216400:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290370.216409:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:1.0:1784290370.216428:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:1.0:1784290370.216434:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1870961901098496:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784290370.216439:0:65990:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:0.0:1784290370.216444:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1784290370.216448:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901099776 00000100:00100000:2.0:1784290370.216448:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784290370.216453:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784290370.216456:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901099776 00000100:00100000:0.0:1784290370.216463:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901099648:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1784290370.216479:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1870961901098496:12345-0@lo:400:kworker.0 Request processed in 44us (166us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784290370.216487:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:3.0:1784290370.216493:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3823 00000100:00080000:2.0:1784290370.216495:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784290370.216501:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:0.0:1784290370.216503:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901099520 00000100:02000400:2.0:1784290370.216506:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1784290370.216507:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901099776:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1784290370.216511:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784290370.216511:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901099520 00000100:00080000:2.0:1784290370.216520:0:3617:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2096 00000100:00080000:2.0:1784290370.216524:0:3617:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00010000:00020000:3.0:1784290370.216553:0:22091:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290370.216565:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:0.0:1784290370.216621:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1870961901099520:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1784290370.216628:0:66008:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784290370.216691:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901099776:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 181us (290us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290370.216700:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1870961901099520:12345-0@lo:400:kworker.0 Request processed in 77us (253us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784290370.216701:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2474e8ea00 x1870961901099904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784290370.216708:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3823 00000100:00100000:0.0:1784290370.216716:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:2.0:1784290370.216729:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c244405aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1870961901098496:0@lo:400:kworker.0 00000100:00080000:1.0:1784290370.216732:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784290370.216738:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784290370.216743:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901099776:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1784290370.216752:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784290370.216756:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784290370.216760:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784290370.216763:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1784290370.216765:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901099904:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1784290370.216769:0:3617:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2096 00000100:00080000:2.0:1784290370.216773:0:3617:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290370.216788:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a543b80 x1870961901100032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290370.216800:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1870961901099520:0@lo:400:kworker.0 00000100:00100000:1.0:1784290370.216800:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290370.216827:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901100032:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1784290370.216845:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290370.216856:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901099904 00000100:00100000:3.0:1784290370.216863:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901099904 00000100:00100000:2.0:1784290370.216881:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901100032 00000100:00100000:3.0:1784290370.216892:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:3.0:1784290370.216900:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1870961901099904:12345-0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1784290370.216908:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901100032 00010000:00020000:3.0:1784290370.216918:0:65988:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784290370.216936:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:2.0:1784290370.216942:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901100032:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1784290370.216952:0:65990:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784290370.216969:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1870961901099904:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 67us (169us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784290370.216979:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1784290370.216984:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901100032:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 40us (135us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290370.216991:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00080000:0.0:1784290370.217011:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290370.217018:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290370.217029:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901100032:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1784290370.217042:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290370.217044:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290370.217046:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901099904:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1784290370.727634:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901100160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290370.727662:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784290370.727698:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901100288:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784290370.727718:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290370.727760:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290370.727843:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901100160 00000100:00100000:0.0:1784290370.727844:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901100288 00000100:00100000:0.0:1784290370.727856:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901100288 00000100:00100000:1.0:1784290370.727857:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901100160 00000100:00100000:1.0:1784290370.727923:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:0.0:1784290370.727950:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:1.0:1784290370.727958:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901100160:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784290370.727970:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901100288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784290370.727997:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1784290370.727998:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784290370.728099:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901100288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290370.728100:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901100160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290370.728128:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:0.0:1784290370.728140:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:2.0:1784290370.728144:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901100288:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784290370.728150:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901100160:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784290371.239654:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290372.263636:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1784290372.613727:0:3611:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.6@tcp portal 26 match 1870961896252544 offset 0 length 224: 4 00000100:00100000:2.0:1784290372.613789:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290372.613836:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290372.613880:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896252928 00000100:00100000:2.0:1784290372.613889:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290372.613902:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896252928 00000100:00100000:2.0:1784290372.613941:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290372.613970:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896252672 00000100:00100000:0.0:1784290372.613976:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896252800 00000100:00100000:0.0:1784290372.613987:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896252800 00000100:00100000:1.0:1784290372.613994:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896253056 00000100:00100000:3.0:1784290372.613995:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896252672 00000100:00100000:1.0:1784290372.614002:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896253056 00000100:00100000:2.0:1784290372.614022:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1581 00000100:00100000:2.0:1784290372.614049:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2397:x1870961896252928:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290372.614060:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 710 00000100:00100000:1.0:1784290372.614073:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1582 00000100:00100000:0.0:1784290372.614082:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1206 00000100:00100000:3.0:1784290372.614086:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2398:x1870961896252800:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290372.614102:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1870961896252672:12345-192.168.202.6@tcp:38:kworker.0 00000100:00100000:1.0:1784290372.614104:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2398:x1870961896253056:12345-192.168.202.6@tcp:400:kworker.0 00010000:00020000:0.0:1784290372.614131:0:66008:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784290372.614141:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a541180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2397:x1870961896252928:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 104us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290372.614151:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1581 00000100:00100000:3.0:1784290372.614166:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2398:x1870961896252800:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 89us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290372.614188:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 710 00000100:00100000:1.0:1784290372.614189:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2398:x1870961896253056:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 92us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290372.614190:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1870961896252672:12345-192.168.202.6@tcp:38:kworker.0 Request processed in 92us (350us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290372.614212:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1206 00000100:00100000:1.0:1784290372.614221:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1582 00000100:00080000:0.0:1784290372.614248:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784290372.614255:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784290372.614258:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784290373.287601:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784290373.801217:0:75386:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411372 batchid updated 00000020:00080000:2.0:1784290373.801294:0:75406:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411372 00000100:00080000:2.0:1784290373.801456:0:75406:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9c246a541880 x1870961901100416/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'dist_txn-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290373.801490:0:75406:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dab4240 going to sleep for 0 seconds 00010000:00010000:2.0:1784290374.311593:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290374.823478:0:75406:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dab4240 going to sleep for 0 seconds 00010000:00010000:3.0:1784290375.335469:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784290375.335518:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290375.335523:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290375.335543:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290375.335550:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2111 00000100:00080000:2.0:1784290375.335556:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784290375.335562:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290375.335572:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901100544:0@lo:400:kworker.0 00000100:00100000:2.0:1784290375.335583:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a540700 x1870961901100672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784290375.335619:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290375.335624:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000400:00000100:1.0:1784290375.335625:0:3620:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870961901100544 offset 0 length 224: 4 00000100:00080000:2.0:1784290375.335627:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784290375.335632:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901100672:0@lo:38:kworker.0 00000100:00080000:2.0:1784290375.335635:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2111 00000100:00080000:2.0:1784290375.335642:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784290375.335646:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290375.335651:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901100800:0@lo:400:kworker.0 00000100:00100000:2.0:1784290375.335664:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a540a80 x1870961901100928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290375.335686:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784290375.335692:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290375.335697:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1784290375.335700:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1870961901101056:0@lo:400:kworker.0 00000100:00080000:2.0:1784290375.335701:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290375.335712:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2111 00000100:00080000:2.0:1784290375.335717:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784290375.335732:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290375.335752:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a543100 x1870961901101184/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784290375.335791:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901100672 00000100:00100000:0.0:1784290375.335797:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901100928:0@lo:38:kworker.0 00000100:00100000:1.0:1784290375.335798:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290375.335801:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901100672 00000100:00080000:2.0:1784290375.335810:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290375.335816:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290375.335819:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290375.335824:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2111 00000100:00080000:2.0:1784290375.335828:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784290375.335835:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290375.335836:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290375.335840:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901101056 00000100:00100000:3.0:1784290375.335844:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901101056 00000100:00100000:1.0:1784290375.335851:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901100928 00000100:00100000:1.0:1784290375.335858:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901100928 00000100:00100000:2.0:1784290375.335859:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a543b80 x1870961901101568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290375.335864:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901101184:0@lo:38:kworker.0 00000100:00100000:3.0:1784290375.335889:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1784290375.335899:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290375.335906:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1870961901101056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290375.335906:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901101440:0@lo:400:kworker.0 00000100:00100000:1.0:1784290375.335906:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:1.0:1784290375.335919:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901100672:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290375.335923:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901101568:0@lo:38:kworker.0 00010000:00020000:1.0:1784290375.335939:0:65990:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290375.335965:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290375.335971:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290375.335996:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901100672:12345-0@lo:38:kworker.0 Request processed in 79us (311us total) trans 0 rc -19/-19 00000100:00080000:0.0:1784290375.336009:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1784290375.336011:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1870961901101056:12345-0@lo:400:kworker.0 Request processed in 112us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290375.336015:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00080000:0.0:1784290375.336017:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784290375.336024:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784290375.336025:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901100672:0@lo:38:kworker.0 00000100:00100000:3.0:1784290375.336029:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:1.0:1784290375.336036:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901101568 00000100:00100000:2.0:1784290375.336042:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901101312:0@lo:400:kworker.0 00000100:00100000:1.0:1784290375.336042:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901101568 00000100:00100000:3.0:1784290375.336054:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1784290375.336060:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1870961901100928:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1784290375.336065:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00020000:3.0:1784290375.336072:0:65988:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784290375.336081:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:2.0:1784290375.336087:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290375.336091:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901101568:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1784290375.336102:0:65990:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290375.336119:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901101184 00000100:00100000:3.0:1784290375.336120:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1870961901100928:12345-0@lo:38:kworker.0 Request processed in 56us (283us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290375.336125:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901101184 00000100:00100000:3.0:1784290375.336130:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:1.0:1784290375.336152:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901101568:12345-0@lo:38:kworker.0 Request processed in 60us (189us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290375.336163:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901101440 00000100:00100000:1.0:1784290375.336164:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:3.0:1784290375.336167:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901101312 00000100:00100000:0.0:1784290375.336170:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3824 00000100:00100000:2.0:1784290375.336172:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901101440 00000100:00100000:3.0:1784290375.336174:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901101312 00000100:00100000:0.0:1784290375.336178:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901101184:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1784290375.336189:0:23867:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290375.336223:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901101184:12345-0@lo:38:kworker.0 Request processed in 45us (327us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784290375.336231:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1583 00000100:00100000:0.0:1784290375.336232:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3824 00000100:00100000:3.0:1784290375.336246:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901101312:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784290375.336249:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784290375.336255:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00080000:0.0:1784290375.336257:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290375.336260:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901101568:0@lo:38:kworker.0 00000100:00080000:0.0:1784290375.336263:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784290375.336268:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1584 00000100:00080000:1.0:1784290375.336279:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1784290375.336285:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901101440:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784290375.336288:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784290375.336300:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901101312:12345-0@lo:400:kworker.0 Request processed in 55us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290375.336300:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a540a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901100928:0@lo:38:kworker.0 00000100:00100000:0.0:1784290375.336301:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290375.336314:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1583 00000100:00080000:1.0:1784290375.336330:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784290375.336335:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784290375.336361:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901101184:0@lo:38:kworker.0 00000100:00100000:0.0:1784290375.336383:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901100800 00000100:00100000:0.0:1784290375.336387:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901100800 00000100:00100000:2.0:1784290375.336400:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901101440:12345-0@lo:400:kworker.0 Request processed in 119us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290375.336405:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901101312:0@lo:400:kworker.0 00000100:00100000:2.0:1784290375.336417:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1584 00000100:00100000:1.0:1784290375.336422:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1870961901101056:0@lo:400:kworker.0 00000100:00100000:0.0:1784290375.336428:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1784290375.336432:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901101440:0@lo:400:kworker.0 00000100:00100000:0.0:1784290375.336441:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901100800:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784290375.336454:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784290375.336481:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901100800:12345-0@lo:400:kworker.0 Request processed in 44us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290375.336507:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1784290375.336510:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901100800:0@lo:400:kworker.0 00000100:00100000:2.0:1784290375.847505:0:75406:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dab4240 going to sleep for 0 seconds 00000100:00100000:0.0:1784290375.847545:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784290375.847551:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784290375.847569:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901101696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784290375.847571:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901101824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784290375.847653:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290375.847675:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901101696 00000100:00100000:3.0:1784290375.847684:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901101696 00000100:00100000:1.0:1784290375.847714:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290375.847748:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901101824 00000100:00100000:3.0:1784290375.847752:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901101824 00000100:00100000:0.0:1784290375.847777:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:3.0:1784290375.847788:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:0.0:1784290375.847794:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901101696:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784290375.847804:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901101824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784290375.847826:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1784290375.847829:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784290375.847891:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901101824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290375.847904:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:0.0:1784290375.847905:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468893100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901101696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290375.847917:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:1.0:1784290375.847940:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901101824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784290375.847970:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901101696:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1784290376.359602:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290376.872404:0:75406:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dab4240 going to sleep for 0 seconds 00010000:00010000:2.0:1784290377.384435:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1784290377.733521:0:3610:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.6@tcp portal 26 match 1870961896253184 offset 0 length 224: 4 00000100:00100000:0.0:1784290377.733586:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290377.733645:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290377.733666:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896253440 00000100:00100000:3.0:1784290377.733692:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896253440 00000100:00100000:0.0:1784290377.733717:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00080000:1.0:1784290377.733747:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784290377.733770:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290377.733774:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896253312 00000100:00100000:3.0:1784290377.733781:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896253312 00000100:00100000:1.0:1784290377.733798:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 713 00000100:00100000:0.0:1784290377.733813:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896253568 00000100:00100000:0.0:1784290377.733822:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896253568 00000100:00100000:1.0:1784290377.733829:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2398:x1870961896253440:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290377.733839:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1210 00000100:00100000:3.0:1784290377.733850:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1870961896253312:12345-192.168.202.6@tcp:38:kworker.0 00010000:00020000:3.0:1784290377.733884:0:65988:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290377.733885:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896253696 00000100:00100000:0.0:1784290377.733893:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896253696 00000100:00100000:1.0:1784290377.733921:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2398:x1870961896253440:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 99us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290377.733930:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 713 00000100:00100000:3.0:1784290377.733938:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1870961896253312:12345-192.168.202.6@tcp:38:kworker.0 Request processed in 86us (220us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290377.733950:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1585 00000100:00100000:3.0:1784290377.733956:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1210 00000100:00100000:0.0:1784290377.733970:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2397:x1870961896253568:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290377.734000:0:26255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1586 00000100:00100000:3.0:1784290377.734014:0:26255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2398:x1870961896253696:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290377.734027:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2397:x1870961896253568:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 64us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290377.734039:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1585 00000100:00100000:3.0:1784290377.734072:0:26255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468890380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2398:x1870961896253696:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 60us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290377.734084:0:26255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1586 00000100:00080000:0.0:1784290377.734109:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784290377.734116:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784290377.895528:0:75406:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dab4240 going to sleep for 0 seconds 00010000:00010000:1.0:1784290378.407445:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784290378.732249:0:92144:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784290378.732255:0:92144:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1784290378.732256:0:92144:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1784290378.732379:0:92144:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9c246dd94000 00000020:01000004:1.0:1784290378.732392:0:92144:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1784290378.732403:0:92144:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1784290378.732414:0:92144:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c246ff6cd40) 00000020:00000080:1.0:1784290378.732428:0:92144:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1784290378.753723:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1784290378.754074:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1784290378.756286:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1784290378.757223:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1784290378.757357:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1784290378.757503:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1784290378.757633:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1784290378.757780:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1784290378.757939:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1784290378.758081:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1784290378.758204:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1784290378.758361:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1784290378.758496:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1784290378.758637:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1784290378.758793:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1784290378.758942:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1784290378.759097:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1784290378.759232:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1784290378.759386:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1784290378.759545:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1784290378.759670:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1784290378.759829:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1784290378.759952:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1784290378.760111:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1784290378.760232:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1784290378.760386:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1784290378.760547:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1784290378.760683:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1784290378.760814:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1784290378.760974:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1784290378.761118:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1784290378.761282:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1784290378.761418:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1784290378.761595:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1784290378.761721:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1784290378.762303:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1784290378.762473:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1784290378.762693:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1784290378.762825:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1784290378.762985:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1784290378.763107:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1784290378.763270:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1784290378.763424:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1784290378.763572:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1784290378.763708:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1784290378.763895:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1784290378.764024:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1784290378.764489:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1784290378.764748:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1784290378.764904:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1784290378.765233:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1784290378.765394:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1784290378.765541:0:92144:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:1.0:1784290378.765821:0:92144:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1784290378.765957:0:92144:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1784290378.765964:0:92144:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784290378.765971:0:92144:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b307496b 00000020:01000004:1.0:1784290378.765975:0:92144:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1784290378.765985:0:92144:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1784290378.765988:0:92144:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c246dd94000 from MGS 00000020:01000004:1.0:1784290378.765991:0:92144:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1784290378.765997:0:92144:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c246ff68000) 00000020:00000080:1.0:1784290378.766006:0:92144:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:1.0:1784290378.766044:0:92144:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c246dd94000 from MGS, refs=2 00080000:01000000:1.0:1784290378.766046:0:92144:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784290378.766050:0:92144:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3074979 00010000:00010000:1.0:1784290378.766130:0:92144:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1784290378.768263:0:92144:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1784290378.768727:0:92148:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1784290378.768747:0:92144:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1784290378.768788:0:92144:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784290378.769159:0:92144:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1784290378.769538:0:92144:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784290378.769745:0:92144:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1784290378.769755:0:92144:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1784290378.770149:0:92144:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1784290378.770156:0:92144:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1784290378.770327:0:92144:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1784290378.770333:0:92144:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1784290378.770695:0:92144:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1784290378.770716:0:92144:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1784290378.770718:0:92144:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.106@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1784290378.770721:0:92144:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.106@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:1.0:1784290378.770725:0:92144:0:(import.c:65:import_set_state_nolock()) ffff9c2447cad800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1784290378.770729:0:92144:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1784290378.770732:0:92144:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.106@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1784290378.770734:0:92144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1784290378.770741:0:92144:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2444059f80 x1870961901098368/t0(0) o400->MGC192.168.202.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784290386 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290378.770760:0:92144:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c246a542d80 x1870961901100544/t0(0) o400->MGC192.168.202.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784290391 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1784290378.770767:0:92144:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1784290378.770769:0:92144:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1784290378.770770:0:92144:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1784290378.770773:0:92144:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:2.0:1784290378.770925:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901100544:0@lo:400:kworker.0 00000100:00100000:2.0:1784290378.770945:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901098368:0@lo:400:kworker.0 10000000:01000000:1.0:1784290378.770964:0:92144:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1784290378.770977:0:92144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c234236c600/0x5953bbf6b3074535 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b307453c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290378.770986:0:92144:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c234236c600/0x5953bbf6b3074535 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b307453c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290378.770991:0:92144:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784290378.771004:0:92144:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290378.771011:0:92144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c234236c600/0x5953bbf6b3074535 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b307453c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.771025:0:92144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b307449b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b30744a2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290378.771030:0:92144:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b307449b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b30744a2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290378.771040:0:92144:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290378.771049:0:92144:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290378.771054:0:92144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b307449b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b30744a2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.771067:0:92144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b30744b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b30744be expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290378.771072:0:92144:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b30744b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b30744be expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290378.771076:0:92144:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290378.771082:0:92144:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290378.771086:0:92144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b30744b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b30744be expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.771107:0:92144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c234236dc00/0x5953bbf6b30744e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b30744e8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290378.771112:0:92144:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c234236dc00/0x5953bbf6b30744e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b30744e8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290378.771116:0:92144:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290378.771123:0:92144:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290378.771126:0:92144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c234236dc00/0x5953bbf6b30744e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b30744e8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.771137:0:92144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c234236c800/0x5953bbf6b30744ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b30744f6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290378.771149:0:92144:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c234236c800/0x5953bbf6b30744ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b30744f6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290378.771153:0:92144:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290378.771171:0:92144:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290378.771177:0:92144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c234236c800/0x5953bbf6b30744ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b30744f6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.771189:0:92144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2345ef9200/0x5953bbf6b307450b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3074512 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290378.771194:0:92144:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ef9200/0x5953bbf6b307450b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3074512 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290378.771197:0:92144:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290378.771203:0:92144:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290378.771207:0:92144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2345ef9200/0x5953bbf6b307450b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3074512 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.771219:0:92144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8000/0x5953bbf6b3074519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3074520 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290378.771223:0:92144:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8000/0x5953bbf6b3074519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3074520 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290378.771227:0:92144:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290378.771234:0:92144:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290378.771237:0:92144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2345ef8000/0x5953bbf6b3074519 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3074520 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.771256:0:92144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c234236de00/0x5953bbf6b3074543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b307454a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290378.771261:0:92144:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c234236de00/0x5953bbf6b3074543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b307454a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290378.771265:0:92144:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290378.771272:0:92144:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290378.771276:0:92144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c234236de00/0x5953bbf6b3074543 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b307454a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.771290:0:92144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c000/0x5953bbf6b30744a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b30744b0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290378.771296:0:92144:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c000/0x5953bbf6b30744a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b30744b0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290378.771299:0:92144:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290378.771306:0:92144:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290378.771309:0:92144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c000/0x5953bbf6b30744a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b30744b0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.771328:0:92144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b30744c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b30744cc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290378.771333:0:92144:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b30744c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b30744cc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290378.771337:0:92144:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290378.771374:0:92144:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290378.771378:0:92144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b30744c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b30744cc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.771395:0:92144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c234236d200/0x5953bbf6b30744d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b30744da expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290378.771400:0:92144:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c234236d200/0x5953bbf6b30744d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b30744da expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290378.771404:0:92144:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784290378.771410:0:92144:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290378.771415:0:92144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c234236d200/0x5953bbf6b30744d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b30744da expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.771427:0:92144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d400/0x5953bbf6b30744fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3074504 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290378.771432:0:92144:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d400/0x5953bbf6b30744fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3074504 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290378.771436:0:92144:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784290378.771444:0:92144:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290378.771449:0:92144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d400/0x5953bbf6b30744fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3074504 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.771472:0:92144:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074527 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b307452e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290378.771477:0:92144:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074527 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b307452e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290378.771501:0:92144:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784290378.771507:0:92144:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290378.771511:0:92144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074527 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b307452e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784290378.771527:0:92144:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c2447cad800 already not connected (conn 50, was 0): DISCONN 00000100:00080000:1.0:1784290378.771531:0:92144:0:(import.c:65:import_set_state_nolock()) ffff9c2447cad800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290378.771535:0:92144:0:(import.c:510:import_select_connection()) MGC192.168.202.106@tcp: connect to NID 0@lo last attempt 2090 00000100:00080000:1.0:1784290378.771541:0:92144:0:(import.c:624:import_select_connection()) MGC192.168.202.106@tcp: import ffff9c2447cad800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290378.771562:0:92144:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2467ee4a80 x1870961901101952/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784290378.771581:0:92144:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1784290378.771612:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e54cd1c-9dbd-4e31-b60e-998135d46053:3616:1870961901101952:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1784290378.771668:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290378.771700:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901101952 00000100:00100000:1.0:1784290378.771707:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901101952 00000100:00100000:1.0:1784290378.771745:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784290378.771750:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24759f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3616:x1870961901101952:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1784290378.771770:0:92149:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo t0 exp 0000000000000000 cur 2120 last 0 00000020:00000080:1.0:1784290378.771792:0:92149:0:(genops.c:1406:class_connect()) connect: client 2e54cd1c-9dbd-4e31-b60e-998135d46053, cookie 0x5953bbf6b3074980 00000100:00080000:1.0:1784290378.771882:0:92149:0:(import.c:65:import_set_state_nolock()) ffff9c246d8ab800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784290378.771933:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24759f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:3616:x1870961901101952:12345-0@lo:250:mount.lustre.0 Request processed in 181us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290378.771940:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784290378.771961:0:3616:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.106@tcp: committing for last_committed 0 gen 27 00000100:00080000:0.0:1784290378.771969:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.106@tcp: connect to target with instance 0 00000100:00080000:0.0:1784290378.771974:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1784290378.771977:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1784290378.771981:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2447cad800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1784290378.771983:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1784290378.772004:0:3616:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1784290378.772012:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e54cd1c-9dbd-4e31-b60e-998135d46053:3616:1870961901101952:0@lo:250:mount.lustre.0 00000020:01000000:1.0:1784290378.772033:0:42926:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.202.106@tcp 10000000:01000000:1.0:1784290378.772045:0:42926:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1784290378.772048:0:42926:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784290378.772050:0:42926:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784290378.772057:0:42926:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290378.772058:0:42926:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290378.772059:0:42926:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290378.772060:0:42926:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290378.772062:0:42926:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784290378.772063:0:42926:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290378.772064:0:42926:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1784290378.772089:0:42926:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1784290378.772095:0:42926:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1784290378.772097:0:42926:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784290378.772098:0:42926:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000100:00100000:0.0:1784290378.772100:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901102080:0@lo:253:kworker.0 00000020:01000004:1.0:1784290378.772101:0:42926:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290378.772105:0:42926:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290378.772108:0:42926:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290378.772110:0:42926:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290378.772111:0:42926:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784290378.772112:0:42926:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290378.772113:0:42926:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1784290378.772128:0:42926:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1784290378.772132:0:42926:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1784290378.772134:0:42926:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784290378.772135:0:42926:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784290378.772136:0:42926:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:2.0:1784290378.772140:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901102208:0@lo:253:kworker.0 00000020:01000004:1.0:1784290378.772141:0:42926:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:0.0:1784290378.772144:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1784290378.772145:0:42926:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290378.772150:0:42926:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290378.772152:0:42926:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784290378.772153:0:42926:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290378.772154:0:42926:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1784290378.772180:0:42926:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1784290378.772191:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901102080 00000100:00100000:0.0:1784290378.772197:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901102080 00000100:00100000:2.0:1784290378.772198:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290378.772212:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901102336:0@lo:253:kworker.0 00000100:00100000:0.0:1784290378.772232:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901102208 00000100:00100000:0.0:1784290378.772235:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901102208 00000100:00100000:1.0:1784290378.772256:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290378.772260:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784290378.772269:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24759f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:3619:x1870961901102080:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1784290378.772289:0:92152:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:1.0:1784290378.772298:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901102336 00000100:00100000:1.0:1784290378.772303:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901102336 00000100:00100000:1.0:1784290378.772326:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784290378.772333:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24759f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:3620:x1870961901102208:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1784290378.772377:0:92149:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00080000:1.0:1784290378.772406:0:92144:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1784290378.772414:0:92144:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 10000000:01000000:0.0:1784290378.772426:0:92153:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000020:01000004:1.0:1784290378.772437:0:92144:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1784290378.772442:0:92144:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1784290378.772522:0:92144:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784290378.772545:0:92144:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.106@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1784290378.772547:0:92144:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784290378.772549:0:92144:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784290378.772550:0:92144:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290378.772551:0:92144:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290378.772552:0:92144:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290378.772553:0:92144:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290378.772555:0:92144:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784290378.772556:0:92144:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784290378.772558:0:92144:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290378.772559:0:92144:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784290378.772561:0:92144:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1784290378.772563:0:92144:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784290378.772564:0:92144:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784290378.772565:0:92144:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290378.772566:0:92144:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290378.772568:0:92144:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290378.772569:0:92144:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290378.772570:0:92144:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784290378.772571:0:92144:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784290378.772572:0:92144:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290378.772573:0:92144:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784290378.772584:0:92144:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1784290378.772592:0:92144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901102464:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784290378.772620:0:92144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290378.772647:0:92151:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1784290378.772652:0:92144:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247d321780 going to sleep for 11 seconds 20000000:01000000:0.0:1784290378.772683:0:92152:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 116 00000100:00100000:0.0:1784290378.772807:0:92151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1784290378.772942:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901102464 00000100:00100000:1.0:1784290378.772946:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901102464 00000100:00100000:2.0:1784290378.773011:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784290378.773020:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24759f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:3617:x1870961901102336:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1784290378.773039:0:92154:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1784290378.773438:0:92155:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1784290378.773442:0:92155:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1784290378.773444:0:92155:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1784290378.773447:0:92155:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1784290378.773597:0:92155:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1784290378.773662:0:92152:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784290378.773679:0:92152:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1784290378.774442:0:92152:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784290378.774454:0:92152:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1784290378.774469:0:92149:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784290378.774474:0:92153:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784290378.774478:0:92153:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784290378.774504:0:92153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c246dd27000/0x5953bbf6b3074987 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.774517:0:92153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd27000/0x5953bbf6b3074987 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784290378.774525:0:92153:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000046472s 00010000:00010000:0.0:1784290378.774528:0:92153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c246dd27000/0x5953bbf6b3074987 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.774534:0:92153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c246dd27000/0x5953bbf6b3074987 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.774539:0:92153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c246dd27000/0x5953bbf6b3074987 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.774544:0:92153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c246dd27000/0x5953bbf6b3074987 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.774549:0:92153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290378.774552:0:92153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c246dd27000/0x5953bbf6b3074987 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.774556:0:92153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c246dd27000/0x5953bbf6b3074987 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.774564:0:92153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c246dd27000/0x5953bbf6b3074987 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.774570:0:92153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c246dd27000/0x5953bbf6b3074987 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.774580:0:92153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd27000/0x5953bbf6b3074987 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290378.774615:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24759f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:3619:x1870961901102080:12345-0@lo:253:kworker.0 Request processed in 2346us (2474us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290378.774622:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:0.0:1784290378.774634:0:3619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1784290378.774638:0:3619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784290378.774640:0:3619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000100:00100000:1.0:1784290378.774644:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000020:01000004:0.0:1784290378.774644:0:3619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784290378.774649:0:3619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784290378.774653:0:3619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00100000:1.0:1784290378.774654:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24759f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:92144:x1870961901102464:12345-0@lo:253:mount.lustre.0 00000020:01000004:0.0:1784290378.774656:0:3619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784290378.774660:0:3619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784290378.774662:0:3619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1784290378.774667:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901102080:0@lo:253:kworker.0 20000000:01000000:1.0:1784290378.774675:0:92152:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784290378.774678:0:92152:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1784290378.774681:0:92152:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:1.0:1784290378.774685:0:92152:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1784290378.775791:0:92149:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784290378.775800:0:92149:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1784290378.775812:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24759f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:92144:x1870961901102464:12345-0@lo:253:mount.lustre.0 Request processed in 1158us (3190us total) trans 0 rc 0/0 20000000:01000000:0.0:1784290378.775813:0:92153:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784290378.775821:0:92153:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:1.0:1784290378.775823:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1784290378.775840:0:92153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b307498e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784290378.775848:0:92154:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:0.0:1784290378.775854:0:92153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b307498e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290378.775863:0:92144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901102464:0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784290378.775864:0:92153:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000046472s 00010000:00010000:0.0:1784290378.775873:0:92153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b307498e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290378.775876:0:92144:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1784290378.775880:0:92144:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784290378.775884:0:92144:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784290378.775885:0:92144:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290378.775887:0:92144:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00010000:00010000:0.0:1784290378.775887:0:92153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b307498e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784290378.775891:0:92144:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290378.775894:0:92144:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290378.775897:0:92144:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784290378.775899:0:92144:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784290378.775901:0:92144:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290378.775904:0:92144:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00010000:00010000:0.0:1784290378.775906:0:92153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b307498e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.775916:0:92153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b307498e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784290378.775917:0:92144:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c246dd94000 from lustre-MDT0000 00010000:00010000:0.0:1784290378.775933:0:92153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27c00 already unused, calling callback (ffffffffc0ec3230) 10000000:01000000:1.0:1784290378.775936:0:92144:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 00010000:00010000:0.0:1784290378.775939:0:92153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b307498e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290378.775940:0:92144:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784290378.775948:0:92144:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c246dd94000 00010000:00010000:0.0:1784290378.775952:0:92153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b307498e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290378.775953:0:92144:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784290378.775960:0:92144:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c246dd94000 10000000:01000000:1.0:1784290378.775964:0:92144:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 00010000:00010000:0.0:1784290378.775973:0:92153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b307498e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290378.775978:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24759f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:3620:x1870961901102208:12345-0@lo:253:kworker.0 Request processed in 3641us (3778us total) trans 0 rc 0/0 10000000:01000000:1.0:1784290378.775978:0:92144:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9c246dd94000 from 1 10000000:01000000:1.0:1784290378.775993:0:92144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00000020:01000004:3.0:1784290378.775998:0:3620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1784290378.776002:0:3620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00010000:00010000:0.0:1784290378.776004:0:92153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b307498e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784290378.776006:0:3620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784290378.776009:0:3620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784290378.776013:0:3620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:2.0:1784290378.776013:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1784290378.776014:0:92144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3074995 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1784290378.776017:0:3620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784290378.776021:0:3620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784290378.776024:0:3620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784290378.776027:0:3620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:0.0:1784290378.776028:0:92153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b307498e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290378.776033:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901102208:0@lo:253:kworker.0 00010000:00010000:1.0:1784290378.776035:0:92144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3074995 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.776053:0:92144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3074995 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290378.776064:0:92144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901102592:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784290378.776086:0:92144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290378.776107:0:92144:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247d321000 going to sleep for 11 seconds 00000100:00100000:0.0:1784290378.776116:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901102592 00000100:00100000:0.0:1784290378.776123:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901102592 00000100:00100000:0.0:1784290378.776160:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784290378.776170:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24759f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:92144:x1870961901102592:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784290378.776180:0:92151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290378.776192:0:92151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246dd26a00/0x5953bbf6b307499c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074995 expref: -99 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.776209:0:92151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd26a00/0x5953bbf6b307499c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074995 expref: 7 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.776220:0:92151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246dd26a00/0x5953bbf6b307499c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074995 expref: 7 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.776241:0:92151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26a00, rc 0) 00000100:00100000:0.0:1784290378.776281:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24759f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:92144:x1870961901102592:12345-0@lo:101:mount.lustre.0 Request processed in 113us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290378.776290:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784290378.776305:0:92144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901102592:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784290378.776317:0:92144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3074995 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307499c expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.776324:0:92144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3074995 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307499c expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290378.776334:0:92144:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784290378.776358:0:92144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3074995 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307499c expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.776364:0:92144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3074995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307499c expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290378.776369:0:92144:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784290378.776378:0:92144:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784290378.776382:0:92144:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c246dd94000 10000000:01000000:1.0:1784290378.776385:0:92144:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1784290378.776388:0:92144:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1784290378.776390:0:92144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784290378.776402:0:92144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30749a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.776407:0:92144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30749a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.776412:0:92144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30749a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290378.776420:0:92144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901102720:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784290378.776443:0:92144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290378.776479:0:92144:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247d321000 going to sleep for 11 seconds 00000100:00100000:2.0:1784290378.776491:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901102720 00000100:00100000:2.0:1784290378.776498:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901102720 00000100:00100000:2.0:1784290378.776546:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784290378.776555:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24759f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:92144:x1870961901102720:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784290378.776564:0:92149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290378.776583:0:92149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c24585bee00/0x5953bbf6b30749aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30749a3 expref: -99 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.776600:0:92149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c24585bee00/0x5953bbf6b30749aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30749a3 expref: 8 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.776610:0:92149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c24585bee00/0x5953bbf6b30749aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30749a3 expref: 8 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.776618:0:92149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24585bee00, rc 0) 00000100:00100000:2.0:1784290378.776662:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24759f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:92144:x1870961901102720:12345-0@lo:101:mount.lustre.0 Request processed in 107us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290378.776672:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784290378.776693:0:92144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901102720:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784290378.776703:0:92144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30749a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30749aa expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.776709:0:92144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30749a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30749aa expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290378.776753:0:92144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901102848:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784290378.776773:0:92144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290378.776786:0:92144:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247d321000 going to sleep for 11 seconds 00000100:00100000:0.0:1784290378.776850:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901102848 00000100:00100000:0.0:1784290378.776857:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901102848 00000100:00100000:0.0:1784290378.776889:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784290378.776900:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:92144:x1870961901102848:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784290378.777067:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:92144:x1870961901102848:12345-0@lo:501:mount.lustre.0 Request processed in 169us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290378.777077:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784290378.777090:0:92144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901102848:0@lo:501:mount.lustre.0 20000000:01000000:3.0:1784290378.777097:0:92154:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784290378.777115:0:92154:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1784290378.777123:0:92144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901102976:0@lo:503:mount.lustre.0 20000000:01000000:2.0:1784290378.777136:0:92153:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784290378.777141:0:92153:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784290378.777155:0:92153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c24585bea00/0x5953bbf6b30749b1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290378.777162:0:92144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784290378.777176:0:92153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c24585bea00/0x5953bbf6b30749b1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784290378.777186:0:92153:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000046472s 00000100:00100000:1.0:1784290378.777186:0:92144:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247d321000 going to sleep for 11 seconds 00010000:00010000:2.0:1784290378.777194:0:92153:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c24585bea00/0x5953bbf6b30749b1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290378.777199:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901102976 00000100:00100000:3.0:1784290378.777206:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901102976 00010000:00010000:2.0:1784290378.777207:0:92153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c24585bea00/0x5953bbf6b30749b1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.777217:0:92153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c24585bea00/0x5953bbf6b30749b1 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.777225:0:92153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c24585bea00/0x5953bbf6b30749b1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.777239:0:92153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585bea00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290378.777244:0:92153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c24585bea00/0x5953bbf6b30749b1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.777253:0:92153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c24585bea00/0x5953bbf6b30749b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290378.777259:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784290378.777273:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:92144:x1870961901102976:12345-0@lo:503:mount.lustre.0 00010000:00010000:2.0:1784290378.777274:0:92153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c24585bea00/0x5953bbf6b30749b1 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.777288:0:92153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c24585bea00/0x5953bbf6b30749b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.777295:0:92153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c24585bea00/0x5953bbf6b30749b1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290378.777310:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24759f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:3617:x1870961901102336:12345-0@lo:253:kworker.0 Request processed in 4289us (5052us total) trans 0 rc 0/0 00000020:01000004:1.0:1784290378.777319:0:3617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000100:00100000:0.0:1784290378.777320:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:1.0:1784290378.777322:0:3617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1784290378.777326:0:3617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290378.777327:0:3617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290378.777329:0:3617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290378.777330:0:3617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290378.777332:0:3617:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784290378.777333:0:3617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290378.777334:0:3617:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784290378.777353:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901102336:0@lo:253:kworker.0 00000100:00100000:3.0:1784290378.777793:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:92144:x1870961901102976:12345-0@lo:503:mount.lustre.0 Request processed in 523us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290378.777805:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784290378.777821:0:92144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901102976:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784290378.778001:0:92156:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92156:1870961901103104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290378.778028:0:92156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290378.778046:0:92156:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458630000 going to sleep for 11 seconds 00000100:00100000:0.0:1784290378.778072:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901103104 00000100:00100000:0.0:1784290378.778078:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901103104 00000100:00100000:0.0:1784290378.778119:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784290378.778130:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:92156:x1870961901103104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290378.778527:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:92156:x1870961901103104:12345-0@lo:502:llog_process_th.0 Request processed in 400us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290378.778535:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784290378.778571:0:92156:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92156:1870961901103104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784290378.778592:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784290378.778600:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290378.778602:0:92156:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784290378.778605:0:92156:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1784290378.778607:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784290378.778614:0:92156:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c246ff6b380) 00000020:00000080:1.0:1784290378.778626:0:92156:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:1.0:1784290378.778630:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1784290378.778678:0:92156:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:1.0:1784290378.778683:0:92156:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b30749bf 00000020:00000080:1.0:1784290378.778854:0:92156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1784290378.778863:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784290378.778866:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290378.778867:0:92156:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1784290378.778869:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784290378.778871:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290378.778872:0:92156:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1784290378.778874:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784290378.778880:0:92156:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c23440d0000) 00000020:00000080:1.0:1784290378.778889:0:92156:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:1.0:1784290378.778892:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1784290378.778893:0:92156:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1784290378.778895:0:92156:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1784290378.778899:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784290378.778931:0:92156:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c246dd94000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1784290378.778939:0:92156:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c23440d19c0) 00000020:00000080:1.0:1784290378.778945:0:92156:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:1.0:1784290378.778982:0:92156:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1784290378.778985:0:92156:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b30749d4 00000020:00000080:1.0:1784290378.779061:0:92156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1784290378.779066:0:92156:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1784290378.779069:0:92156:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5953bbf6b30749db 00080000:01000000:1.0:1784290378.779072:0:92156:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:1.0:1784290378.779074:0:92156:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b30749e2 00010000:00010000:1.0:1784290378.815452:0:92156:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:1.0:1784290378.815820:0:92156:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 111669149701 lx: 0 gen 21 00000001:00080000:1.0:1784290378.815859:0:92156:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 711f3c77-e791-4aa8-86ee-bc854fd0bcc5 idx: 2 lr: 0 srv lr: 111669149701 lx: 0 gen 23 00000001:00000004:1.0:1784290378.815881:0:92156:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 111669149701 00000001:00080000:1.0:1784290378.816096:0:92156:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:1.0:1784290378.816146:0:92156:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c234537c540: xid 1870961901094400, transno 111669149701, client gen 21, slot idx 1 00000001:00080000:1.0:1784290378.816152:0:92156:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c234537c6c0: xid 1870961901094144, transno 111669149700, client gen 21, slot idx 2 00000020:00000080:1.0:1784290378.816493:0:92156:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c23440d4d40) 00000020:00000080:1.0:1784290378.816513:0:92156:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:1.0:1784290378.816570:0:92156:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:1.0:1784290378.816575:0:92156:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b30749fe 00000020:00000080:1.0:1784290378.816870:0:92156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1784290378.818294:0:92156:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5953bbf6b3074a05 00000020:00000080:1.0:1784290378.818525:0:92156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1784290378.818533:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784290378.818538:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290378.818540:0:92156:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1784290378.818544:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784290378.818546:0:92156:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1784290378.818547:0:92156:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784290378.818548:0:92156:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784290378.818549:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784290378.818551:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290378.818552:0:92156:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784290378.818554:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784290378.818557:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290378.818558:0:92156:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1784290378.818561:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1784290378.818585:0:92156:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1784290378.818597:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784290378.818599:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290378.818600:0:92156:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1784290378.818601:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784290378.818603:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290378.818604:0:92156:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1784290378.818606:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784290378.818610:0:92156:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:00000080:1.0:1784290378.818629:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784290378.818636:0:92156:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c23440d3380) 00000020:00000080:1.0:1784290378.818644:0:92156:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1784290378.818647:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784290378.818690:0:92156:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1784290378.818695:0:92156:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784290378.818699:0:92156:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3074a13 00010000:00080000:1.0:1784290378.818728:0:92156:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2458841000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:1.0:1784290378.820147:0:92156:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1784290378.820747:0:92156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784290378.820755:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1784290378.820780:0:92156:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784290378.820797:0:92156:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3074a1a 00000100:00080000:2.0:1784290378.820805:0:92156:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784290378.820811:0:92156:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c2458841000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290378.820842:0:92156:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246dee6300 x1870961901103232/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784290378.820866:0:92156:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1784290378.820902:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290378.820908:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290378.820912:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784290378.820912:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901103232:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1784290378.820922:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2116 00000020:01000000:2.0:1784290378.820923:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:1.0:1784290378.820926:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000020:00000080:2.0:1784290378.820928:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290378.820931:0:92156:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000100:00080000:1.0:1784290378.820933:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000020:01000000:2.0:1784290378.820936:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784290378.820944:0:92156:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1784290378.820946:0:92156:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784290378.820948:0:92156:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784290378.820950:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000100:00100000:1.0:1784290378.820963:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2467ee5500 x1870961901103360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:2.0:1784290378.820965:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290378.820969:0:92156:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784290378.820976:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784290378.820981:0:92156:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1784290378.820986:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290378.820987:0:92156:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1784290378.820991:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784290378.820995:0:92156:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000100:00080000:1.0:1784290378.821004:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1784290378.821007:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784290378.821009:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000020:01000000:2.0:1784290378.821010:0:92156:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000100:00080000:1.0:1784290378.821012:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000020:00000080:2.0:1784290378.821013:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000100:00080000:1.0:1784290378.821020:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2116 00000100:00080000:1.0:1784290378.821023:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000020:00000080:2.0:1784290378.821024:0:92156:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c2445c14d40) 00000100:00080000:1.0:1784290378.821028:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290378.821041:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2467ee5c00 x1870961901103616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:2.0:1784290378.821042:0:92156:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1784290378.821051:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00080000:1.0:1784290378.821072:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290378.821075:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290378.821077:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784290378.821080:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901103360:0@lo:38:kworker.0 00000100:00080000:1.0:1784290378.821082:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2116 00000100:00080000:1.0:1784290378.821087:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784290378.821101:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290378.821117:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2444059f80 x1870961901103872/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00080000:2.0:1784290378.821126:0:92156:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1784290378.821134:0:92156:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000100:00100000:0.0:1784290378.821141:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1784290378.821144:0:92156:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3074a28 00000100:00080000:1.0:1784290378.821150:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290378.821154:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290378.821155:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290378.821160:0:42926:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2116 00000100:00080000:1.0:1784290378.821164:0:42926:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784290378.821167:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290378.821180:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901103616:0@lo:38:kworker.0 00000100:00100000:1.0:1784290378.821181:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c244405ad80 x1870961901104256/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:2.0:1784290378.821189:0:92156:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2474f81800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.106@tcp at head 00000100:00100000:3.0:1784290378.821211:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c244405aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901104000:0@lo:400:kworker.0 00000100:00100000:1.0:1784290378.821221:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901103488:0@lo:400:kworker.0 00000100:00100000:0.0:1784290378.821227:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290378.821264:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290378.821268:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901103872:0@lo:38:kworker.0 00000100:00100000:1.0:1784290378.821273:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290378.821296:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784290378.821305:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1870961901103744:0@lo:400:kworker.0 00000100:00100000:1.0:1784290378.821306:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784290378.821319:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901104128:0@lo:400:kworker.0 00000100:00100000:0.0:1784290378.821320:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290378.821377:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290378.821402:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290378.821406:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c244405ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901104256:0@lo:38:kworker.0 00010000:00010000:2.0:1784290378.821440:0:92156:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:3.0:1784290378.821441:0:26260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901104000 00000100:00100000:3.0:1784290378.821447:0:26260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901104000 00000100:00100000:0.0:1784290378.821451:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290378.821518:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901103360 00000100:00100000:1.0:1784290378.821522:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901103360 00000100:00100000:3.0:1784290378.821530:0:26260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901104128 00000100:00100000:3.0:1784290378.821535:0:26260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901104128 00000100:00100000:0.0:1784290378.821541:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901103232 00000100:00100000:1.0:1784290378.821560:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901103616 00000100:00100000:0.0:1784290378.821560:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901103232 00000100:00100000:1.0:1784290378.821566:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901103616 00000100:00100000:3.0:1784290378.821580:0:26260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1587 00000100:00100000:1.0:1784290378.821585:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901103488 00000100:00100000:1.0:1784290378.821589:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901103488 00000100:00100000:3.0:1784290378.821595:0:26260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901104000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290378.821595:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901103872 00000100:00100000:0.0:1784290378.821602:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901103872 00000100:00100000:1.0:1784290378.821612:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901103744 00000100:00100000:1.0:1784290378.821617:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901103744 00000100:00100000:0.0:1784290378.821638:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3825 00000100:00100000:1.0:1784290378.821640:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901104256 00000100:00100000:1.0:1784290378.821652:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901104256 00000100:00100000:0.0:1784290378.821659:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901103232:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784290378.821667:0:8999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1588 00000100:00100000:1.0:1784290378.821671:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:3.0:1784290378.821678:0:26260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901104000:12345-0@lo:400:kworker.0 Request processed in 87us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290378.821688:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244405b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901103488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290378.821689:0:8999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244405b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901104128:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1784290378.821689:0:22091:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2120 last 0 00000100:00100000:3.0:1784290378.821696:0:26260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1587 00000020:00000080:0.0:1784290378.821753:0:22091:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3074a2f 00000100:00100000:3.0:1784290378.821759:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1784290378.821760:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244405b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901103488:12345-0@lo:400:kworker.0 Request processed in 76us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290378.821773:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000004:00100000:0.0:1784290378.821782:0:22091:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1784290378.821784:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1870961901103744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290378.821792:0:8999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244405b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901104128:12345-0@lo:400:kworker.0 Request processed in 113us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290378.821805:0:8999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1588 00000100:00100000:1.0:1784290378.821805:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:1.0:1784290378.821817:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901103360:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784290378.821840:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:3.0:1784290378.821846:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1870961901103744:12345-0@lo:400:kworker.0 Request processed in 72us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290378.821848:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901103616:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1784290378.821857:0:22091:0:(import.c:65:import_set_state_nolock()) ffff9c24481c6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784290378.821863:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1784290378.821875:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901103360:12345-0@lo:38:kworker.0 Request processed in 58us (735us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784290378.821883:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:3.0:1784290378.821895:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:2.0:1784290378.821897:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901103616:12345-0@lo:38:kworker.0 Request processed in 49us (674us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784290378.821908:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901104256:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784290378.821915:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00100000:0.0:1784290378.821922:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468891500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3616:x1870961901103232:12345-0@lo:38:llog_process_th.0 Request processed in 260us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290378.821929:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3826 00000100:00100000:0.0:1784290378.821940:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3825 00000100:00100000:1.0:1784290378.821941:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901103872:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1784290378.821966:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901104256:12345-0@lo:38:kworker.0 Request processed in 58us (516us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784290378.821976:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:1.0:1784290378.821983:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901103872:12345-0@lo:38:kworker.0 Request processed in 45us (666us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784290378.821991:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3826 00000100:00100000:1.0:1784290378.822027:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901104128:0@lo:400:kworker.0 00000100:00080000:3.0:1784290378.822030:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784290378.822044:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784290378.822048:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784290378.822050:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290378.822050:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901103488:0@lo:400:kworker.0 00000100:00080000:0.0:1784290378.822061:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784290378.822062:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1870961901103744:0@lo:400:kworker.0 00000100:00100000:0.0:1784290378.822072:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901103872:0@lo:38:kworker.0 00000100:00080000:0.0:1784290378.822092:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290378.822098:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784290378.822104:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c244405aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901104000:0@lo:400:kworker.0 00000100:00100000:0.0:1784290378.822115:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c244405ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901104256:0@lo:38:kworker.0 00000100:00080000:0.0:1784290378.822138:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290378.822143:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784290378.822148:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901103360:0@lo:38:kworker.0 00000040:01000000:3.0:1784290378.822151:0:92156:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:0.0:1784290378.822161:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290378.822167:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784290378.822170:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901103616:0@lo:38:kworker.0 00000100:00100000:0.0:1784290378.822181:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784290378.822186:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:0.0:1784290378.822192:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1784290378.822197:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1784290378.822200:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2458841000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784290378.822217:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901103232:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784290378.822289:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901104384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784290378.822318:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:0.0:1784290378.822337:0:92156:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1784290378.822379:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901104384 00000100:00100000:3.0:1784290378.822384:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901104384 00000100:00100000:3.0:1784290378.822421:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3827 00000100:00100000:3.0:1784290378.822428:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901104384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1784290378.822448:0:22091:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445097472 avail 1298857984 00000100:00100000:3.0:1784290378.822495:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901104384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290378.822500:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3827 00000100:00100000:2.0:1784290378.822528:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901104384:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1784290378.823520:0:92156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784290378.823701:0:92156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].27, 64 off9920 00000040:00080000:0.0:1784290378.826506:0:92156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6c:0x0].1, 64 off8256 00000040:00080000:2.0:1784290378.826765:0:92162:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:2.0:1784290378.826770:0:92162:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1784290378.827183:0:92156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784290378.827191:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784290378.827220:0:92156:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784290378.827234:0:92156:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3074a36 00000100:00080000:0.0:1784290378.827240:0:92156:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784290378.827244:0:92156:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c2474f81800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290378.827263:0:92156:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a542d80 x1870961901104512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784290378.827288:0:92156:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1784290378.827313:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901104512:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1784290378.827366:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1784290378.827393:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784290378.827400:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290378.827403:0:92156:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000100:00100000:1.0:1784290378.827407:0:26251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901104512 00000020:01000000:0.0:1784290378.827408:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00100000:1.0:1784290378.827414:0:26251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901104512 00000020:01000000:0.0:1784290378.827414:0:92156:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1784290378.827418:0:92156:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784290378.827422:0:92156:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784290378.827424:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784290378.827429:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290378.827431:0:92156:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784290378.827435:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784290378.827440:0:92156:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000100:00100000:1.0:1784290378.827444:0:26251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4952 00000020:00000080:0.0:1784290378.827446:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290378.827451:0:92156:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000100:00100000:1.0:1784290378.827452:0:26251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3616:x1870961901104512:12345-0@lo:8:llog_process_th.0 00000020:00000080:0.0:1784290378.827476:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784290378.827481:0:92156:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00010000:00080000:1.0:1784290378.827487:0:26251:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2120 last 0 00000020:01000000:0.0:1784290378.827499:0:92156:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784290378.827505:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784290378.827509:0:26251:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3074a3d 00000020:00000080:0.0:1784290378.827515:0:92156:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c247d268000) 00002000:00100000:1.0:1784290378.827518:0:26251:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c245fd7a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ad ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1784290378.827523:0:26251:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1784290378.827525:0:26251:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000080:0.0:1784290378.827534:0:92156:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1784290378.827541:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00002000:00080000:1.0:1784290378.827571:0:26251:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784290378.827588:0:26251:0:(import.c:65:import_set_state_nolock()) ffff9c245fd7c800 : changing import state from RECOVER to FULL 00000004:00080000:0.0:1784290378.827609:0:92156:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1784290378.827615:0:92156:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00000020:00000080:0.0:1784290378.827623:0:92156:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3074a4b 00000100:00100000:1.0:1784290378.827629:0:26251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3616:x1870961901104512:12345-0@lo:8:llog_process_th.0 Request processed in 177us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290378.827637:0:26251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4952 00000100:00100000:2.0:1784290378.827656:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00010000:00080000:0.0:1784290378.827662:0:92156:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c246dce0800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.106@tcp at head 00000100:00080000:2.0:1784290378.827663:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784290378.827670:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784290378.827674:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1784290378.827676:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2474f81800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784290378.827689:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784290378.827693:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901104512:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1784290378.827705:0:92162:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1784290378.827744:0:92162:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2120067402803ns, next at 0ns, rc = 0 00080000:00080000:1.0:1784290378.827751:0:92162:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1784290378.827762:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901104640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784290378.827837:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784290378.827956:0:92156:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000100:00100000:1.0:1784290378.827985:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901104640 00000100:00100000:1.0:1784290378.827990:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901104640 00000040:01000000:0.0:1784290378.828018:0:92156:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00080000:3.0:1784290378.828026:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290378.828030:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000040:01000000:0.0:1784290378.828030:0:92156:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1784290378.828041:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901104640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784290378.828056:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290378.828090:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901104640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290378.828095:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1784290378.828120:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901104640:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1784290378.828602:0:92145:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:0.0:1784290378.828989:0:92156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784290378.829138:0:92156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].27, 64 off9920 00000040:00080000:0.0:1784290378.829257:0:92156:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6e:0x0].1, 64 off8256 00000040:00080000:2.0:1784290378.829570:0:92164:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:2.0:1784290378.829574:0:92164:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1784290378.829968:0:92156:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784290378.829980:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784290378.830009:0:92156:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784290378.830020:0:92156:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3074a52 00000100:00080000:0.0:1784290378.830025:0:92156:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784290378.830029:0:92156:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c246dce0800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290378.830046:0:92156:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a542300 x1870961901104768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784290378.830068:0:92156:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1784290378.830111:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784290378.830116:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290378.830119:0:92156:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784290378.830123:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784290378.830128:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290378.830131:0:92156:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000100:00100000:2.0:1784290378.830136:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901104768:0@lo:8:llog_process_th.0 00000020:00000080:0.0:1784290378.830138:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784290378.830141:0:92156:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784290378.830146:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784290378.830152:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290378.830154:0:92156:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784290378.830158:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784290378.830163:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290378.830165:0:92156:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784290378.830170:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784290378.830179:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290378.830198:0:92156:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a543800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92156:1870961901104896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290378.830224:0:26257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901104768 00000100:00100000:1.0:1784290378.830230:0:26257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901104768 00000100:00100000:0.0:1784290378.830252:0:92156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290378.830256:0:26257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4953 00000100:00100000:1.0:1784290378.830261:0:26257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3616:x1870961901104768:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1784290378.830276:0:26257:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2120 last 0 00000100:00100000:0.0:1784290378.830281:0:92156:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246deb36c0 going to sleep for 11 seconds 00000020:00000080:1.0:1784290378.830292:0:26257:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3074a59 00002000:00100000:1.0:1784290378.830300:0:26257:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c245fd7e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ad ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1784290378.830304:0:26257:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1784290378.830306:0:26257:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1784290378.830307:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901104896 00000100:00100000:3.0:1784290378.830314:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901104896 00002000:00080000:1.0:1784290378.830374:0:26257:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1784290378.830391:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1784290378.830394:0:26257:0:(import.c:65:import_set_state_nolock()) ffff9c245fd78800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784290378.830406:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:92156:x1870961901104896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290378.830436:0:26257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3616:x1870961901104768:12345-0@lo:8:llog_process_th.0 Request processed in 172us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290378.830443:0:26257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4953 00000100:00100000:2.0:1784290378.830448:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784290378.830454:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784290378.830472:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784290378.830476:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784290378.830477:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dce0800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784290378.830492:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784290378.830505:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901104768:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1784290378.830519:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:92156:x1870961901104896:12345-0@lo:502:llog_process_th.0 Request processed in 118us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290378.830528:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784290378.830532:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:0.0:1784290378.830541:0:92164:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1784290378.830543:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901105024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784290378.830585:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1784290378.830590:0:92164:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2120070247619ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784290378.830599:0:92164:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1784290378.830609:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901105024 00000100:00100000:3.0:1784290378.830614:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901105024 00000100:00080000:1.0:1784290378.830643:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290378.830649:0:92156:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a543800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92156:1870961901104896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290378.830656:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:3.0:1784290378.830666:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444058000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901105024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784290378.830685:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000020:01000000:0.0:1784290378.830694:0:92156:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784290378.830701:0:92156:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290378.830704:0:92156:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784290378.830709:0:92156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:3.0:1784290378.830733:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444058000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901105024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290378.830740:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:1.0:1784290378.830750:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901105024:0@lo:13:osp-pre-1-0.0 00000020:01000000:1.0:1784290378.830799:0:92144:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1784290378.830828:0:92144:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784290378.830846:0:92144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30749a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30749aa expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.830859:0:92144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30749a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30749aa expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290378.830868:0:92144:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9c246dd94000 from 1 10000000:01000000:1.0:1784290378.830871:0:92144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784290378.830894:0:92144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b3074a60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.830903:0:92144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b3074a60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.830911:0:92144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b3074a60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290378.830925:0:92144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901105152:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784290378.830967:0:92144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290378.831012:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901105152 00000100:00100000:1.0:1784290378.831014:0:92144:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458b93900 going to sleep for 11 seconds 00000100:00100000:0.0:1784290378.831019:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901105152 00000100:00100000:0.0:1784290378.831059:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784290378.831071:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:92144:x1870961901105152:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784290378.831082:0:92152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290378.831097:0:92152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b3074a67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074a60 expref: -99 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.831132:0:92152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b3074a67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074a60 expref: 9 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.831146:0:92152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b3074a67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074a60 expref: 9 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.831156:0:92152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27c00, rc 0) 00000100:00100000:0.0:1784290378.831203:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:92144:x1870961901105152:12345-0@lo:101:mount.lustre.0 Request processed in 134us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290378.831211:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784290378.831222:0:92144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901105152:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784290378.831235:0:92144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b3074a60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074a67 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.831242:0:92144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b3074a60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074a67 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784290378.831378:0:92145:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1784290378.831779:0:92144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901105280:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784290378.831817:0:92144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290378.831844:0:92144:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458b93900 going to sleep for 11 seconds 00000100:00100000:2.0:1784290378.831875:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901105280 00000100:00100000:2.0:1784290378.831880:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901105280 00000100:00100000:2.0:1784290378.831903:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784290378.831909:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:92144:x1870961901105280:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1784290378.831921:0:92149:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784290378.831934:0:92149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784290378.831937:0:92149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784290378.831939:0:92149:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784290378.831941:0:92149:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 119 00000100:00100000:2.0:1784290378.832012:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:92144:x1870961901105280:12345-0@lo:256:mount.lustre.0 Request processed in 103us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290378.832019:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784290378.832046:0:92144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901105280:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1784290378.832692:0:92144:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784290378.832707:0:92144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b3074a60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074a67 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.832717:0:92144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b3074a60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074a67 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290378.832726:0:92144:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c246dd94000 from 1 10000000:01000000:1.0:1784290378.832729:0:92144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784290378.832756:0:92144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3074a6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.832766:0:92144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3074a6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.832786:0:92144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3074a6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290378.832801:0:92144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901105408:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784290378.832828:0:92144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290378.832853:0:92144:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458b93900 going to sleep for 11 seconds 00000100:00100000:0.0:1784290378.832875:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901105408 00000100:00100000:0.0:1784290378.832882:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901105408 00000100:00100000:0.0:1784290378.832916:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784290378.832927:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:92144:x1870961901105408:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784290378.832936:0:92151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290378.832947:0:92151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246dd27000/0x5953bbf6b3074a75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074a6e expref: -99 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.832978:0:92151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd27000/0x5953bbf6b3074a75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074a6e expref: 10 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.832999:0:92151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246dd27000/0x5953bbf6b3074a75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074a6e expref: 10 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.833007:0:92151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27000, rc 0) 00000100:00100000:0.0:1784290378.833048:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:92144:x1870961901105408:12345-0@lo:101:mount.lustre.0 Request processed in 122us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290378.833064:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784290378.833075:0:92144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901105408:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784290378.833091:0:92144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3074a6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074a75 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.833101:0:92144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3074a6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074a75 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290378.833143:0:92144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901105536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784290378.833169:0:92144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290378.833186:0:92144:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458b93900 going to sleep for 11 seconds 00000100:00100000:3.0:1784290378.833209:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901105536 00000100:00100000:3.0:1784290378.833221:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901105536 00000100:00100000:3.0:1784290378.833251:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784290378.833258:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:92144:x1870961901105536:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784290378.833361:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:92144:x1870961901105536:12345-0@lo:501:mount.lustre.0 Request processed in 103us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290378.833369:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784290378.833378:0:92144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901105536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784290378.833409:0:92144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901105664:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784290378.833448:0:92144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290378.833488:0:92144:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458b93900 going to sleep for 11 seconds 00000100:00100000:0.0:1784290378.833497:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901105664 00000100:00100000:0.0:1784290378.833503:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901105664 00000100:00100000:0.0:1784290378.833535:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784290378.833546:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:92144:x1870961901105664:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784290378.833633:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:92144:x1870961901105664:12345-0@lo:503:mount.lustre.0 Request processed in 89us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290378.833643:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784290378.833652:0:92144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901105664:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784290378.833878:0:92166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92166:1870961901105792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290378.833914:0:92166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290378.833932:0:92166:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458b93b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784290378.833948:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901105792 00000100:00100000:2.0:1784290378.833954:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901105792 00000100:00100000:2.0:1784290378.833980:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784290378.833988:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:92166:x1870961901105792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290378.834196:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:92166:x1870961901105792:12345-0@lo:502:llog_process_th.0 Request processed in 207us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290378.834210:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784290378.834237:0:92166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92166:1870961901105792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784290378.834259:0:92166:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784290378.834264:0:92166:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290378.834266:0:92166:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784290378.834272:0:92166:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c246dd94000 00000020:00000080:1.0:1784290378.834274:0:92166:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784290378.834280:0:92166:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784290378.834282:0:92166:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290378.834284:0:92166:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1784290378.834286:0:92166:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784290378.834289:0:92166:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290378.834290:0:92166:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784290378.834295:0:92166:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c246dd94000 00000020:00000080:1.0:1784290378.834297:0:92166:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784290378.834376:0:92166:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92166:1870961901105920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290378.834413:0:92166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290378.834439:0:92166:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458b93b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784290378.834453:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901105920 00000100:00100000:0.0:1784290378.834474:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901105920 00000100:00100000:0.0:1784290378.834510:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784290378.834520:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:92166:x1870961901105920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290378.834606:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:92166:x1870961901105920:12345-0@lo:502:llog_process_th.0 Request processed in 87us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290378.834615:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784290378.834624:0:92166:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92166:1870961901105920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784290378.834649:0:92166:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784290378.834655:0:92166:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290378.834658:0:92166:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784290378.834661:0:92166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784290378.834744:0:92144:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1784290378.834765:0:92144:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784290378.834782:0:92144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3074a6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074a75 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.834794:0:92144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3074a6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074a75 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290378.834853:0:92144:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784290378.834856:0:92144:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c246dd94000 10000000:01000000:2.0:1784290378.834860:0:92144:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c246dd94000 10000000:01000000:2.0:1784290378.834865:0:92144:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784290378.834869:0:92144:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c246dd94000 from 1 10000000:01000000:2.0:1784290378.834872:0:92144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784290378.834892:0:92144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24585bea00/0x5953bbf6b3074a7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.834901:0:92144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24585bea00/0x5953bbf6b3074a7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.834910:0:92144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24585bea00/0x5953bbf6b3074a7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290378.834924:0:92144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901106048:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784290378.834970:0:92144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290378.834990:0:92144:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b279600 going to sleep for 11 seconds 00000100:00100000:0.0:1784290378.835000:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901106048 00000100:00100000:0.0:1784290378.835005:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901106048 00000100:00100000:0.0:1784290378.835042:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784290378.835048:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:92144:x1870961901106048:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784290378.835054:0:92154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290378.835063:0:92154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246dd27800/0x5953bbf6b3074a83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074a7c expref: -99 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.835077:0:92154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd27800/0x5953bbf6b3074a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074a7c expref: 11 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.835083:0:92154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246dd27800/0x5953bbf6b3074a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074a7c expref: 11 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.835088:0:92154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27800, rc 0) 00000100:00100000:0.0:1784290378.835122:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:92144:x1870961901106048:12345-0@lo:101:mount.lustre.0 Request processed in 75us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290378.835129:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784290378.835148:0:92144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901106048:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784290378.835162:0:92144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24585bea00/0x5953bbf6b3074a7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074a83 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.835179:0:92144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24585bea00/0x5953bbf6b3074a7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074a83 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290378.835232:0:92144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901106176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784290378.835265:0:92144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290378.835286:0:92144:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b279600 going to sleep for 11 seconds 00000100:00100000:1.0:1784290378.835302:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901106176 00000100:00100000:1.0:1784290378.835307:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901106176 00000100:00100000:1.0:1784290378.835334:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784290378.835361:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:92144:x1870961901106176:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784290378.835426:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:92144:x1870961901106176:12345-0@lo:501:mount.lustre.0 Request processed in 86us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290378.835432:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784290378.835483:0:92144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901106176:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784290378.835505:0:92144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901106304:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784290378.835536:0:92144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290378.835554:0:92144:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458b93e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784290378.835565:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901106304 00000100:00100000:1.0:1784290378.835568:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901106304 00000100:00100000:1.0:1784290378.835590:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784290378.835598:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:92144:x1870961901106304:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784290378.835662:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:92144:x1870961901106304:12345-0@lo:503:mount.lustre.0 Request processed in 66us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290378.835668:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784290378.835684:0:92144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901106304:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784290378.835861:0:92168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a543800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92168:1870961901106432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290378.835901:0:92168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290378.835924:0:92168:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341700900 going to sleep for 11 seconds 00000100:00100000:1.0:1784290378.835935:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901106432 00000100:00100000:1.0:1784290378.835940:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901106432 00000100:00100000:1.0:1784290378.835969:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784290378.835987:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:92168:x1870961901106432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290378.836055:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:92168:x1870961901106432:12345-0@lo:502:llog_process_th.0 Request processed in 70us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290378.836061:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784290378.836065:0:92168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a543800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92168:1870961901106432:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1784290378.836103:0:92168:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1784290378.836111:0:92168:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c247d2699c0) 00000020:00000080:0.0:1784290378.836124:0:92168:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1784290378.836221:0:92168:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c246dd94000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784290378.836224:0:92168:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c246dd94000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784290378.836226:0:92168:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c246dd94000 4 00010000:00080000:0.0:1784290378.836260:0:92168:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c246dce3000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:0.0:1784290378.838100:0:92168:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1784290378.838168:0:92168:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1784290378.838206:0:92168:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784290378.838214:0:92168:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5953bbf6b3074a91 00000100:00080000:0.0:1784290378.838218:0:92168:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784290378.838221:0:92168:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c246dce3000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290378.838234:0:92168:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a543800 x1870961901106560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784290378.838255:0:92168:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784290378.838268:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901106560:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784290378.838307:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290378.838355:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901106560 00000100:00100000:0.0:1784290378.838359:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901106560 00000100:00100000:0.0:1784290378.838387:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:0.0:1784290378.838398:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901106560:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784290378.838448:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901106560:12345-0@lo:38:llog_process_th.0 Request processed in 49us (141us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784290378.838454:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:2.0:1784290378.838478:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784290378.838485:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dce3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290378.838490:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784290378.838495:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901106560:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784290378.838551:0:92168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92168:1870961901106688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290378.838590:0:92168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290378.838612:0:92168:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341700900 going to sleep for 11 seconds 00000100:00100000:1.0:1784290378.838622:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901106688 00000100:00100000:1.0:1784290378.838628:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901106688 00000100:00100000:1.0:1784290378.838660:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784290378.838667:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:92168:x1870961901106688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290378.838744:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:92168:x1870961901106688:12345-0@lo:502:llog_process_th.0 Request processed in 76us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290378.838755:0:92168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92168:1870961901106688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290378.838757:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784290378.838798:0:92168:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92168:1870961901106816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290378.838832:0:92168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290378.838849:0:92168:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341700900 going to sleep for 11 seconds 00000100:00100000:1.0:1784290378.838855:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901106816 00000100:00100000:1.0:1784290378.838865:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901106816 00000100:00100000:1.0:1784290378.838896:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784290378.838903:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:92168:x1870961901106816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290378.838977:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:92168:x1870961901106816:12345-0@lo:502:llog_process_th.0 Request processed in 73us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290378.838985:0:92168:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92168:1870961901106816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290378.838987:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000040:00080000:0.0:1784290378.839010:0:92168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1784290378.839060:0:92144:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1784290378.839083:0:92144:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784290378.839101:0:92144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24585bea00/0x5953bbf6b3074a7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074a83 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290378.839112:0:92144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24585bea00/0x5953bbf6b3074a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074a83 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784290378.839153:0:92144:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784290378.839166:0:92144:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784290378.839168:0:92144:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290378.839170:0:92144:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290378.839171:0:92144:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290378.839173:0:92144:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290378.839175:0:92144:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784290378.839177:0:92144:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784290378.839179:0:92144:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290378.839181:0:92144:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784290378.839184:0:92144:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1784290378.839188:0:92144:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784290378.839190:0:92144:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784290378.839191:0:92144:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290378.839193:0:92144:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290378.839195:0:92144:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290378.839196:0:92144:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290378.839198:0:92144:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784290378.839200:0:92144:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784290378.839201:0:92144:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290378.839209:0:92144:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784290378.839222:0:92144:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1784290378.839233:0:92144:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c244405ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901106944:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784290378.839267:0:92144:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290378.839296:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901106944 00000100:00100000:1.0:1784290378.839299:0:92144:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23422e1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290378.839301:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901106944 00000100:00100000:2.0:1784290378.839331:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784290378.839337:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:92144:x1870961901106944:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784290378.839374:0:92149:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784290378.839382:0:92149:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784290378.840797:0:92149:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784290378.840809:0:92149:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1784290378.840830:0:92153:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784290378.840835:0:92153:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784290378.840848:0:92153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c247c262800/0x5953bbf6b3074a98 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290378.840863:0:92153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b3074a67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074a60 expref: 11 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290378.840873:0:92153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c247c262800/0x5953bbf6b3074a98 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290378.840903:0:92153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b3074a67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3074a60 expref: 11 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290378.840919:0:92153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b3074a67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3074a60 expref: 11 pid: 92152 timeout: 2220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290378.840932:0:92153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d03800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92153:1870961901107072:0@lo:104: 00000100:00100000:2.0:1784290378.840936:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:92144:x1870961901106944:12345-0@lo:253:mount.lustre.0 Request processed in 1597us (1666us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290378.840945:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784290378.840974:0:92153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290378.840974:0:92144:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c244405ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:92144:1870961901106944:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784290378.840987:0:92144:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1784290378.840990:0:92144:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784290378.840993:0:92144:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784290378.840995:0:92144:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290378.840997:0:92144:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290378.840998:0:92144:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290378.841000:0:92144:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290378.841003:0:92144:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784290378.841004:0:92144:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784290378.841006:0:92144:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290378.841008:0:92144:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1784290378.841021:0:92153:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344a79540 going to sleep for 11 seconds 00000100:00100000:0.0:1784290378.841021:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901107072 00000020:02000000:1.0:1784290378.841025:0:92144:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1784290378.841027:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901107072 00000100:00100000:0.0:1784290378.841064:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1784290378.841071:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:92153:x1870961901107072:12345-0@lo:104: 00010000:00010000:0.0:1784290378.841080:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b3074a60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074a67 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290378.841128:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784290378.841133:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:92153:x1870961901107072:12345-0@lo:104: Request processed in 63us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290378.841138:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1784290378.841144:0:92153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d03800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:92153:1870961901107072:0@lo:104: 00010000:00010000:2.0:1784290378.841149:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290378.841157:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b3074a60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074a67 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290378.841173:0:92153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c247c262800/0x5953bbf6b3074a98 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.841193:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab600 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:2.0:1784290378.841200:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b3074a60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3074a67 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.841209:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b3074a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3074a67 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290378.841215:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b3074a60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3074a67 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290378.841219:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784290378.841248:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b3074a60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074a67 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.841252:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784290378.841267:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b3074a60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074a67 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.841273:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b3074a60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074a67 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290378.841278:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901107200:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290378.841289:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290378.841292:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290378.841295:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290378.841313:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290378.841357:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901107200 00000100:00100000:2.0:1784290378.841361:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901107200 00010000:00010000:2.0:1784290378.841380:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b3074a67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074a60 expref: 11 pid: 92152 timeout: 2220 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290378.841407:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585 00000100:00100000:2.0:1784290378.841420:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:3617:x1870961901107200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290378.841431:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290378.841435:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b3074a67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074a60 expref: 11 pid: 92152 timeout: 2220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.841445:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b3074a67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3074a60 expref: 11 pid: 92152 timeout: 2220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.841466:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b3074a67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3074a60 expref: 11 pid: 92152 timeout: 2220 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.841476:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c247c262800/0x5953bbf6b3074a98 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.841482:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247c262800/0x5953bbf6b3074a98 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784290378.841491:0:7430:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000656868s 00010000:00010000:2.0:1784290378.841494:0:7430:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c247c262800/0x5953bbf6b3074a98 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.841499:0:7430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c247c262800/0x5953bbf6b3074a98 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.841505:0:7430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c247c262800/0x5953bbf6b3074a98 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.841519:0:7430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c247c262800/0x5953bbf6b3074a98 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.841522:0:7430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c262800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290378.841533:0:7430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c247c262800/0x5953bbf6b3074a98 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.841539:0:7430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c247c262800/0x5953bbf6b3074a98 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.841554:0:7430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c247c262800/0x5953bbf6b3074a98 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290378.841561:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290378.841584:0:92153:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c247c262800/0x5953bbf6b3074a98 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290378.841593:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d03800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:3617:x1870961901107200:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (278us total) trans 0 rc 0/0 00010000:00010000:3.0:1784290378.841594:0:92153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c247c262800/0x5953bbf6b3074a98 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290378.841607:0:92153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247c262800/0x5953bbf6b3074a98 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290378.841608:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585 00000100:00100000:3.0:1784290378.841648:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901107200:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1784290378.844068:0:92144:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444064 00000040:01000000:2.0:1784290378.844269:0:92144:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1784290378.844272:0:92174:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444064 00000020:00080000:1.0:1784290378.844276:0:92174:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444064 00000040:01000000:2.0:1784290378.844432:0:92175:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784290378.844443:0:92144:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1784290378.844679:0:92175:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784290378.844750:0:92176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee4e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92176:1870961901107328:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784290378.844778:0:92176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290378.844802:0:92176:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b279600 going to sleep for 11 seconds 00000100:00100000:0.0:1784290378.844818:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901107328 00000100:00100000:0.0:1784290378.844825:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901107328 00000100:00100000:0.0:1784290378.844857:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3828 00000100:00100000:0.0:1784290378.844868:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92176:x1870961901107328:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784290378.844945:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92176:x1870961901107328:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 80us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290378.844954:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3828 00000100:00100000:2.0:1784290378.844969:0:92176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee4e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92176:1870961901107328:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1784290378.845007:0:92176:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1784290378.845035:0:92144:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000100:00100000:2.0:1784290378.845035:0:92176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee4e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92176:1870961901107456:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784290378.845076:0:92176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1784290378.845079:0:92144:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784290378.845102:0:92176:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b2790c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290378.847392:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901107456 00000100:00100000:0.0:1784290378.847397:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901107456 00000100:00100000:0.0:1784290378.847426:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3829 00000100:00100000:0.0:1784290378.847434:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92176:x1870961901107456:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784290378.847548:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92176:x1870961901107456:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 114us (2471us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290378.847558:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3829 00000100:00100000:2.0:1784290378.847562:0:92176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee4e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92176:1870961901107456:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784290378.847607:0:92176:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee4e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92176:1870961901107584:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784290378.847631:0:92176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290378.847650:0:92176:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b279600 going to sleep for 11 seconds 00000100:00100000:0.0:1784290378.847655:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901107584 00000100:00100000:0.0:1784290378.847660:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901107584 00000100:00100000:0.0:1784290378.847687:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3830 00000100:00100000:0.0:1784290378.847700:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92176:x1870961901107584:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1784290378.847756:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ad5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:92176:x1870961901107584:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 56us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290378.847764:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3830 00000100:00100000:2.0:1784290378.847778:0:92176:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee4e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:92176:1870961901107584:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1784290378.847816:0:92176:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1784290378.853258:0:92144:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1784290378.853264:0:92144:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1784290378.853291:0:92144:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784290378.874897:0:92144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1784290378.876595:0:92176:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400090a3:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784290378.876627:0:92176:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1784290378.876773:0:92175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784290378.876816:0:92175:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1784290378.876820:0:92175:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1784290378.877087:0:92144:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1784290378.877111:0:92144:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1784290378.877187:0:92144:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1784290378.877579:0:92144:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4e:0x0] (8/32) registered 00010000:00080000:1.0:1784290378.878795:0:92144:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 111669149701 00010000:00080000:1.0:1784290378.879302:0:92177:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 92177 00010000:02000000:1.0:1784290378.879315:0:92177:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1784290378.879318:0:92177:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1784290378.879321:0:92177:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1784290378.879383:0:92144:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784290378.879396:0:92144:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784290378.879411:0:92144:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1784290378.879421:0:92144:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1784290378.880266:0:92144:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784290378.880566:0:92144:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1784290378.920386:0:75406:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dab4240 going to sleep for 0 seconds 00010000:00010000:0.0:1784290379.432833:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290379.944405:0:75406:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dab4240 going to sleep for 0 seconds 10000000:01000000:3.0:1784290380.071410:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784290380.071425:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9c246dd94000 from 120 10000000:01000000:3.0:1784290380.071431:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784290380.071503:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247c263200/0x5953bbf6b3074a9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.071516:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247c263200/0x5953bbf6b3074a9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.071530:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247c263200/0x5953bbf6b3074a9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290380.071558:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901107712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290380.071626:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290380.071671:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901107712 00000100:00100000:3.0:1784290380.071677:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8780 going to sleep for 11 seconds 00000100:00100000:1.0:1784290380.071679:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901107712 00000100:00100000:1.0:1784290380.071739:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784290380.071746:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:6485:x1870961901107712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290380.071759:0:92151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290380.071773:0:92151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c23450aa200/0x5953bbf6b3074aa6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074a9f expref: -99 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290380.071794:0:92151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c23450aa200/0x5953bbf6b3074aa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074a9f expref: 11 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290380.071803:0:92151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c23450aa200/0x5953bbf6b3074aa6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074a9f expref: 11 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290380.071810:0:92151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aa200, rc 0) 00000100:00100000:1.0:1784290380.071854:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901107712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290380.071860:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784290380.071906:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901107712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290380.071924:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247c263200/0x5953bbf6b3074a9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074aa6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.071936:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247c263200/0x5953bbf6b3074a9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074aa6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290380.071991:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901107840:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784290380.072032:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290380.072056:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8780 going to sleep for 11 seconds 00000100:00100000:1.0:1784290380.072064:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901107840 00000100:00100000:1.0:1784290380.072069:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901107840 00000100:00100000:1.0:1784290380.072104:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784290380.072114:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901107840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784290380.072130:0:92154:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784290380.072145:0:92154:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784290380.072148:0:92154:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 120 00000100:00100000:1.0:1784290380.072240:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901107840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290380.072255:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784290380.072265:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d03b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901107840:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784290380.072322:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784290380.072330:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247c263200/0x5953bbf6b3074a9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074aa6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.072534:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247c263200/0x5953bbf6b3074a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074aa6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290380.072544:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784290380.072546:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c23452c5000 from 52 10000000:01000000:2.0:1784290380.072548:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784290380.072563:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24585be200/0x5953bbf6b3074aad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.072569:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24585be200/0x5953bbf6b3074aad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.072575:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24585be200/0x5953bbf6b3074aad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290380.072586:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901107968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.072614:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290380.072641:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247d321b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784290380.072651:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901107968 00000100:00100000:1.0:1784290380.072656:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901107968 00000100:00100000:1.0:1784290380.072697:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784290380.072703:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901107968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290380.072709:0:92152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290380.072717:0:92152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c23450aa000/0x5953bbf6b3074ab4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074aad expref: -99 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290380.072730:0:92152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c23450aa000/0x5953bbf6b3074ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074aad expref: 12 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290380.072737:0:92152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c23450aa000/0x5953bbf6b3074ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074aad expref: 12 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290380.072742:0:92152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aa000, rc 0) 00000100:00100000:1.0:1784290380.072774:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901107968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290380.072779:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784290380.072803:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901107968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290380.072814:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24585be200/0x5953bbf6b3074aad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ab4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.072828:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24585be200/0x5953bbf6b3074aad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074ab4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290380.072878:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901108096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.072902:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290380.072918:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247d321b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784290380.072933:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901108096 00000100:00100000:3.0:1784290380.072940:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901108096 00000100:00100000:3.0:1784290380.072979:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784290380.072988:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901108096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290380.073121:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901108096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290380.073138:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784290380.073146:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901108096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.073183:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901108224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.073218:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290380.073234:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247d321b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784290380.073253:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901108224 00000100:00100000:1.0:1784290380.073260:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901108224 00000100:00100000:1.0:1784290380.073294:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784290380.073305:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901108224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290380.073432:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901108224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290380.073435:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901108224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290380.073460:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000040:00080000:2.0:1784290380.074061:0:92332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1784290380.074133:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1784290380.074171:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290380.074177:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24585be200/0x5953bbf6b3074aad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ab4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.074189:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24585be200/0x5953bbf6b3074aad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ab4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290380.074198:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784290380.074201:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9c23452c5000 from 117 10000000:01000000:3.0:1784290380.074203:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784290380.074222:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247c262800/0x5953bbf6b3074abb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.074232:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247c262800/0x5953bbf6b3074abb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.074241:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247c262800/0x5953bbf6b3074abb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290380.074257:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901108352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290380.074295:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290380.074334:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901108352 00000100:00100000:3.0:1784290380.074335:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8900 going to sleep for 11 seconds 00000100:00100000:2.0:1784290380.074369:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901108352 00000100:00100000:2.0:1784290380.074405:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784290380.074413:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901108352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290380.074430:0:92154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290380.074437:0:92154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c24585bf600/0x5953bbf6b3074ac2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074abb expref: -99 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.074468:0:92154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c24585bf600/0x5953bbf6b3074ac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074abb expref: 13 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.074476:0:92154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c24585bf600/0x5953bbf6b3074ac2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074abb expref: 13 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.074492:0:92154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24585bf600, rc 0) 00000100:00100000:2.0:1784290380.074536:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901108352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290380.074543:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784290380.074556:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901108352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290380.074575:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247c262800/0x5953bbf6b3074abb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ac2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.074586:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247c262800/0x5953bbf6b3074abb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074ac2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290380.074632:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901108480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784290380.074665:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290380.074691:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901108480 00000100:00100000:3.0:1784290380.074694:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8900 going to sleep for 11 seconds 00000100:00100000:2.0:1784290380.074696:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901108480 00000100:00100000:2.0:1784290380.074726:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784290380.074734:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901108480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784290380.074744:0:92152:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784290380.074755:0:92152:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784290380.074758:0:92152:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1784290380.074760:0:92152:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1784290380.074763:0:92152:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1784290380.074765:0:92152:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 120 00000100:00100000:2.0:1784290380.074845:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901108480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290380.074851:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784290380.074860:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d00380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901108480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1784290380.074925:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784290380.074931:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247c262800/0x5953bbf6b3074abb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ac2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290380.074938:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247c262800/0x5953bbf6b3074abb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ac2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290380.074943:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1784290380.074945:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1784290380.074947:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1784290380.074964:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450ab400/0x5953bbf6b3074ac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290380.074969:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450ab400/0x5953bbf6b3074ac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290380.074976:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450ab400/0x5953bbf6b3074ac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290380.074987:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c244405ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901108608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290380.075024:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290380.075045:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246d46a240 going to sleep for 11 seconds 00000100:00100000:2.0:1784290380.075047:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901108608 00000100:00100000:2.0:1784290380.075052:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901108608 00000100:00100000:2.0:1784290380.075083:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784290380.075089:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901108608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290380.075095:0:92149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290380.075105:0:92149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c24585bf000/0x5953bbf6b3074ad0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074ac9 expref: -99 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.075121:0:92149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c24585bf000/0x5953bbf6b3074ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074ac9 expref: 14 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.075146:0:92149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c24585bf000/0x5953bbf6b3074ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074ac9 expref: 14 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.075154:0:92149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24585bf000, rc 0) 00000100:00100000:2.0:1784290380.075193:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901108608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290380.075198:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784290380.075224:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c244405ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901108608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290380.075238:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450ab400/0x5953bbf6b3074ac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ad0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.075246:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450ab400/0x5953bbf6b3074ac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074ad0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290380.075300:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901108736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290380.075331:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290380.075377:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901108736 00000100:00100000:2.0:1784290380.075381:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901108736 00000100:00100000:0.0:1784290380.075401:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290380.075413:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784290380.075419:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901108736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.075521:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901108736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290380.075527:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784290380.075550:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901108736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290380.075576:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901108864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290380.075615:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290380.075634:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290380.075636:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901108864 00000100:00100000:2.0:1784290380.075640:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901108864 00000100:00100000:2.0:1784290380.075667:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784290380.075673:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901108864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.076144:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901108864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 468us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290380.076153:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784290380.076157:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901108864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784290380.076800:0:92337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:2.0:1784290380.076845:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:2.0:1784290380.076862:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784290380.076868:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450ab400/0x5953bbf6b3074ac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ad0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.076885:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450ab400/0x5953bbf6b3074ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ad0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290380.076891:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1784290380.076892:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9c23452c5000 from 1 10000000:01000000:2.0:1784290380.076894:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1784290380.076913:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24585be800/0x5953bbf6b3074ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.076919:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24585be800/0x5953bbf6b3074ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.076925:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24585be800/0x5953bbf6b3074ad7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290380.076936:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901108992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.076970:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290380.076999:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901108992 00000100:00100000:0.0:1784290380.077005:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901108992 00000100:00100000:2.0:1784290380.077010:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b279300 going to sleep for 11 seconds 00000100:00100000:0.0:1784290380.077048:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784290380.077057:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901108992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290380.077065:0:92152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290380.077082:0:92152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246dd27200/0x5953bbf6b3074ade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074ad7 expref: -99 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.077097:0:92152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd27200/0x5953bbf6b3074ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074ad7 expref: 15 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.077103:0:92152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246dd27200/0x5953bbf6b3074ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074ad7 expref: 15 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.077109:0:92152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27200, rc 0) 00000100:00100000:0.0:1784290380.077146:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:6485:x1870961901108992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290380.077151:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784290380.077167:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901108992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290380.077183:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24585be800/0x5953bbf6b3074ad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ade expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.077190:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24585be800/0x5953bbf6b3074ad7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074ade expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290380.077200:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1784290380.077204:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24585be800/0x5953bbf6b3074ad7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ade expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.077219:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24585be800/0x5953bbf6b3074ad7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ade expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290380.077225:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784290380.077227:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c23452c5000 from 7 10000000:01000000:2.0:1784290380.077228:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784290380.077242:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24585bfc00/0x5953bbf6b3074ae5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.077247:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24585bfc00/0x5953bbf6b3074ae5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.077252:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24585bfc00/0x5953bbf6b3074ae5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290380.077263:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901109120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.077288:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290380.077309:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b279300 going to sleep for 11 seconds 00000100:00100000:0.0:1784290380.077310:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901109120 00000100:00100000:0.0:1784290380.077315:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901109120 00000100:00100000:0.0:1784290380.077366:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784290380.077375:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:6485:x1870961901109120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290380.077382:0:92149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290380.077390:0:92149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246dd27a00/0x5953bbf6b3074aec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074ae5 expref: -99 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.077401:0:92149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd27a00/0x5953bbf6b3074aec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074ae5 expref: 16 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.077407:0:92149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246dd27a00/0x5953bbf6b3074aec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074ae5 expref: 16 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.077412:0:92149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27a00, rc 0) 00000100:00100000:0.0:1784290380.077458:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901109120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290380.077468:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901109120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784290380.077482:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1784290380.077485:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24585bfc00/0x5953bbf6b3074ae5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074aec expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.077493:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24585bfc00/0x5953bbf6b3074ae5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074aec expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290380.077529:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901109248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.077553:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290380.077580:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b279300 going to sleep for 11 seconds 00000100:00100000:2.0:1784290380.077592:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901109248 00000100:00100000:2.0:1784290380.077595:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901109248 00000100:00100000:2.0:1784290380.077615:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784290380.077620:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901109248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.077675:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901109248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 55us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290380.077680:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784290380.077704:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901109248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.077723:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901109376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.077753:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290380.077763:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b279300 going to sleep for 11 seconds 00000100:00100000:2.0:1784290380.077773:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901109376 00000100:00100000:2.0:1784290380.077775:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901109376 00000100:00100000:2.0:1784290380.077794:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784290380.077799:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901109376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.077854:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901109376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290380.077858:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784290380.077889:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901109376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784290380.078510:0:92339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784290380.078580:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784290380.078615:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784290380.078622:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24585bfc00/0x5953bbf6b3074ae5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074aec expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.078633:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24585bfc00/0x5953bbf6b3074ae5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074aec expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290380.078644:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784290380.078647:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c246ff27800 from 52 10000000:01000000:3.0:1784290380.078650:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784290380.078670:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247c263c00/0x5953bbf6b3074af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.078679:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247c263c00/0x5953bbf6b3074af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.078689:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247c263c00/0x5953bbf6b3074af3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290380.078705:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901109504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290380.078743:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290380.078777:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901109504 00000100:00100000:3.0:1784290380.078779:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784290380.078784:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901109504 00000100:00100000:2.0:1784290380.078828:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784290380.078839:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901109504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290380.078848:0:92151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290380.078868:0:92151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c24585be400/0x5953bbf6b3074afa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074af3 expref: -99 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.078887:0:92151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c24585be400/0x5953bbf6b3074afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074af3 expref: 17 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.078898:0:92151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c24585be400/0x5953bbf6b3074afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074af3 expref: 17 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.078906:0:92151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24585be400, rc 0) 00000100:00100000:2.0:1784290380.078959:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901109504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290380.078970:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784290380.078980:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901109504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290380.079002:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247c263c00/0x5953bbf6b3074af3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074afa expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.079010:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247c263c00/0x5953bbf6b3074af3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074afa expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290380.079055:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901109632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290380.079091:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290380.079106:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784290380.079122:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901109632 00000100:00100000:2.0:1784290380.079129:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901109632 00000100:00100000:2.0:1784290380.079167:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784290380.079180:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901109632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.079285:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901109632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290380.079296:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784290380.079302:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901109632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290380.079336:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901109760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290380.079414:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290380.079472:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784290380.079496:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901109760 00000100:00100000:3.0:1784290380.079501:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901109760 00000100:00100000:3.0:1784290380.079538:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784290380.079549:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901109760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290380.079636:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901109760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290380.079647:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784290380.079657:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d01880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901109760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784290380.080554:0:92340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1784290380.080615:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1784290380.080643:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290380.080648:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247c263c00/0x5953bbf6b3074af3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074afa expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.080655:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247c263c00/0x5953bbf6b3074af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074afa expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290380.080669:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1784290380.080671:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1784290380.080673:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784290380.080687:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247c262000/0x5953bbf6b3074b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.080693:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247c262000/0x5953bbf6b3074b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.080699:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247c262000/0x5953bbf6b3074b01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290380.080710:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901109888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290380.080747:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290380.080784:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901109888 00000100:00100000:2.0:1784290380.080790:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901109888 00000100:00100000:3.0:1784290380.080794:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784290380.080825:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784290380.080836:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901109888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290380.080845:0:92149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290380.080856:0:92149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c24585bfa00/0x5953bbf6b3074b08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074b01 expref: -99 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.080881:0:92149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c24585bfa00/0x5953bbf6b3074b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074b01 expref: 18 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.080892:0:92149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c24585bfa00/0x5953bbf6b3074b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074b01 expref: 18 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.080900:0:92149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24585bfa00, rc 0) 00000100:00100000:2.0:1784290380.080940:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901109888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290380.080949:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784290380.080969:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901109888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290380.080981:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247c262000/0x5953bbf6b3074b01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074b08 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.080987:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247c262000/0x5953bbf6b3074b01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074b08 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290380.081020:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901110016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290380.081044:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290380.081059:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784290380.081071:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901110016 00000100:00100000:2.0:1784290380.081076:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901110016 00000100:00100000:2.0:1784290380.081109:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784290380.081120:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901110016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.081218:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901110016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290380.081227:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784290380.081232:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901110016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290380.081270:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901110144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290380.081318:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290380.081335:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784290380.081369:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901110144 00000100:00100000:2.0:1784290380.081375:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901110144 00000100:00100000:2.0:1784290380.081414:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784290380.081423:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901110144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.081873:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901110144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 450us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290380.081883:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784290380.081902:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901110144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784290380.082758:0:92341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1784290380.082844:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1784290380.082884:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784290380.082903:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247c262000/0x5953bbf6b3074b01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074b08 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.082916:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247c262000/0x5953bbf6b3074b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074b08 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290380.082927:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784290380.082931:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c246ff27800 from 7 10000000:01000000:2.0:1784290380.082935:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784290380.082958:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24585be600/0x5953bbf6b3074b0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.082969:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24585be600/0x5953bbf6b3074b0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.082981:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24585be600/0x5953bbf6b3074b0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290380.083002:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901110272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.083043:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290380.083088:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e78000 going to sleep for 11 seconds 00000100:00100000:3.0:1784290380.083100:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901110272 00000100:00100000:3.0:1784290380.083108:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901110272 00000100:00100000:3.0:1784290380.083155:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784290380.083166:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901110272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290380.083175:0:92152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290380.083185:0:92152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247c263400/0x5953bbf6b3074b16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074b0f expref: -99 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.083201:0:92152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247c263400/0x5953bbf6b3074b16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074b0f expref: 19 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.083211:0:92152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247c263400/0x5953bbf6b3074b16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074b0f expref: 19 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.083218:0:92152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247c263400, rc 0) 00000100:00100000:3.0:1784290380.083272:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901110272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290380.083278:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784290380.083310:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901110272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290380.083326:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24585be600/0x5953bbf6b3074b0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074b16 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.083336:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24585be600/0x5953bbf6b3074b0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074b16 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290380.083410:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901110400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.083472:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290380.083499:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e78000 going to sleep for 11 seconds 00000100:00100000:2.0:1784290380.083515:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901110400 00000100:00100000:2.0:1784290380.083519:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901110400 00000100:00100000:2.0:1784290380.083555:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784290380.083564:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901110400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.083637:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901110400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290380.083646:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784290380.083668:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901110400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290380.083694:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901110528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290380.083729:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290380.083749:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784290380.083758:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901110528 00000100:00100000:2.0:1784290380.083764:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901110528 00000100:00100000:2.0:1784290380.083805:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784290380.083817:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901110528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.083895:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901110528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290380.083904:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784290380.083914:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901110528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784290380.084776:0:92342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784290380.084853:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784290380.084875:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784290380.084882:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24585be600/0x5953bbf6b3074b0f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074b16 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.084893:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24585be600/0x5953bbf6b3074b0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074b16 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290380.084901:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784290380.084904:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c247d3d2000 from 52 10000000:01000000:0.0:1784290380.084906:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784290380.084924:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246dd26600/0x5953bbf6b3074b1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.084932:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c246dd26600/0x5953bbf6b3074b1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.084941:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c246dd26600/0x5953bbf6b3074b1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290380.084958:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901110656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784290380.084995:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290380.085037:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c1050c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290380.085046:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901110656 00000100:00100000:2.0:1784290380.085053:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901110656 00000100:00100000:2.0:1784290380.085103:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784290380.085115:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901110656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290380.085124:0:92154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290380.085134:0:92154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c24585bec00/0x5953bbf6b3074b24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074b1d expref: -99 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.085150:0:92154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c24585bec00/0x5953bbf6b3074b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074b1d expref: 20 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.085175:0:92154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c24585bec00/0x5953bbf6b3074b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074b1d expref: 20 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.085183:0:92154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24585bec00, rc 0) 00000100:00100000:2.0:1784290380.085232:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901110656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290380.085242:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784290380.085245:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901110656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290380.085262:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c246dd26600/0x5953bbf6b3074b1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074b24 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.085269:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c246dd26600/0x5953bbf6b3074b1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074b24 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290380.085314:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901110784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290380.085367:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290380.085394:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901110784 00000100:00100000:3.0:1784290380.085400:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901110784 00000100:00100000:0.0:1784290380.085410:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c1050c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290380.085436:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784290380.085443:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901110784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290380.085577:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901110784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290380.085586:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784290380.085596:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901110784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.085634:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901110912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.085685:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290380.085708:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344dd4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290380.085716:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901110912 00000100:00100000:0.0:1784290380.085723:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901110912 00000100:00100000:0.0:1784290380.085755:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784290380.085762:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901110912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290380.085827:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901110912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290380.085833:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784290380.085849:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901110912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784290380.086535:0:92343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1784290380.086593:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1784290380.086622:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784290380.086628:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246dd26600/0x5953bbf6b3074b1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074b24 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290380.086636:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c246dd26600/0x5953bbf6b3074b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074b24 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290380.086652:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1784290380.086654:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1784290380.086656:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784290380.086670:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3074b2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290380.086678:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3074b2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290380.086688:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3074b2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290380.086704:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901111040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290380.086745:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290380.086771:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246d46a000 going to sleep for 11 seconds 00000100:00100000:3.0:1784290380.086778:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901111040 00000100:00100000:3.0:1784290380.086783:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901111040 00000100:00100000:3.0:1784290380.086810:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784290380.086816:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901111040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290380.086823:0:92152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290380.086829:0:92152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247c263a00/0x5953bbf6b3074b32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074b2b expref: -99 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.086843:0:92152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247c263a00/0x5953bbf6b3074b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074b2b expref: 21 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.086852:0:92152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247c263a00/0x5953bbf6b3074b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074b2b expref: 21 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.086860:0:92152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247c263a00, rc 0) 00000100:00100000:3.0:1784290380.086901:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901111040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290380.086909:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784290380.086932:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901111040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290380.086949:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3074b2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074b32 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290380.086959:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3074b2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074b32 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290380.087009:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901111168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290380.087035:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290380.087051:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246d46a000 going to sleep for 11 seconds 00000100:00100000:2.0:1784290380.087067:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901111168 00000100:00100000:2.0:1784290380.087072:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901111168 00000100:00100000:2.0:1784290380.087097:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1784290380.087104:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901111168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.087198:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901111168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290380.087206:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784290380.087233:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901111168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290380.087263:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901111296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290380.087299:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290380.087314:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246d46a000 going to sleep for 11 seconds 00000100:00100000:2.0:1784290380.087319:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901111296 00000100:00100000:2.0:1784290380.087323:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901111296 00000100:00100000:2.0:1784290380.087369:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784290380.087375:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901111296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.087743:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901111296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 367us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290380.087750:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784290380.087779:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901111296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784290380.088720:0:92345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1784290380.088783:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1784290380.088802:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1784290380.088807:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3074b2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074b32 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.088816:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3074b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074b32 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290380.088823:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784290380.088824:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c247d3d2000 from 7 10000000:01000000:0.0:1784290380.088827:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784290380.088841:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246dd26c00/0x5953bbf6b3074b39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.088848:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c246dd26c00/0x5953bbf6b3074b39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.088858:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c246dd26c00/0x5953bbf6b3074b39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290380.088884:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a541c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901111424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784290380.088922:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290380.088952:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c1050c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290380.088970:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901111424 00000100:00100000:0.0:1784290380.088975:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901111424 00000100:00100000:0.0:1784290380.089016:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784290380.089027:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901111424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290380.089036:0:92149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290380.089047:0:92149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246dd27600/0x5953bbf6b3074b40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074b39 expref: -99 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.089064:0:92149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd27600/0x5953bbf6b3074b40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074b39 expref: 22 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.089076:0:92149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246dd27600/0x5953bbf6b3074b40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074b39 expref: 22 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.089084:0:92149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27600, rc 0) 00000100:00100000:0.0:1784290380.089133:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901111424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290380.089143:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784290380.089146:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a541c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901111424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290380.089161:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c246dd26c00/0x5953bbf6b3074b39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074b40 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290380.089175:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c246dd26c00/0x5953bbf6b3074b39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074b40 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290380.089216:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901111552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290380.089258:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290380.089302:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23432763c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290380.089346:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901111552 00000100:00100000:0.0:1784290380.089391:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901111552 00000100:00100000:0.0:1784290380.089433:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784290380.089443:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901111552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290380.089557:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901111552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290380.089565:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901111552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290380.089580:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784290380.089594:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901111680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290380.089628:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290380.089655:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246d46aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1784290380.089656:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901111680 00000100:00100000:0.0:1784290380.089662:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901111680 00000100:00100000:0.0:1784290380.089691:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784290380.089699:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901111680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290380.089761:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901111680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290380.089766:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784290380.089793:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901111680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784290380.090684:0:92348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1784290380.090758:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1784290380.090782:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784290380.090788:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246dd26c00/0x5953bbf6b3074b39 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074b40 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.090796:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c246dd26c00/0x5953bbf6b3074b39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074b40 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290380.090804:0:6485:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1784290380.090806:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9c2480260000 from 1 10000000:01000000:2.0:1784290380.090808:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784290380.090826:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24585bf200/0x5953bbf6b3074b47 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.090832:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24585bf200/0x5953bbf6b3074b47 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.090838:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24585bf200/0x5953bbf6b3074b47 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290380.090849:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901111808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.090880:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290380.090914:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2449b9c540 going to sleep for 11 seconds 00000100:00100000:0.0:1784290380.090962:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901111808 00000100:00100000:0.0:1784290380.090969:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901111808 00000100:00100000:0.0:1784290380.091013:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784290380.091024:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901111808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290380.091031:0:92151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290380.091042:0:92151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246dd27400/0x5953bbf6b3074b4e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074b47 expref: -99 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.091056:0:92151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd27400/0x5953bbf6b3074b4e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074b47 expref: 23 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.091064:0:92151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246dd27400/0x5953bbf6b3074b4e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074b47 expref: 23 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.091071:0:92151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27400, rc 0) 00000100:00100000:0.0:1784290380.091112:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901111808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290380.091118:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784290380.091141:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901111808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290380.091157:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24585bf200/0x5953bbf6b3074b47 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074b4e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.091176:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24585bf200/0x5953bbf6b3074b47 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074b4e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290380.091195:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784290380.091200:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24585bf200/0x5953bbf6b3074b47 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074b4e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.091206:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24585bf200/0x5953bbf6b3074b47 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074b4e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290380.091211:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784290380.091213:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9c2480260000 from 1 10000000:01000000:2.0:1784290380.091214:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784290380.091227:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24585be000/0x5953bbf6b3074b55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.091233:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24585be000/0x5953bbf6b3074b55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.091239:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24585be000/0x5953bbf6b3074b55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290380.091250:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901111936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.091278:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290380.091300:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2449b9c540 going to sleep for 11 seconds 00000100:00100000:0.0:1784290380.091325:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901111936 00000100:00100000:0.0:1784290380.091337:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901111936 00000100:00100000:0.0:1784290380.091395:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784290380.091402:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901111936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290380.091408:0:92154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290380.091416:0:92154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b3074b5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074b55 expref: -99 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.091430:0:92154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b3074b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074b55 expref: 24 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.091436:0:92154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b3074b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074b55 expref: 24 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290380.091442:0:92154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27c00, rc 0) 00000100:00100000:0.0:1784290380.091493:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901111936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290380.091499:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784290380.091518:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901111936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290380.091530:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24585be000/0x5953bbf6b3074b55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074b5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.091548:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24585be000/0x5953bbf6b3074b55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074b5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290380.091603:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901112064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290380.091637:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290380.091663:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2449b9c540 going to sleep for 11 seconds 00000100:00100000:1.0:1784290380.091673:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901112064 00000100:00100000:1.0:1784290380.091680:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901112064 00000100:00100000:1.0:1784290380.091732:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784290380.091745:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901112064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290380.091813:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901112064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (176us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784290380.091820:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784290380.091845:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901112064:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1784290380.091880:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784290380.091884:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24585be000/0x5953bbf6b3074b55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074b5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290380.091890:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24585be000/0x5953bbf6b3074b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074b5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290380.315413:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290380.315458:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290380.315486:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290380.315493:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896253824 00000100:00100000:0.0:1784290380.315505:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896253824 00000100:00100000:3.0:1784290380.315508:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896253952 00000100:00100000:2.0:1784290380.315509:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290380.315516:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896253952 00000100:00100000:2.0:1784290380.315536:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290380.315554:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896254080 00000100:00100000:3.0:1784290380.315558:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896254080 00000100:00100000:0.0:1784290380.315567:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:2.0:1784290380.315568:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896254336 00000100:00100000:2.0:1784290380.315574:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896254336 00000100:00100000:0.0:1784290380.315580:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2397:x1870961896253824:12345-192.168.202.6@tcp:400:kworker.0 00000020:00080000:0.0:1784290380.315591:0:92149:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.6@tcp 00000100:00100000:3.0:1784290380.315602:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 716 00000100:00100000:3.0:1784290380.315613:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2396:x1870961896254080:12345-192.168.202.6@tcp:38:kworker.0 00000100:00100000:2.0:1784290380.315614:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896254208 00000100:00100000:2.0:1784290380.315619:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896254208 00010000:02000400:3.0:1784290380.315641:0:65990:0:(ldlm_lib.c:964:target_handle_reconnect()) lustre-MDT0001: Client 711f3c77-e791-4aa8-86ee-bc854fd0bcc5 (at 192.168.202.6@tcp) reconnecting 00000100:00100000:2.0:1784290380.315659:0:26262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1589 00000100:00100000:0.0:1784290380.315660:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2397:x1870961896253824:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 74us (247us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784290380.315669:0:26262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2397:x1870961896254336:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290380.315677:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 60 00000100:00100000:2.0:1784290380.315712:0:26262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2397:x1870961896254336:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 47us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290380.315726:0:26262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1589 00000100:00100000:0.0:1784290380.315730:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1215 00000100:00100000:0.0:1784290380.315737:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2396:x1870961896253952:12345-192.168.202.6@tcp:38:kworker.0 00000100:00100000:2.0:1784290380.315745:0:26262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1590 00000100:00100000:2.0:1784290380.315753:0:26262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2398:x1870961896254208:12345-192.168.202.6@tcp:400:kworker.0 00010000:00080000:0.0:1784290380.315756:0:74876:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '711f3c77-e791-4aa8-86ee-bc854fd0bcc5' at ffff9c246dcfe000, cookie 0x5953bbf6b30749f0 00010000:00080000:0.0:1784290380.315773:0:74876:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp recovering/t0 exp ffff9c246dcfe000 cur 2121 last 1784290378 00000100:00100000:2.0:1784290380.315779:0:26262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2398:x1870961896254208:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 24us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290380.315786:0:26262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1590 00010000:02000400:0.0:1784290380.315787:0:74876:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1784290380.315798:0:74876:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000100:00080000:2.0:1784290380.315819:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00100000:0.0:1784290380.315820:0:74876:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784290380.315824:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784290380.315829:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784290380.315992:0:74876:0:(import.c:65:import_set_state_nolock()) ffff9c246d8ad800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290380.316032:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2396:x1870961896253952:12345-192.168.202.6@tcp:38:kworker.0 Request processed in 295us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290380.316038:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1215 00010000:00080000:3.0:1784290380.318856:0:65990:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from 711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp t0 exp ffff9c234687c800 cur 2121 last 1784290380 00000004:00100000:3.0:1784290380.318875:0:65990:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli 192.168.202.6@tcp supports cksum type f7, return f7 00000100:00100000:2.0:1784290380.318883:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00080000:3.0:1784290380.318921:0:65990:0:(import.c:65:import_set_state_nolock()) ffff9c2346879000 : changing import state from FULL to RECOVER 00000100:00100000:0.0:1784290380.318924:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896254464 00000100:00080000:3.0:1784290380.318928:0:65990:0:(import.c:65:import_set_state_nolock()) ffff9c2346879000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290380.318930:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896254464 00000100:00100000:0.0:1784290380.318961:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:3.0:1784290380.318967:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2396:x1870961896254080:12345-192.168.202.6@tcp:38:kworker.0 Request processed in 3356us (3458us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290380.318969:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343b49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2396:x1870961896254464:12345-192.168.202.6@tcp:250:ptlrpcd_00_00.0 00000100:00100000:3.0:1784290380.318980:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 716 00010000:00080000:0.0:1784290380.318991:0:92151:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f@192.168.202.6@tcp t0 exp 0000000000000000 cur 2121 last 0 00000020:00000080:0.0:1784290380.319015:0:92151:0:(genops.c:1406:class_connect()) connect: client fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f, cookie 0x5953bbf6b3074b63 00000100:00080000:0.0:1784290380.319129:0:92151:0:(import.c:65:import_set_state_nolock()) ffff9c2344b52000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290380.319170:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343b49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+5:2396:x1870961896254464:12345-192.168.202.6@tcp:250:ptlrpcd_00_00.0 Request processed in 202us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290380.319176:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:2.0:1784290380.320988:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290380.321041:0:65998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896251648 00000100:00100000:3.0:1784290380.321046:0:65998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896251648 00000100:00100000:3.0:1784290380.321075:0:65998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:3.0:1784290380.321082:0:65998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:70834:x1870961896251648:12345-192.168.202.6@tcp:700:cp.0 00000100:00080000:3.0:1784290380.321125:0:65998:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9c2345d02a00 x1870961901112192/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290380.321140:0:65998:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343276000 going to sleep for 0 seconds 00000100:00100000:3.0:1784290380.321522:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290380.321602:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896254720 00000100:00100000:2.0:1784290380.321608:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896254720 00000100:00100000:2.0:1784290380.321642:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1216 00000100:00100000:2.0:1784290380.321649:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2396:x1870961896254720:12345-192.168.202.6@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1784290380.321660:0:66004:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c2345d01180 x1870961896254720/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:401/0 lens 328/0 e 0 to 0 dl 1784290391 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290380.321676:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2396:x1870961896254720:12345-192.168.202.6@tcp:101:ldlm_lock_repla.0 Request processed in 29us (156us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784290380.321681:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1216 00010000:00080000:0.0:1784290380.321703:0:92177:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000001:02000400:3.0:1784290380.451837:0:92428:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1784290380.455608:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1784290380.813680:0:92480:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784290380.813990:0:92480:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1784290380.967508:0:75406:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dab4240 going to sleep for 0 seconds 00000100:00100000:1.0:1784290380.967580:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901112320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784290380.967580:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901112448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290380.967707:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290380.967768:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290380.967785:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901112320 00000100:00100000:3.0:1784290380.967798:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901112320 00000100:00100000:1.0:1784290380.967798:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901112448 00000100:00100000:1.0:1784290380.967808:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901112448 00000100:00080000:2.0:1784290380.967850:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784290380.967861:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784290380.967938:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:1.0:1784290380.967955:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:3.0:1784290380.967971:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244405aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901112320:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290380.967990:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901112448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784290380.968020:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00002000:00000024:1.0:1784290380.968024:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290380.968147:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244405aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901112320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 194us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290380.968160:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:1.0:1784290380.968172:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901112448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 187us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290380.968191:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:0.0:1784290380.968217:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901112320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784290380.968261:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901112448:0@lo:13:osp-pre-0-1.0 00000020:00000004:2.0:1784290381.193897:0:92530:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784290381.194155:0:92530:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1784290381.351450:0:65998:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343276000 going to sleep for 0 seconds 00000100:00100000:2.0:1784290381.381804:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290381.381897:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896254848 00000100:00100000:0.0:1784290381.381912:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896254848 00000100:00100000:0.0:1784290381.381997:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:0.0:1784290381.382013:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+5:70750:x1870961896254848:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290381.382033:0:92149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290381.382055:0:92149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246dd26000/0x5953bbf6b3074b6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2478 expref: -99 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290381.382106:0:92149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd26000/0x5953bbf6b3074b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2478 expref: 6 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290381.382125:0:92149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246dd26000/0x5953bbf6b3074b6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2478 expref: 6 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290381.382150:0:92149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26000, rc 0) 00000100:00100000:0.0:1784290381.382238:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+6:70750:x1870961896254848:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 228us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290381.382250:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:3.0:1784290381.383801:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290381.383856:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896254976 00000100:00100000:2.0:1784290381.383863:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896254976 00000100:00100000:2.0:1784290381.383900:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:2.0:1784290381.383906:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+6:70750:x1870961896254976:12345-192.168.202.6@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784290381.383922:0:92152:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1784290381.383939:0:92152:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784290381.383943:0:92152:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1784290381.383946:0:92152:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1784290381.383948:0:92152:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1784290381.383950:0:92152:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 120 00000100:00100000:1.0:1784290381.384967:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+6:70750:x1870961896254976:12345-192.168.202.6@tcp:256:ll_cfg_requeue.0 Request processed in 1057us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290381.384977:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:0.0:1784290381.386333:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290381.386488:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896255104 00000100:00100000:2.0:1784290381.386496:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896255104 00000100:00100000:2.0:1784290381.386568:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:2.0:1784290381.386580:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24759f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+6:70750:x1870961896255104:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290381.386609:0:92154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290381.386620:0:92154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c24585bf400/0x5953bbf6b3074b71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b247f expref: -99 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290381.386639:0:92154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c24585bf400/0x5953bbf6b3074b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b247f expref: 7 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290381.386648:0:92154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c24585bf400/0x5953bbf6b3074b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b247f expref: 7 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290381.386655:0:92154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24585bf400, rc 0) 00000100:00100000:2.0:1784290381.386692:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24759f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+7:70750:x1870961896255104:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 115us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290381.386699:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:3.0:1784290381.387784:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290381.387877:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896255232 00000100:00100000:0.0:1784290381.387887:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896255232 00000100:00100000:0.0:1784290381.387935:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:0.0:1784290381.387948:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24759f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+7:70750:x1870961896255232:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290381.388079:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24759f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70750:x1870961896255232:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 133us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290381.388086:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:3.0:1784290381.389236:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290381.389297:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896255360 00000100:00100000:0.0:1784290381.389305:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896255360 00000100:00100000:0.0:1784290381.389361:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:0.0:1784290381.389370:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24759f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70750:x1870961896255360:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290381.389492:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24759f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70750:x1870961896255360:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 122us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290381.389501:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:2.0:1784290381.392321:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290381.392449:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896255488 00000100:00100000:1.0:1784290381.392457:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896255488 00000100:00100000:1.0:1784290381.392496:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:1.0:1784290381.392504:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24759f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70750:x1870961896255488:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290381.392514:0:92152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290381.392524:0:92152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c23450ab600/0x5953bbf6b3074b78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2486 expref: -99 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290381.392543:0:92152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c23450ab600/0x5953bbf6b3074b78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2486 expref: 9 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290381.392553:0:92152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c23450ab600/0x5953bbf6b3074b78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2486 expref: 9 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290381.392560:0:92152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450ab600, rc 0) 00000100:00100000:1.0:1784290381.392596:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24759f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896255488:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 92us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290381.392603:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:3.0:1784290381.393554:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290381.393648:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896255616 00000100:00100000:2.0:1784290381.393655:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896255616 00000100:00100000:2.0:1784290381.393695:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:2.0:1784290381.393703:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24759f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896255616:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290381.393791:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24759f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896255616:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 87us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290381.393799:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:3.0:1784290381.394846:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290381.394911:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896255744 00000100:00100000:0.0:1784290381.394920:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896255744 00000100:00100000:0.0:1784290381.394959:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:0.0:1784290381.394967:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24759f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896255744:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290381.395050:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24759f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896255744:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 82us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290381.395058:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:3.0:1784290381.397564:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290381.397642:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896255872 00000100:00100000:0.0:1784290381.397652:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896255872 00000100:00100000:0.0:1784290381.397701:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:0.0:1784290381.397714:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896255872:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290381.397726:0:92149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290381.397741:0:92149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246dd26400/0x5953bbf6b3074b7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b248d expref: -99 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290381.397768:0:92149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd26400/0x5953bbf6b3074b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b248d expref: 10 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290381.397784:0:92149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246dd26400/0x5953bbf6b3074b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b248d expref: 10 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290381.397796:0:92149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26400, rc 0) 00000100:00100000:0.0:1784290381.397846:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70750:x1870961896255872:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 134us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290381.397870:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:3.0:1784290381.398782:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290381.398871:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896256000 00000100:00100000:1.0:1784290381.398878:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896256000 00000100:00100000:1.0:1784290381.398915:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:1.0:1784290381.398922:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24759f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70750:x1870961896256000:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290381.398995:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24759f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70750:x1870961896256000:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 72us (213us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784290381.399002:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 71 00010000:00010000:2.0:1784290381.479721:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290381.991508:0:75406:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dab4240 going to sleep for 0 seconds 00000100:00100000:3.0:1784290382.375496:0:65998:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343276000 going to sleep for 0 seconds 00010000:00010000:1.0:1784290382.503609:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290383.015558:0:75406:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dab4240 going to sleep for 0 seconds 00000100:00100000:3.0:1784290383.399451:0:65998:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343276000 going to sleep for 0 seconds 00010000:00010000:2.0:1784290383.527542:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290384.039613:0:75406:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dab4240 going to sleep for 0 seconds 00000100:00080000:2.0:1784290384.039621:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290384.039630:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290384.039636:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290384.039651:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290384.039673:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901112576:0@lo:400:kworker.0 00000100:00100000:0.0:1784290384.039676:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784290384.039683:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2468ad6a00 x1870961901112832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290384.039703:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901112704:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1784290384.039733:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290384.039738:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290384.039740:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290384.039746:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290384.039765:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246dee4e00 x1870961901113088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784290384.039790:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1784290384.039797:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290384.039803:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290384.039810:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1784290384.039815:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901112960:0@lo:400:kworker.0 00000100:00100000:3.0:1784290384.039818:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290384.039825:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784290384.039841:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290384.039866:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a519880 x1870961901113344/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784290384.039911:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290384.039917:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1784290384.039918:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1784290384.039928:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a51b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901113472:0@lo:400:kworker.0 00000100:00080000:2.0:1784290384.039930:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290384.039937:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784290384.039939:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901113600:0@lo:400:kworker.0 00000100:00080000:2.0:1784290384.039953:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290384.039975:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a51bb80 x1870961901113728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784290384.039992:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901112832:0@lo:38:kworker.0 00000100:00100000:3.0:1784290384.040012:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290384.040041:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901112576 00000100:00100000:0.0:1784290384.040052:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901112576 00000100:00080000:2.0:1784290384.040063:0:42926:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:1.0:1784290384.040064:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290384.040071:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00080000:2.0:1784290384.040075:0:42926:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784290384.040080:0:42926:0:(import.c:65:import_set_state_nolock()) ffff9c246dce3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1784290384.040092:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a51ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1870961901113216:0@lo:400:kworker.0 00000100:00080000:2.0:1784290384.040092:0:42926:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c246dce3000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290384.040115:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901113088:0@lo:38:kworker.0 00000100:00100000:2.0:1784290384.040127:0:42926:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a51b480 x1870961901114112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290384.040127:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784290384.040158:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3620:x1870961901112576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290384.040162:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290384.040184:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901112704 00000100:00100000:2.0:1784290384.040192:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901112704 00000100:00100000:1.0:1784290384.040228:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290384.040229:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a51a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901113984:0@lo:400:kworker.0 00000100:00100000:0.0:1784290384.040251:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3620:x1870961901112576:12345-0@lo:400:kworker.0 Request processed in 102us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290384.040261:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3831 00000100:00100000:0.0:1784290384.040270:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784290384.040279:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901113344:0@lo:38:kworker.0 00000100:00100000:2.0:1784290384.040284:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a543b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901112704:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784290384.040297:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:2.0:1784290384.040336:0:22091:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445097472 avail 1298857984 00000100:00100000:1.0:1784290384.040384:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290384.040390:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901112576:0@lo:400:kworker.0 00000100:00100000:0.0:1784290384.040434:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901112960 00000100:00100000:0.0:1784290384.040443:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901112960 00000100:00100000:3.0:1784290384.040469:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901113472 00000100:00100000:1.0:1784290384.040473:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a51bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901113728:0@lo:38:kworker.0 00000100:00100000:3.0:1784290384.040478:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901113472 00000100:00100000:2.0:1784290384.040487:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a543b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901112704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 209us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290384.040501:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3831 00000100:00100000:0.0:1784290384.040507:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901112832 00000100:00100000:0.0:1784290384.040517:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901112832 00000100:00100000:1.0:1784290384.040531:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290384.040535:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901113344 00000100:00100000:2.0:1784290384.040543:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901113344 00000100:00100000:3.0:1784290384.040546:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901113984 00000100:00100000:3.0:1784290384.040554:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901113984 00000100:00100000:1.0:1784290384.040566:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a51b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901114112:0@lo:38:kworker.0 00000100:00100000:0.0:1784290384.040574:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901113216 00000100:00100000:0.0:1784290384.040584:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901113216 00000100:00100000:2.0:1784290384.040609:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3832 00000100:00100000:1.0:1784290384.040622:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290384.040625:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1591 00000100:00100000:2.0:1784290384.040629:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901113344:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290384.040640:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901113088 00000100:00100000:0.0:1784290384.040647:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901113088 00000100:00100000:3.0:1784290384.040651:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901113472:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1784290384.040666:0:22091:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9c246dcfb800, cookie 0x5953bbf6b30749e9 00000100:00100000:0.0:1784290384.040674:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901113728 00010000:00080000:2.0:1784290384.040677:0:22091:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9c246dcfb800 cur 2125 last 1784290378 00000100:00100000:0.0:1784290384.040681:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901113728 00000004:00100000:2.0:1784290384.040705:0:22091:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1784290384.040715:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901114112 00000100:00100000:0.0:1784290384.040722:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901114112 00000100:00100000:3.0:1784290384.040729:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901113472:12345-0@lo:400:kworker.0 Request processed in 85us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290384.040732:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:3.0:1784290384.040750:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1591 00000100:00100000:1.0:1784290384.040765:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244405ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901112960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290384.040773:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1784290384.040787:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1592 00000100:00100000:0.0:1784290384.040796:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1870961901113216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290384.040805:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901113984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290384.040850:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244405ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901112960:12345-0@lo:400:kworker.0 Request processed in 96us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290384.040864:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:3.0:1784290384.040899:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901113984:12345-0@lo:400:kworker.0 Request processed in 96us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290384.040914:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:3.0:1784290384.040922:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1592 00000100:00100000:0.0:1784290384.040925:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1870961901113216:12345-0@lo:400:kworker.0 Request processed in 126us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290384.040937:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444058380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901112832:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290384.040946:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:3.0:1784290384.040977:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00010000:00080000:1.0:1784290384.040983:0:65989:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2125 last 0 00000100:00080000:2.0:1784290384.040984:0:22091:0:(import.c:65:import_set_state_nolock()) ffff9c247036a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290384.040998:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:3.0:1784290384.040999:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901113088:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290384.041011:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901113728:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1784290384.041039:0:65990:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2125 last 0 00000020:00000080:1.0:1784290384.041043:0:65989:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5953bbf6b3074b86 00010000:00080000:3.0:1784290384.041049:0:74876:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2125 last 0 00000004:00100000:1.0:1784290384.041063:0:65989:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1784290384.041085:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1870961901113344:12345-0@lo:38:kworker.0 Request processed in 458us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290384.041096:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3832 00000100:00080000:1.0:1784290384.041106:0:65989:0:(import.c:65:import_set_state_nolock()) ffff9c246ff1f000 : changing import state from RECOVER to FULL 00000020:00000080:0.0:1784290384.041119:0:65990:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5953bbf6b3074b8d 00000020:00000080:3.0:1784290384.041122:0:74876:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5953bbf6b3074b94 00000004:00100000:0.0:1784290384.041139:0:65990:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1784290384.041145:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000004:00100000:3.0:1784290384.041153:0:74876:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1784290384.041161:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901114112:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784290384.041178:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444058380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1870961901112832:12345-0@lo:38:kworker.0 Request processed in 245us (1118us total) trans 0 rc 0/0 00000100:00080000:0.0:1784290384.041186:0:65990:0:(import.c:65:import_set_state_nolock()) ffff9c23417db000 : changing import state from RECOVER to FULL 00010000:00080000:2.0:1784290384.041191:0:66008:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2125 last 0 00000100:00100000:1.0:1784290384.041196:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00080000:3.0:1784290384.041216:0:74876:0:(import.c:65:import_set_state_nolock()) ffff9c246ff64000 : changing import state from RECOVER to FULL 00000020:00000080:2.0:1784290384.041252:0:66008:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5953bbf6b3074b9b 00000100:00100000:1.0:1784290384.041266:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901112960:0@lo:400:kworker.0 00000004:00100000:2.0:1784290384.041270:0:66008:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1784290384.041278:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1870961901113728:12345-0@lo:38:kworker.0 Request processed in 264us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290384.041288:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784290384.041297:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:1.0:1784290384.041309:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901113856:0@lo:400:kworker.0 00000100:00080000:2.0:1784290384.041310:0:66008:0:(import.c:65:import_set_state_nolock()) ffff9c2470369800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784290384.041317:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1870961901113088:12345-0@lo:38:kworker.0 Request processed in 321us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290384.041336:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00010000:00080000:0.0:1784290384.041384:0:92177:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1784290384.041392:0:92177:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 111669149702 00000020:00080000:0.0:1784290384.041400:0:92177:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290384.041405:0:92177:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149702 00000020:00080000:0.0:1784290384.041436:0:92177:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290384.041440:0:92177:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149702 00000100:00100000:2.0:1784290384.041448:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1870961901114112:12345-0@lo:38:kworker.0 Request processed in 286us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290384.041458:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290384.041474:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:3.0:1784290384.041475:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a51ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1870961901113216:0@lo:400:kworker.0 00000100:00100000:0.0:1784290384.041500:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290384.041511:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a51a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901113984:0@lo:400:kworker.0 00000100:00080000:2.0:1784290384.041525:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784290384.041534:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784290384.041540:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784290384.041545:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a51b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901113472:0@lo:400:kworker.0 00000100:00100000:1.0:1784290384.041549:0:26254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901113856 00000100:00100000:1.0:1784290384.041558:0:26254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901113856 00000100:00100000:2.0:1784290384.041573:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901113600 00000100:00100000:2.0:1784290384.041582:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901113600 00000100:00100000:0.0:1784290384.041603:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901112704:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784290384.041646:0:26254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1593 00000100:00080000:3.0:1784290384.041652:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784290384.041659:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1594 00000100:00080000:3.0:1784290384.041661:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290384.041672:0:26254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901113856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290384.041680:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901113600:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1784290384.041745:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c246a51bb80 x1870961901113728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290384.041762:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 27 00000100:00100000:2.0:1784290384.041780:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901113600:12345-0@lo:400:kworker.0 Request processed in 107us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290384.041798:0:26254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901113856:12345-0@lo:400:kworker.0 Request processed in 135us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290384.041809:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1594 00000100:00100000:1.0:1784290384.041825:0:26254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1593 00000100:00100000:3.0:1784290384.041862:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901113856:0@lo:400:kworker.0 00000100:00100000:2.0:1784290384.041887:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901113600:0@lo:400:kworker.0 00000100:00080000:0.0:1784290384.042954:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9c246a51bb80 x1870961901113728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290404 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290384.042981:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784290384.042985:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784290384.042990:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1784290384.042996:0:3616:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000005c0388ce): req@ffff9c2345d02a00 x1870961901112192/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290384.043025:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a51bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901113728:0@lo:38:kworker.0 00010000:00080000:0.0:1784290384.043049:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c246a51b480 x1870961901114112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290384.043061:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 27 00000100:00080000:0.0:1784290384.043068:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784290384.043073:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784290384.043076:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dce3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784290384.043082:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a51b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901114112:0@lo:38:kworker.0 00010000:00080000:0.0:1784290384.043096:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2468ad6a00 x1870961901112832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290384.043106:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 27 00000100:00100000:3.0:1784290384.043133:0:65998:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290384.043169:0:65998:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343276000 going to sleep for 11 seconds 00000100:00100000:1.0:1784290384.043264:0:65995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901112192 00000100:00100000:1.0:1784290384.043274:0:65995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901112192 00000100:00100000:1.0:1784290384.043319:0:65995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784290384.043329:0:65995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:65998:x1870961901112192:12345-0@lo:700:mdt_seqm_0001.0 00010000:00080000:1.0:1784290384.043381:0:65995:0:(ldlm_lib.c:3211:target_queue_recovery_request()) @@@ not queueing req@ffff9c2345d03b80 x1870961901112192/t0(0) o700->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:405/0 lens 264/0 e 0 to 0 dl 1784290395 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'mdt_seqm_0001.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290384.044320:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9c2468ad6a00 x1870961901112832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290404 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290384.044329:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784290384.044333:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784290384.044337:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784290384.044374:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901112832:0@lo:38:kworker.0 00010000:00080000:0.0:1784290384.044402:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c246dee4e00 x1870961901113088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290384.044444:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 27 40000000:02000000:1.0:1784290384.045080:0:65995:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000300000400-0x0000000340000400]:1:mdt 00000100:00080000:0.0:1784290384.045716:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9c246dee4e00 x1870961901113088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290404 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290384.045725:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1784290384.045729:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1784290384.045732:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1784290384.045737:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901113088:0@lo:38:kworker.0 00000100:00080000:0.0:1784290384.045757:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 27 00000100:00080000:0.0:1784290384.045764:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1784290384.045768:0:3616:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1784290384.045771:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 111669149701 gen 3 00000100:00080000:0.0:1784290384.045774:0:3616:0:(recover.c:53:ptlrpc_replay_next()) import ffff9c246dd98000 from lustre-MDT0000_UUID committed 111669149701 last 0 00000100:00080000:0.0:1784290384.045778:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1784290384.046222:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901113344:0@lo:38:kworker.0 00010000:00080000:3.0:1784290384.046273:0:92542:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1784290384.046281:0:92542:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1784290384.046288:0:92542:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1784290384.046957:0:92542:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1784290384.047133:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901114240:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1784290384.047185:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290384.047325:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901114240 00000100:00100000:2.0:1784290384.047335:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901114240 00000100:00100000:2.0:1784290384.047470:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3833 00000100:00100000:2.0:1784290384.047490:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1870961901114240:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1784290384.047514:0:23867:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9c246a543100 x1870961901114240/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:405/0 lens 224/0 e 0 to 0 dl 1784290395 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290384.047540:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1870961901114240:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 61us (356us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784290384.047549:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3833 00000020:00080000:0.0:1784290384.047597:0:92177:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290384.047607:0:92177:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 111669149702 00010000:00080000:0.0:1784290384.047614:0:92177:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1784290384.047619:0:92177:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290384.047628:0:92177:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1784290384.047633:0:92177:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1784290384.047650:0:92177:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.6@tcp: req@ffff9c2345d01180 x1870961896254720/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:401/0 lens 328/0 e 0 to 0 dl 1784290391 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784290384.047696:0:92177:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290384.047729:0:92177:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3074ba2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b244e expref: -99 pid: 92177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.047760:0:92177:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3074ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b244e expref: 7 pid: 92177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.047781:0:92177:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3074ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b244e expref: 7 pid: 92177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.047792:0:92177:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26200, rc 0) 00010000:00080000:0.0:1784290384.047860:0:92177:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1784290384.047874:0:92177:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1784290384.050019:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290384.050154:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896256128 00000100:00100000:2.0:1784290384.050165:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896256128 00000100:00100000:2.0:1784290384.050227:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 719 00000100:00100000:2.0:1784290384.050239:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2396:x1870961896256128:12345-192.168.202.6@tcp:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1784290384.050255:0:65989:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9c2468ad6a00 x1870961896256128/t0(0) o400->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:405/0 lens 224/0 e 0 to 0 dl 1784290395 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290384.050284:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2396:x1870961896256128:12345-192.168.202.6@tcp:400:ptlrpcd_rcv.0 Request processed in 48us (270us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784290384.050294:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 719 00010000:00080000:3.0:1784290384.050332:0:92177:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1784290384.050497:0:92177:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116992 00000100:00100000:1.0:1784290384.051216:0:65995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:65998:x1870961901112192:12345-0@lo:700:mdt_seqm_0001.0 Request processed in 7884us (8082us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290384.051229:0:65995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784290384.051390:0:65998:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d02a00 pname:cluuid:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-lwp-MDT0001_UUID:65998:1870961901112192:0@lo:700:mdt_seqm_0001.0 40000000:02000000:3.0:1784290384.051438:0:65998:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000300000400-0x0000000340000400]:1:mdt] 00000001:00100000:2.0:1784290384.052642:0:92145:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 711f3c77-e791-4aa8-86ee-bc854fd0bcc5 00000001:00100000:2.0:1784290384.052651:0:92145:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1784290384.052762:0:92177:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1784290384.052811:0:92177:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1784290384.052823:0:92177:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9c246a543100 x1870961901114240/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:405/0 lens 224/0 e 0 to 0 dl 1784290395 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1784290384.052924:0:92177:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.202.6@tcp: req@ffff9c2468ad6a00 x1870961896256128/t0(0) o400->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:405/0 lens 224/0 e 0 to 0 dl 1784290395 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784290384.052973:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1784290384.052987:0:3616:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9c2345d00e00 x1870961901114240/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290400 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784290384.053005:0:3616:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9c2345d00e00 x1870961901114240/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290400 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1784290384.053006:0:92177:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1784290384.053027:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1784290384.053052:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1784290384.053061:0:3616:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000027fa51cf): req@ffff9c246a541880 x1870961901100416/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'dist_txn-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784290384.053081:0:3616:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000124aa97): req@ffff9c246d95df80 x1870961901099008/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290384.053098:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901114240:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1784290384.053198:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784290384.053213:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901114368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290384.053230:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290384.053289:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290384.053377:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901099008 00000100:00100000:2.0:1784290384.053397:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901099008 00000100:00100000:2.0:1784290384.053470:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901114368 00000100:00100000:2.0:1784290384.053475:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901114368 00000100:00100000:1.0:1784290384.053508:0:75406:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290384.053515:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3834 00000100:00100000:2.0:1784290384.053534:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:0:x1870961901099008:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784290384.053538:0:75406:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dab4240 going to sleep for 11 seconds 00000004:00000024:2.0:1784290384.053566:0:8412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444605952 avail 1298366464 00000100:00100000:1.0:1784290384.053580:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901100416 00000100:00100000:1.0:1784290384.053590:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901100416 00000100:00100000:1.0:1784290384.053640:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3835 00000100:00100000:2.0:1784290384.053649:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:0:x1870961901099008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290384.053665:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3619:x1870961901114368:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290384.053669:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3834 00000100:00100000:2.0:1784290384.053703:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3836 00000004:00000024:1.0:1784290384.053710:0:8413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444605952 avail 1298366464 00000100:00100000:2.0:1784290384.053721:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75406:x1870961901100416:12345-0@lo:1000:dist_txn-1.0 00000100:00100000:1.0:1784290384.053809:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3619:x1870961901114368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 152us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290384.053836:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3835 00000100:00100000:2.0:1784290384.053845:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75406:x1870961901100416:12345-0@lo:1000:dist_txn-1.0 Request processed in 127us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290384.053858:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3836 00000100:00100000:1.0:1784290384.053918:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901114368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290384.053936:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d95df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:0:1870961901099008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784290384.053986:0:75406:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a541880 pname:cluuid:pid:xid:nid:opc:job dist_txn-1:lustre-MDT0001-mdtlov_UUID:75406:1870961901100416:0@lo:1000:dist_txn-1.0 00000004:00080000:1.0:1784290384.054043:0:75406:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c246dab4900 with version 8 00000020:00080000:1.0:1784290384.054069:0:75406:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411372 cancel update log [0x20000c751:0x1:0x0].1: rc = 0 00000004:00080000:2.0:1784290384.054090:0:75392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9c2344dd4900 version 8 rpc_version 8 00000020:00100000:2.0:1784290384.054122:0:75392:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784290384.054134:0:75392:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c246a519880 x1870961901114624/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290384.054160:0:75392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a519880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75392:1870961901114624:0@lo:1000:osp_up0-1.0 00000020:00080000:1.0:1784290384.054175:0:75406:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411372 cancel update log [0x2400090a4:0x1:0x0].1: rc = 0 00000020:00080000:1.0:1784290384.054194:0:75406:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411372 00000100:00100000:2.0:1784290384.054207:0:75392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290384.054247:0:75392:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b235cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290384.054434:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901114624 00000100:00100000:1.0:1784290384.054445:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901114624 00000100:00100000:1.0:1784290384.054493:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3837 00000100:00100000:1.0:1784290384.054504:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a51b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:75392:x1870961901114624:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784290384.055044:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a51b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75392:x1870961901114624:12345-0@lo:1000:osp_up0-1.0 Request processed in 538us (837us total) trans 115964116993 rc 0/0 00000100:00100000:1.0:1784290384.055056:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3837 00000100:00100000:1.0:1784290384.055118:0:75392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a519880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75392:1870961901114624:0@lo:1000:osp_up0-1.0 00000001:00100000:2.0:1784290384.055462:0:75386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1784290384.058228:0:65998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:70834:x1870961896251648:12345-192.168.202.6@tcp:700:cp.0 Request processed in 3737141us (3737238us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290384.058241:0:65998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 14 00000100:00100000:3.0:1784290384.060012:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290384.060148:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896256384 00000100:00100000:1.0:1784290384.060159:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896256384 00000100:00080000:3.0:1784290384.060226:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784290384.060238:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1221 00000100:00100000:1.0:1784290384.060252:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:70834:x1870961896256384:12345-192.168.202.6@tcp:101:cp.0 00010000:00010000:1.0:1784290384.060269:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290384.060289:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab200/0x5953bbf6b3074ba9 lrc: 2/0,0 mode: --/CW res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2494 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.060470:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450abe00/0x5953bbf6b3074bb0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.060493:0:65988:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450abe00/0x5953bbf6b3074bb0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.060507:0:65988:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450abe00/0x5953bbf6b3074bb0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290384.060527:0:65988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:65988:1870961901114752:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1784290384.060572:0:65988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290384.060616:0:65988:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24803b3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784290384.060650:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901114752 00000100:00100000:2.0:1784290384.060662:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901114752 00000100:00100000:2.0:1784290384.060719:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3838 00000100:00100000:2.0:1784290384.060732:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:65988:x1870961901114752:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1784290384.060763:0:23867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290384.060783:0:23867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d400/0x5953bbf6b3074bb7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074bb0 expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.060813:0:23867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d400/0x5953bbf6b3074bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074bb0 expref: 8 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.060831:0:23867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d400/0x5953bbf6b3074bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074bb0 expref: 8 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.060842:0:23867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:2.0:1784290384.060846:0:23867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784290384.060850:0:23867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2458d5d400, rc 0) 00000100:00100000:2.0:1784290384.060911:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65988:x1870961901114752:12345-0@lo:101:mdt00_000.0 Request processed in 182us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290384.060920:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3838 00000100:00100000:1.0:1784290384.060984:0:65988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:65988:1870961901114752:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1784290384.061006:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450abe00/0x5953bbf6b3074bb0 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074bb7 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.061022:0:65988:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450abe00/0x5953bbf6b3074bb0 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074bb7 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784290384.061041:0:65988:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784290384.061050:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450abe00/0x5953bbf6b3074bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074bb7 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.061061:0:65988:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450abe00/0x5953bbf6b3074bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074bb7 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.061122:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aaa00/0x5953bbf6b3074bbe lrc: 3/0,1 mode: --/CW res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.061134:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aaa00/0x5953bbf6b3074bbe lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.061164:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aaa00/0x5953bbf6b3074bbe lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.061181:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aae00/0x5953bbf6b3074bc5 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.061191:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aae00/0x5953bbf6b3074bc5 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.061199:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aae00/0x5953bbf6b3074bc5 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290384.061378:0:65988:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:65988:1870961901114880:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784290384.061458:0:65988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290384.061489:0:65988:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e78300 going to sleep for 11 seconds 00000100:00100000:2.0:1784290384.061587:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901114880 00000100:00100000:2.0:1784290384.061598:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901114880 00000100:00100000:2.0:1784290384.061652:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3839 00000100:00100000:2.0:1784290384.061663:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65988:x1870961901114880:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1784290384.061777:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65988:x1870961901114880:12345-0@lo:1000:mdt00_000.0 Request processed in 114us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290384.061789:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3839 00000100:00100000:1.0:1784290384.061828:0:65988:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:65988:1870961901114880:0@lo:1000:mdt00_000.0 00000004:00080000:1.0:1784290384.062535:0:65988:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0xd1:0x0], count =369 00000004:00080000:1.0:1784290384.062546:0:65988:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0xd1:0x0]+369 in llog 00000004:00080000:1.0:1784290384.062568:0:65988:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x242:0x0], index 0: 0 00010000:00010000:1.0:1784290384.062780:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab800/0x5953bbf6b3074bcc lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.062794:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab800/0x5953bbf6b3074bcc lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.062805:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab800/0x5953bbf6b3074bcc lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.062844:0:65988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aaa00/0x5953bbf6b3074bbe lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.062865:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aaa00/0x5953bbf6b3074bbe lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.062873:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aaa00/0x5953bbf6b3074bbe lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.062881:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aaa00/0x5953bbf6b3074bbe lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.062888:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aaa00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290384.062894:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aaa00/0x5953bbf6b3074bbe lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.062903:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aaa00/0x5953bbf6b3074bbe lrc: 5/0,0 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.062917:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c2449fa5100) 00010000:00010000:1.0:1784290384.062920:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290384.062925:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aaa00/0x5953bbf6b3074bbe lrc: 3/0,0 mode: --/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.062934:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aaa00/0x5953bbf6b3074bbe lrc: 0/0,0 mode: --/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784290384.062949:0:65988:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000f3a1cd2 reply state 00000000a1177066 transno 81604378749 ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aae00/0x5953bbf6b3074bc5 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.062962:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aae00/0x5953bbf6b3074bc5 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.062970:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0xb1bed465 (ffff9c2475807400) 00010000:00010000:1.0:1784290384.062980:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784290384.062983:0:65988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784290384.063020:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab200/0x5953bbf6b3074ba9 lrc: 0/0,0 mode: --/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2494 expref: 10 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.063037:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab800/0x5953bbf6b3074bcc lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2494 expref: 9 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.063047:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff9c2475807f00) 00010000:00010000:1.0:1784290384.063050:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784290384.063053:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450ab800, rc 0) 00000100:00100000:1.0:1784290384.063107:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:70834:x1870961896256384:12345-192.168.202.6@tcp:101:cp.0 Request processed in 2857us (3097us total) trans 81604378749 rc 0/0 00000100:00100000:1.0:1784290384.063116:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1221 00000100:00100000:2.0:1784290384.065970:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290384.066107:0:8999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896256512 00000100:00100000:1.0:1784290384.066117:0:8999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896256512 00000100:00100000:1.0:1784290384.066195:0:8999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4954 00000100:00080000:3.0:1784290384.066208:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290384.066211:0:8999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2399:x1870961896256512:12345-192.168.202.6@tcp:101:cp.0 00010000:00010000:1.0:1784290384.066229:0:8999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290384.066249:0:8999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c14e744/0x5953bbf6b3074bda lrc: 2/0,0 mode: --/PR res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b249b expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290384.066280:0:8999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x242:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290384.066298:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:1.0:1784290384.066304:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290384.066315:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c14e744/0x5953bbf6b3074bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b249b expref: 6 pid: 8999 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.066401:0:8999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005c14e744/0x5953bbf6b3074bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b249b expref: 6 pid: 8999 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.066445:0:8999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450abc00, rc 0) 00000100:00100000:1.0:1784290384.066500:0:8999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2399:x1870961896256512:12345-192.168.202.6@tcp:101:cp.0 Request processed in 294us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290384.066510:0:8999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4954 00000100:00100000:2.0:1784290384.068690:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290384.068765:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896256640 00000100:00100000:1.0:1784290384.068777:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896256640 00000100:00100000:1.0:1784290384.068833:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4955 00000100:00100000:1.0:1784290384.068846:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:70834:x1870961896256640:12345-192.168.202.6@tcp:101:cp.0 00010000:00010000:1.0:1784290384.068862:0:26252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290384.068879:0:26252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074be1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b24a2 expref: -99 pid: 26252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.068908:0:26252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c14e744/0x5953bbf6b3074bda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b249b expref: 7 pid: 8999 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.068920:0:26252:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290384.068925:0:26252:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290384.068932:0:26252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074be1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24a2 expref: 7 pid: 26252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.068963:0:26252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c14e744/0x5953bbf6b3074bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b249b expref: 7 pid: 8999 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.068995:0:26252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c14e744/0x5953bbf6b3074bda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b249b expref: 7 pid: 8999 timeout: 2225 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290384.069011:0:26252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:26252:1870961901115008:192.168.202.6@tcp:104: 00000100:00100000:1.0:1784290384.069091:0:26252:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e78300 going to sleep for 11 seconds 00000100:00100000:1.0:1784290384.070792:0:26252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:26252:1870961901115008:192.168.202.6@tcp:104: 00010000:00010000:1.0:1784290384.070820:0:26252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074be1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24a2 expref: 7 pid: 26252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.070840:0:26252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8ca000, rc 0) 00000100:00100000:1.0:1784290384.070898:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:70834:x1870961896256640:12345-192.168.202.6@tcp:101:cp.0 Request processed in 2054us (2211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290384.070908:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4955 00000100:00100000:2.0:1784290384.071464:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290384.071539:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896256768 00000100:00100000:3.0:1784290384.071550:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896256768 00010000:00010000:3.0:1784290384.071583:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c14e744/0x5953bbf6b3074bda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b249b expref: 7 pid: 8999 timeout: 2225 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290384.071630:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2586 00000100:00100000:3.0:1784290384.071644:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245818e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2399:x1870961896256768:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784290384.071666:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290384.071693:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c14e744/0x5953bbf6b3074bda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b249b expref: 7 pid: 8999 timeout: 2225 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.071720:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c14e744/0x5953bbf6b3074bda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b249b expref: 7 pid: 8999 timeout: 2225 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.071752:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c14e744/0x5953bbf6b3074bda lrc: 0/0,0 mode: --/PR res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b249b expref: 7 pid: 8999 timeout: 2225 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.071776:0:6473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.071782:0:6473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.071791:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074be1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24a2 expref: 6 pid: 26252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.071818:0:6473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074be1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24a2 expref: 6 pid: 26252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.071854:0:6473:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074be1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24a2 expref: 6 pid: 26252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290384.071869:0:6473:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6473:1870961901115136:192.168.202.6@tcp:105: 00000100:00100000:3.0:1784290384.071938:0:6473:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dac6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784290384.073753:0:6473:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6473:1870961901115136:192.168.202.6@tcp:105: 00010000:00010000:3.0:1784290384.073773:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784290384.073822:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245818e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2399:x1870961896256768:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 2182us (2363us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290384.073832:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2586 00000100:00100000:2.0:1784290384.074443:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290384.074506:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896257024 00000100:00100000:3.0:1784290384.074515:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896257024 00000100:00100000:3.0:1784290384.074563:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 228 00000100:00100000:3.0:1784290384.074572:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:70834:x1870961896257024:12345-192.168.202.6@tcp:35:cp.0 00000001:00080000:3.0:1784290384.074814:0:65992:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 81604378750 00000100:00100000:3.0:1784290384.074920:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+12:70834:x1870961896257024:12345-192.168.202.6@tcp:35:cp.0 Request processed in 347us (509us total) trans 81604378751 rc 0/0 00000100:00100000:3.0:1784290384.074931:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 228 00000020:00080000:3.0:1784290384.074936:0:65992:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000004:00000080:0.0:1784290384.075594:0:92177:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae5447873e10 00100000:10000000:0.0:1784290384.075612:0:92177:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1784290384.076094:0:92163:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x703:0x0] 00000004:00080000:1.0:1784290384.076137:0:92165:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x702:0x0] 00000100:00100000:2.0:1784290384.076144:0:92163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a51a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92163:1870961901115264:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1784290384.076192:0:92165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92165:1870961901115392:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1784290384.076211:0:92163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290384.076269:0:92163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b235d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784290384.076271:0:92165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290384.076309:0:26251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901115264 00000100:00100000:0.0:1784290384.076319:0:26251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901115264 00000100:00100000:1.0:1784290384.076338:0:92165:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e78300 going to sleep for 11 seconds 00000100:00100000:2.0:1784290384.076378:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901115392 00000100:00100000:2.0:1784290384.076388:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901115392 00000100:00100000:2.0:1784290384.076486:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4956 00000100:00100000:2.0:1784290384.076508:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:92165:x1870961901115392:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1784290384.076544:0:9000:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1857 -> diff = -63 00002000:02000040:2.0:1784290384.076552:0:9000:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1795 to 0x2c0000401:1857) 00000100:00100000:0.0:1784290384.076566:0:26251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4957 00000100:00100000:0.0:1784290384.076598:0:26251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:92163:x1870961901115264:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1784290384.076650:0:26251:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1857 -> diff = -62 00002000:02000040:0.0:1784290384.076656:0:26251:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1796 to 0x280000401:1857) 00000100:00100000:3.0:1784290384.083496:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290384.083565:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896257152 00000100:00100000:1.0:1784290384.083579:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896257152 00000100:00100000:1.0:1784290384.083657:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1222 00000100:00100000:1.0:1784290384.083679:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:71098:x1870961896257152:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:1.0:1784290384.083701:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290384.083722:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb600/0x5953bbf6b3074be8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b24a9 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290384.083821:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x741:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.083835:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043eec9cd/0x5953bbf6b3074bef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.083852:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x741:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:2.0:1784290384.083858:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290384.083864:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043eec9cd/0x5953bbf6b3074bef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.083885:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043eec9cd/0x5953bbf6b3074bef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.083897:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043eec9cd/0x5953bbf6b3074bef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.083909:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043eec9cd/0x5953bbf6b3074bef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.083959:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290384.083978:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290384.084003:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043eec9cd/0x5953bbf6b3074bef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.084019:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5d800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290384.084027:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043eec9cd/0x5953bbf6b3074bef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.084043:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043eec9cd/0x5953bbf6b3074bef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.084065:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043eec9cd/0x5953bbf6b3074bef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.084076:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043eec9cd/0x5953bbf6b3074bef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290384.084097:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x740:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290384.084105:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.084111:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006320ca05/0x5953bbf6b3074bf6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.084113:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.084119:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.084133:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x740:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:2.0:1784290384.084139:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290384.084145:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006320ca05/0x5953bbf6b3074bf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.084160:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006320ca05/0x5953bbf6b3074bf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.084171:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006320ca05/0x5953bbf6b3074bf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.084181:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006320ca05/0x5953bbf6b3074bf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.084212:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.084276:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.084285:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006320ca05/0x5953bbf6b3074bf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.084295:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5d200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.084314:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006320ca05/0x5953bbf6b3074bf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.084326:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006320ca05/0x5953bbf6b3074bf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.084401:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006320ca05/0x5953bbf6b3074bf6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.084439:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006320ca05/0x5953bbf6b3074bf6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.084464:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.084467:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.084470:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784290384.084597:0:66008:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 813us 00002000:00010000:2.0:1784290384.084741:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.084750:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b76a8d4/0x5953bbf6b3074bfd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.084763:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73f:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:2.0:1784290384.084767:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290384.084774:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b76a8d4/0x5953bbf6b3074bfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.084787:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b76a8d4/0x5953bbf6b3074bfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.084819:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b76a8d4/0x5953bbf6b3074bfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.084829:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b76a8d4/0x5953bbf6b3074bfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.084853:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.084868:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.084876:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b76a8d4/0x5953bbf6b3074bfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.084887:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5d600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.084892:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b76a8d4/0x5953bbf6b3074bfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.084903:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b76a8d4/0x5953bbf6b3074bfd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.084922:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b76a8d4/0x5953bbf6b3074bfd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.084932:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b76a8d4/0x5953bbf6b3074bfd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.084953:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.084965:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.084968:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784290384.085036:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290384.085048:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076188843/0x5953bbf6b3074c04 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.085063:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73e:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.085069:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.085076:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076188843/0x5953bbf6b3074c04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.085136:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076188843/0x5953bbf6b3074c04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.085149:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076188843/0x5953bbf6b3074c04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.085160:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076188843/0x5953bbf6b3074c04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.085223:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.085256:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.085266:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076188843/0x5953bbf6b3074c04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.085278:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c263800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.085285:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076188843/0x5953bbf6b3074c04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.085297:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076188843/0x5953bbf6b3074c04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.085317:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076188843/0x5953bbf6b3074c04 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.085328:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076188843/0x5953bbf6b3074c04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.085389:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.085395:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.085402:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784290384.085497:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290384.085507:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038a702d0/0x5953bbf6b3074c0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.085520:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73d:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.085524:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.085529:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038a702d0/0x5953bbf6b3074c0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.085543:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038a702d0/0x5953bbf6b3074c0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.085554:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038a702d0/0x5953bbf6b3074c0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.085583:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038a702d0/0x5953bbf6b3074c0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.085608:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.085636:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.085647:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038a702d0/0x5953bbf6b3074c0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.085658:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c263000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.085665:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038a702d0/0x5953bbf6b3074c0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.085691:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038a702d0/0x5953bbf6b3074c0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.085710:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038a702d0/0x5953bbf6b3074c0b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.085721:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038a702d0/0x5953bbf6b3074c0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.085741:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.085744:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.085747:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784290384.085776:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290384.085786:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000281ab7d5/0x5953bbf6b3074c12 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.085798:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73c:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.085839:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.085847:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000281ab7d5/0x5953bbf6b3074c12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.085862:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000281ab7d5/0x5953bbf6b3074c12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.085875:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000281ab7d5/0x5953bbf6b3074c12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.085885:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000281ab7d5/0x5953bbf6b3074c12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1784290384.085899:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1784290384.085910:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290384.085926:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290384.085933:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000281ab7d5/0x5953bbf6b3074c12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.085955:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c262400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290384.085961:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000281ab7d5/0x5953bbf6b3074c12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.085973:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000281ab7d5/0x5953bbf6b3074c12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.085990:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000281ab7d5/0x5953bbf6b3074c12 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.086001:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000281ab7d5/0x5953bbf6b3074c12 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.086025:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.086028:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.086030:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1784290384.086098:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290384.086106:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e858fe5e/0x5953bbf6b3074c19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.086118:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73b:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.086123:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.086129:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e858fe5e/0x5953bbf6b3074c19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.086143:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e858fe5e/0x5953bbf6b3074c19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.086165:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e858fe5e/0x5953bbf6b3074c19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.086176:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e858fe5e/0x5953bbf6b3074c19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.086201:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1784290384.086258:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x73a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290384.086267:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d00d8ec4/0x5953bbf6b3074c20 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.086278:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290384.086279:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73a:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.086292:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x73a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290384.086294:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e858fe5e/0x5953bbf6b3074c19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.086300:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d00d8ec4/0x5953bbf6b3074c20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.086322:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c262200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.086332:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e858fe5e/0x5953bbf6b3074c19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.086334:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d00d8ec4/0x5953bbf6b3074c20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.086381:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e858fe5e/0x5953bbf6b3074c19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.086441:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d00d8ec4/0x5953bbf6b3074c20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.086449:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e858fe5e/0x5953bbf6b3074c19 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.086458:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d00d8ec4/0x5953bbf6b3074c20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.086512:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e858fe5e/0x5953bbf6b3074c19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.086573:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.086573:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.086584:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d00d8ec4/0x5953bbf6b3074c20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.086596:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c262a00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.086602:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d00d8ec4/0x5953bbf6b3074c20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.086615:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d00d8ec4/0x5953bbf6b3074c20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.086630:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d00d8ec4/0x5953bbf6b3074c20 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.086639:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d00d8ec4/0x5953bbf6b3074c20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.086646:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x739:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.086657:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.086661:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d746d73/0x5953bbf6b3074c27 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.086663:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.086670:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.086681:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.086689:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x739:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.086698:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x739:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.086708:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d746d73/0x5953bbf6b3074c27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.086729:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d746d73/0x5953bbf6b3074c27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.086746:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d746d73/0x5953bbf6b3074c27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.086756:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d746d73/0x5953bbf6b3074c27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.086781:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.086806:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.086815:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d746d73/0x5953bbf6b3074c27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.086837:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c262e00 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:3.0:1784290384.086838:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x738:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.086843:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d746d73/0x5953bbf6b3074c27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.086849:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7f3cfe4/0x5953bbf6b3074c2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.086862:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d746d73/0x5953bbf6b3074c27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.086868:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x738:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:2.0:1784290384.086884:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d746d73/0x5953bbf6b3074c27 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.086886:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x738:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.086904:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f3cfe4/0x5953bbf6b3074c2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.086908:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d746d73/0x5953bbf6b3074c27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.086946:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7f3cfe4/0x5953bbf6b3074c2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.086955:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.086961:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.086963:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7f3cfe4/0x5953bbf6b3074c2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.086965:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.086979:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7f3cfe4/0x5953bbf6b3074c2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.087000:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.087010:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.087019:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7f3cfe4/0x5953bbf6b3074c2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087030:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c262600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.087035:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f3cfe4/0x5953bbf6b3074c2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087045:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7f3cfe4/0x5953bbf6b3074c2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.087060:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x737:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290384.087072:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099bb238c/0x5953bbf6b3074c35 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087076:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7f3cfe4/0x5953bbf6b3074c2e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.087087:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x737:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:2.0:1784290384.087098:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7f3cfe4/0x5953bbf6b3074c2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.087099:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.087114:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099bb238c/0x5953bbf6b3074c35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.087129:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099bb238c/0x5953bbf6b3074c35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087130:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.087138:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.087145:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099bb238c/0x5953bbf6b3074c35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087148:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.087170:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099bb238c/0x5953bbf6b3074c35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.087192:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.087203:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.087211:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099bb238c/0x5953bbf6b3074c35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087221:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c262c00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.087226:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099bb238c/0x5953bbf6b3074c35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087238:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099bb238c/0x5953bbf6b3074c35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087252:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099bb238c/0x5953bbf6b3074c35 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087261:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099bb238c/0x5953bbf6b3074c35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.087270:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x736:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290384.087282:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87c3db2/0x5953bbf6b3074c3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.087310:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x736:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.087315:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.087321:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f87c3db2/0x5953bbf6b3074c3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087333:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.087336:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f87c3db2/0x5953bbf6b3074c3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087370:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.087377:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.087390:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87c3db2/0x5953bbf6b3074c3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.087400:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f87c3db2/0x5953bbf6b3074c3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.087445:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.087470:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.087479:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f87c3db2/0x5953bbf6b3074c3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087489:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c263e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.087495:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87c3db2/0x5953bbf6b3074c3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087506:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87c3db2/0x5953bbf6b3074c3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.087514:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x735:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.087524:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f87c3db2/0x5953bbf6b3074c3c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.087526:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fd866e1/0x5953bbf6b3074c43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087538:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f87c3db2/0x5953bbf6b3074c3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.087582:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x735:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.087589:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290384.087592:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.087596:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fd866e1/0x5953bbf6b3074c43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087599:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.087606:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.087620:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fd866e1/0x5953bbf6b3074c43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.087632:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fd866e1/0x5953bbf6b3074c43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.087644:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fd866e1/0x5953bbf6b3074c43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.087675:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.087685:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.087694:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fd866e1/0x5953bbf6b3074c43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087722:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585bfe00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.087727:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fd866e1/0x5953bbf6b3074c43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087739:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fd866e1/0x5953bbf6b3074c43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087758:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fd866e1/0x5953bbf6b3074c43 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087766:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fd866e1/0x5953bbf6b3074c43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.087768:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x734:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290384.087790:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078c85ddc/0x5953bbf6b3074c4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.087803:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x734:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.087807:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x734:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290384.087808:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.087814:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078c85ddc/0x5953bbf6b3074c4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087816:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.087826:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.087835:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078c85ddc/0x5953bbf6b3074c4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.087866:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078c85ddc/0x5953bbf6b3074c4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.087877:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078c85ddc/0x5953bbf6b3074c4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.087900:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.087910:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.087920:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078c85ddc/0x5953bbf6b3074c4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087933:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.087937:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078c85ddc/0x5953bbf6b3074c4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.087947:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078c85ddc/0x5953bbf6b3074c4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.087969:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x733:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.087976:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078c85ddc/0x5953bbf6b3074c4a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.087981:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008857b437/0x5953bbf6b3074c51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.088003:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078c85ddc/0x5953bbf6b3074c4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.088010:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x733:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.088021:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.088027:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008857b437/0x5953bbf6b3074c51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.088036:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.088041:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008857b437/0x5953bbf6b3074c51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.088042:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.088048:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.088061:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008857b437/0x5953bbf6b3074c51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.088072:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008857b437/0x5953bbf6b3074c51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.088108:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.088119:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.088128:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008857b437/0x5953bbf6b3074c51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.088141:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.088146:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008857b437/0x5953bbf6b3074c51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.088156:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008857b437/0x5953bbf6b3074c51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.088171:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x732:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.088173:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008857b437/0x5953bbf6b3074c51 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.088186:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000863234df/0x5953bbf6b3074c58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.088190:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008857b437/0x5953bbf6b3074c51 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.088215:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x732:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.088222:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.088237:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000863234df/0x5953bbf6b3074c58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.088253:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000863234df/0x5953bbf6b3074c58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.088259:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.088268:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000863234df/0x5953bbf6b3074c58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.088269:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.088276:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.088286:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000863234df/0x5953bbf6b3074c58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.088307:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.088317:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.088326:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000863234df/0x5953bbf6b3074c58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.088369:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.088375:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000863234df/0x5953bbf6b3074c58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.088389:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000863234df/0x5953bbf6b3074c58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.088426:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000863234df/0x5953bbf6b3074c58 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.088430:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x731:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.088451:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000863234df/0x5953bbf6b3074c58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.088453:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c739b56b/0x5953bbf6b3074c5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.088486:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x731:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.088500:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290384.088507:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.088508:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c739b56b/0x5953bbf6b3074c5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.088515:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.088524:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.088533:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c739b56b/0x5953bbf6b3074c5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.088547:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c739b56b/0x5953bbf6b3074c5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.088557:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c739b56b/0x5953bbf6b3074c5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.088576:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.088587:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.088596:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c739b56b/0x5953bbf6b3074c5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.088624:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.088629:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c739b56b/0x5953bbf6b3074c5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.088640:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c739b56b/0x5953bbf6b3074c5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.088643:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x730:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290384.088668:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007df1a0df/0x5953bbf6b3074c66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.088669:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c739b56b/0x5953bbf6b3074c5f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.088706:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c739b56b/0x5953bbf6b3074c5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.088712:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x730:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.088725:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290384.088733:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.088736:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007df1a0df/0x5953bbf6b3074c66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.088739:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.088746:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.088761:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007df1a0df/0x5953bbf6b3074c66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.088774:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007df1a0df/0x5953bbf6b3074c66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.088795:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007df1a0df/0x5953bbf6b3074c66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.088817:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.088828:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.088835:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007df1a0df/0x5953bbf6b3074c66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.088846:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.088851:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007df1a0df/0x5953bbf6b3074c66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.088861:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007df1a0df/0x5953bbf6b3074c66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.088886:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.088889:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007df1a0df/0x5953bbf6b3074c66 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.088898:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012850e5b/0x5953bbf6b3074c6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.088905:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007df1a0df/0x5953bbf6b3074c66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.088920:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72f:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.088926:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.088933:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012850e5b/0x5953bbf6b3074c6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.088937:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.088944:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.088951:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.088952:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012850e5b/0x5953bbf6b3074c6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.088966:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012850e5b/0x5953bbf6b3074c6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.088976:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012850e5b/0x5953bbf6b3074c6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.088996:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.089007:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.089015:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012850e5b/0x5953bbf6b3074c6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089024:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.089030:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012850e5b/0x5953bbf6b3074c6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089041:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012850e5b/0x5953bbf6b3074c6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089057:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012850e5b/0x5953bbf6b3074c6d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.089058:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290384.089080:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3074c74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089080:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012850e5b/0x5953bbf6b3074c6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.089110:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72e:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.089116:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.089123:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3074c74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089126:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.089132:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.089139:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.089143:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3074c74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.089157:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3074c74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.089167:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3074c74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.089187:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.089198:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.089206:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3074c74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089217:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9c00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.089222:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3074c74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089233:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3074c74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.089247:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.089250:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3074c74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.089258:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aa8e530/0x5953bbf6b3074c7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089264:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4f0f4f3/0x5953bbf6b3074c74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.089279:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72d:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.089286:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.089292:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aa8e530/0x5953bbf6b3074c7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089293:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.089300:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.089306:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.089313:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003aa8e530/0x5953bbf6b3074c7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.089380:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aa8e530/0x5953bbf6b3074c7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.089391:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003aa8e530/0x5953bbf6b3074c7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.089435:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.089443:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.089451:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003aa8e530/0x5953bbf6b3074c7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089482:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.089488:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003aa8e530/0x5953bbf6b3074c7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089499:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003aa8e530/0x5953bbf6b3074c7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.089500:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290384.089518:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004130a9d4/0x5953bbf6b3074c82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089529:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003aa8e530/0x5953bbf6b3074c7b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.089532:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72c:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.089548:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290384.089561:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003aa8e530/0x5953bbf6b3074c7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.089563:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004130a9d4/0x5953bbf6b3074c82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.089602:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004130a9d4/0x5953bbf6b3074c82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089609:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.089614:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004130a9d4/0x5953bbf6b3074c82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089616:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.089623:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.089633:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004130a9d4/0x5953bbf6b3074c82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.089685:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.089694:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.089701:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004130a9d4/0x5953bbf6b3074c82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089712:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.089716:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004130a9d4/0x5953bbf6b3074c82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089728:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004130a9d4/0x5953bbf6b3074c82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089755:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004130a9d4/0x5953bbf6b3074c82 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089765:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004130a9d4/0x5953bbf6b3074c82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.089771:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290384.089782:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1ce9359/0x5953bbf6b3074c89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089787:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.089794:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.089798:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72b:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:2.0:1784290384.089799:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.089809:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.089815:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1ce9359/0x5953bbf6b3074c89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.089828:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1ce9359/0x5953bbf6b3074c89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.089838:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1ce9359/0x5953bbf6b3074c89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.089847:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1ce9359/0x5953bbf6b3074c89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.089868:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.089879:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.089887:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1ce9359/0x5953bbf6b3074c89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089898:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8c00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.089903:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1ce9359/0x5953bbf6b3074c89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089913:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1ce9359/0x5953bbf6b3074c89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.089930:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x72a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.089931:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1ce9359/0x5953bbf6b3074c89 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.089950:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000949211db/0x5953bbf6b3074c90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.089953:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1ce9359/0x5953bbf6b3074c89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.089985:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72a:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.090013:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x72a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.090022:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000949211db/0x5953bbf6b3074c90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.090027:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.090034:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.090038:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000949211db/0x5953bbf6b3074c90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.090041:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.090057:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000949211db/0x5953bbf6b3074c90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090067:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000949211db/0x5953bbf6b3074c90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090090:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.090100:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.090109:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000949211db/0x5953bbf6b3074c90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.090121:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.090127:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000949211db/0x5953bbf6b3074c90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.090138:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000949211db/0x5953bbf6b3074c90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.090150:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x729:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.090153:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000949211db/0x5953bbf6b3074c90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090163:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074ee36b3/0x5953bbf6b3074c97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.090168:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000949211db/0x5953bbf6b3074c90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090192:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x729:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.090198:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x729:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.090204:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074ee36b3/0x5953bbf6b3074c97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.090206:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.090214:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.090219:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.090226:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074ee36b3/0x5953bbf6b3074c97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090239:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074ee36b3/0x5953bbf6b3074c97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090260:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074ee36b3/0x5953bbf6b3074c97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090279:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.090290:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.090297:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074ee36b3/0x5953bbf6b3074c97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.090326:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8a00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.090331:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074ee36b3/0x5953bbf6b3074c97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.090335:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x728:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.090370:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074ee36b3/0x5953bbf6b3074c97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090383:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1dd37d7/0x5953bbf6b3074c9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.090392:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074ee36b3/0x5953bbf6b3074c97 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090397:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x728:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.090434:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290384.090437:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074ee36b3/0x5953bbf6b3074c97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090446:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1dd37d7/0x5953bbf6b3074c9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090467:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1dd37d7/0x5953bbf6b3074c9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.090468:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.090474:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.090479:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.090487:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1dd37d7/0x5953bbf6b3074c9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090498:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1dd37d7/0x5953bbf6b3074c9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090517:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.090528:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.090536:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1dd37d7/0x5953bbf6b3074c9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.090547:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef8e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.090552:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1dd37d7/0x5953bbf6b3074c9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.090563:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1dd37d7/0x5953bbf6b3074c9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.090569:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x727:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290384.090586:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3559906/0x5953bbf6b3074ca5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.090600:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1dd37d7/0x5953bbf6b3074c9e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.090641:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1dd37d7/0x5953bbf6b3074c9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090647:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x727:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.090659:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290384.090664:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.090669:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3559906/0x5953bbf6b3074ca5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.090671:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.090677:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.090700:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3559906/0x5953bbf6b3074ca5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090719:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3559906/0x5953bbf6b3074ca5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090735:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3559906/0x5953bbf6b3074ca5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090759:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.090769:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.090776:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3559906/0x5953bbf6b3074ca5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.090786:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.090792:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3559906/0x5953bbf6b3074ca5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.090802:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3559906/0x5953bbf6b3074ca5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.090816:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3559906/0x5953bbf6b3074ca5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.090822:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x726:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.090833:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3559906/0x5953bbf6b3074ca5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090838:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ebc3a6e/0x5953bbf6b3074cac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090862:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x726:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.090876:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x726:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.090892:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ebc3a6e/0x5953bbf6b3074cac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090908:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ebc3a6e/0x5953bbf6b3074cac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.090908:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.090915:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.090921:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.090946:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ebc3a6e/0x5953bbf6b3074cac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090956:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ebc3a6e/0x5953bbf6b3074cac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.090977:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.090988:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.090996:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ebc3a6e/0x5953bbf6b3074cac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.091008:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.091014:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ebc3a6e/0x5953bbf6b3074cac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.091024:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ebc3a6e/0x5953bbf6b3074cac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.091032:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x725:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.091041:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ebc3a6e/0x5953bbf6b3074cac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.091043:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe4b26db/0x5953bbf6b3074cb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.091073:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ebc3a6e/0x5953bbf6b3074cac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.091078:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x725:0x0].0x0 since=2125s v=(0 0) 00002000:00010000:0.0:1784290384.091086:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x741:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290384.091096:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.091109:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe4b26db/0x5953bbf6b3074cb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.091112:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.091112:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3074cba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.091118:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.091124:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.091149:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe4b26db/0x5953bbf6b3074cb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.091152:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x741:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.091168:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x741:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.091177:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe4b26db/0x5953bbf6b3074cb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.091179:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3074cba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.091216:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe4b26db/0x5953bbf6b3074cb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.091223:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3074cba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.091239:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3074cba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.091261:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3074cba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.091270:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290384.091288:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784290384.091299:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784290384.091308:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.091309:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe4b26db/0x5953bbf6b3074cb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.091322:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3074cba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.091376:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ef9a00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.091382:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe4b26db/0x5953bbf6b3074cb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.091394:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe4b26db/0x5953bbf6b3074cb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.091395:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x724:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290384.091399:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290384.091440:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8e61c6f/0x5953bbf6b3074cc1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.091444:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3074cba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.091447:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe4b26db/0x5953bbf6b3074cb3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.091497:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x724:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.091512:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x724:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290384.091513:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe4b26db/0x5953bbf6b3074cb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.091518:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3074cba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.091523:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8e61c6f/0x5953bbf6b3074cc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.091561:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.091569:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.091570:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8e61c6f/0x5953bbf6b3074cc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.091577:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.091586:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3074cba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.091587:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8e61c6f/0x5953bbf6b3074cc1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.091629:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8e61c6f/0x5953bbf6b3074cc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.091633:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3074cba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x741:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.091675:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290384.091680:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.091684:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.091688:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8e61c6f/0x5953bbf6b3074cc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.091699:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fea00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290384.091704:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8e61c6f/0x5953bbf6b3074cc1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.091743:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8e61c6f/0x5953bbf6b3074cc1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.091747:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x723:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290384.091765:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9df03e3/0x5953bbf6b3074cc8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.091776:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8e61c6f/0x5953bbf6b3074cc1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.091777:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x723:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.091790:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8e61c6f/0x5953bbf6b3074cc1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.091793:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x723:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.091800:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9df03e3/0x5953bbf6b3074cc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.091848:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9df03e3/0x5953bbf6b3074cc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.091860:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9df03e3/0x5953bbf6b3074cc8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.091861:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.091867:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.091874:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.091875:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9df03e3/0x5953bbf6b3074cc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.091901:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.091926:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.091935:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9df03e3/0x5953bbf6b3074cc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.091946:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fec00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.091951:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9df03e3/0x5953bbf6b3074cc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290384.091963:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x722:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290384.091972:0:9000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b26e3f5/0x5953bbf6b3074ccf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.091994:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9df03e3/0x5953bbf6b3074cc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.091996:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x722:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:3.0:1784290384.092010:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x722:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.092027:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b26e3f5/0x5953bbf6b3074ccf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.092037:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9df03e3/0x5953bbf6b3074cc8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.092044:0:9000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b26e3f5/0x5953bbf6b3074ccf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.092055:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9df03e3/0x5953bbf6b3074cc8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.092065:0:9000:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b26e3f5/0x5953bbf6b3074ccf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.092088:0:9000:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b26e3f5/0x5953bbf6b3074ccf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.092090:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.092098:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.092106:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290384.092117:0:9000:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784290384.092121:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b26e3f5/0x5953bbf6b3074ccf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.092133:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fe200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.092137:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b26e3f5/0x5953bbf6b3074ccf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.092147:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b26e3f5/0x5953bbf6b3074ccf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.092160:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b26e3f5/0x5953bbf6b3074ccf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.092184:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b26e3f5/0x5953bbf6b3074ccf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.092215:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.092220:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.092227:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.092241:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784290384.092281:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x740:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290384.092292:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096010256/0x5953bbf6b3074cd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.092307:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x740:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.092313:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x740:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290384.092320:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096010256/0x5953bbf6b3074cd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.092335:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096010256/0x5953bbf6b3074cd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.092384:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096010256/0x5953bbf6b3074cd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.092396:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096010256/0x5953bbf6b3074cd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.092436:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.092450:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.092459:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096010256/0x5953bbf6b3074cd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.092471:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.092478:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096010256/0x5953bbf6b3074cd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.092489:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096010256/0x5953bbf6b3074cd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.092510:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096010256/0x5953bbf6b3074cd6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.092521:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096010256/0x5953bbf6b3074cd6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x740:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.092553:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.092566:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.092569:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1784290384.092610:0:9000:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1794 00000100:00100000:3.0:1784290384.092699:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:92165:x1870961901115392:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16197us (16433us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290384.092719:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4956 00000100:00100000:1.0:1784290384.092724:0:92165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92165:1870961901115392:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1784290384.092747:0:92165:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x741:0x0] from OST, last_created [0x2c0000401:0x741:0x0]last_used is [0x2c0000401:0x702:0x0] 00002000:00010000:0.0:1784290384.092826:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1784290384.092828:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901115520:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784290384.092840:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000448e7a03/0x5953bbf6b3074cdd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290384.092848:0:92165:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92165:1870961901115648:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1784290384.092904:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784290384.092909:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73f:0x0].0x0 since=2125s v=(0 0) 00000100:00100000:1.0:1784290384.092918:0:92165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784290384.092921:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290384.092930:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000448e7a03/0x5953bbf6b3074cdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.092945:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000448e7a03/0x5953bbf6b3074cdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.092956:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000448e7a03/0x5953bbf6b3074cdd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290384.092963:0:92165:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e78300 going to sleep for 11 seconds 00010000:00010000:0.0:1784290384.092967:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000448e7a03/0x5953bbf6b3074cdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290384.092979:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901115520 00000100:00100000:3.0:1784290384.092990:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901115520 00000100:00100000:1.0:1784290384.093000:0:26253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901115648 00000100:00100000:1.0:1784290384.093009:0:26253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901115648 00000100:00100000:1.0:1784290384.093059:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4958 00000100:00100000:3.0:1784290384.093073:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00010000:00010000:0.0:1784290384.093075:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784290384.093078:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:92165:x1870961901115648:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:0.0:1784290384.093098:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1784290384.093105:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901115520:12345-0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784290384.093109:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000448e7a03/0x5953bbf6b3074cdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1784290384.093119:0:26253:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1858 00010000:00010000:0.0:1784290384.093132:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290384.093138:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000448e7a03/0x5953bbf6b3074cdd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:3.0:1784290384.093142:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 896 free 3922481152 avail 3690958848 00010000:00010000:0.0:1784290384.093151:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000448e7a03/0x5953bbf6b3074cdd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.093187:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000448e7a03/0x5953bbf6b3074cdd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.093199:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000448e7a03/0x5953bbf6b3074cdd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290384.093234:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901115520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290384.093260:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:2.0:1784290384.093279:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901115520:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784290384.093316:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.093323:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.093327:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784290384.093451:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1784290384.093504:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290384.093518:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084275446/0x5953bbf6b3074ce4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.093540:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73e:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.093549:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290384.093560:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084275446/0x5953bbf6b3074ce4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.093583:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084275446/0x5953bbf6b3074ce4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.093599:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084275446/0x5953bbf6b3074ce4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.093612:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084275446/0x5953bbf6b3074ce4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.093656:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.093677:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.093687:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084275446/0x5953bbf6b3074ce4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.093699:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.093704:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084275446/0x5953bbf6b3074ce4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.093715:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084275446/0x5953bbf6b3074ce4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.093733:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084275446/0x5953bbf6b3074ce4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290384.093736:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.093755:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084275446/0x5953bbf6b3074ce4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.093757:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5a31b39/0x5953bbf6b3074ceb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.093792:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73d:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.093797:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290384.093803:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5a31b39/0x5953bbf6b3074ceb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.093805:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.093811:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.093818:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.093823:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5a31b39/0x5953bbf6b3074ceb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.093837:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5a31b39/0x5953bbf6b3074ceb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.093846:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5a31b39/0x5953bbf6b3074ceb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.093867:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.093878:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.093895:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5a31b39/0x5953bbf6b3074ceb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.093906:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.093912:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5a31b39/0x5953bbf6b3074ceb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.093921:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5a31b39/0x5953bbf6b3074ceb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.093939:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5a31b39/0x5953bbf6b3074ceb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290384.093940:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290384.093959:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f477e25/0x5953bbf6b3074cf2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.093962:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5a31b39/0x5953bbf6b3074ceb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.093999:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73c:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:2.0:1784290384.094011:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.094017:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290384.094019:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.094025:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.094029:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f477e25/0x5953bbf6b3074cf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.094044:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f477e25/0x5953bbf6b3074cf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.094056:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f477e25/0x5953bbf6b3074cf2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.094065:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f477e25/0x5953bbf6b3074cf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.094085:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.094098:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.094106:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f477e25/0x5953bbf6b3074cf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.094115:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236de00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.094121:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f477e25/0x5953bbf6b3074cf2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.094148:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f477e25/0x5953bbf6b3074cf2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290384.094168:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.094169:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f477e25/0x5953bbf6b3074cf2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.094188:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028bfd575/0x5953bbf6b3074cf9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.094192:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f477e25/0x5953bbf6b3074cf2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.094220:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73b:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.094226:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290384.094232:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028bfd575/0x5953bbf6b3074cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.094241:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.094247:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028bfd575/0x5953bbf6b3074cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.094249:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.094256:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.094266:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028bfd575/0x5953bbf6b3074cf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.094287:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028bfd575/0x5953bbf6b3074cf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.094309:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.094321:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.094328:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028bfd575/0x5953bbf6b3074cf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.094365:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.094371:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028bfd575/0x5953bbf6b3074cf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.094383:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028bfd575/0x5953bbf6b3074cf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.094399:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028bfd575/0x5953bbf6b3074cf9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.094441:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028bfd575/0x5953bbf6b3074cf9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290384.094445:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x73a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290384.094465:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096d702c9/0x5953bbf6b3074d00 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.094477:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.094478:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73a:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:2.0:1784290384.094483:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.094488:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x73a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290384.094490:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.094496:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096d702c9/0x5953bbf6b3074d00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.094513:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096d702c9/0x5953bbf6b3074d00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.094528:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096d702c9/0x5953bbf6b3074d00 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.094544:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096d702c9/0x5953bbf6b3074d00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.094576:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.094586:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.094594:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096d702c9/0x5953bbf6b3074d00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.094603:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236dc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.094608:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096d702c9/0x5953bbf6b3074d00 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.094620:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096d702c9/0x5953bbf6b3074d00 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.094635:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096d702c9/0x5953bbf6b3074d00 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.094644:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096d702c9/0x5953bbf6b3074d00 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x73a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290384.094659:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x739:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.094664:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.094669:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4e1d8dd/0x5953bbf6b3074d07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.094671:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.094687:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.094701:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x739:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.094706:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x739:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290384.094713:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4e1d8dd/0x5953bbf6b3074d07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.094727:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4e1d8dd/0x5953bbf6b3074d07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.094737:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4e1d8dd/0x5953bbf6b3074d07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.094748:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4e1d8dd/0x5953bbf6b3074d07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.094770:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.094781:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.094789:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4e1d8dd/0x5953bbf6b3074d07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.094801:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.094807:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4e1d8dd/0x5953bbf6b3074d07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.094818:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4e1d8dd/0x5953bbf6b3074d07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.094837:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4e1d8dd/0x5953bbf6b3074d07 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.094846:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4e1d8dd/0x5953bbf6b3074d07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x739:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290384.094857:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x738:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290384.094868:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021fd6b20/0x5953bbf6b3074d0e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.094869:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.094877:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.094882:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.094887:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x738:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.094893:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x738:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290384.094899:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021fd6b20/0x5953bbf6b3074d0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.094911:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021fd6b20/0x5953bbf6b3074d0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.094937:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021fd6b20/0x5953bbf6b3074d0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.094948:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021fd6b20/0x5953bbf6b3074d0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.094970:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.094979:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.094987:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021fd6b20/0x5953bbf6b3074d0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.094996:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.095001:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021fd6b20/0x5953bbf6b3074d0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.095030:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021fd6b20/0x5953bbf6b3074d0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.095045:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021fd6b20/0x5953bbf6b3074d0e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290384.095049:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x737:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.095068:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021fd6b20/0x5953bbf6b3074d0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x738:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095069:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb30d43f/0x5953bbf6b3074d15 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095104:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x737:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.095108:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x737:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290384.095114:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb30d43f/0x5953bbf6b3074d15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.095117:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.095124:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.095131:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.095132:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb30d43f/0x5953bbf6b3074d15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095145:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb30d43f/0x5953bbf6b3074d15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095154:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb30d43f/0x5953bbf6b3074d15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095193:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.095203:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.095211:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb30d43f/0x5953bbf6b3074d15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.095221:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236cc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.095226:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb30d43f/0x5953bbf6b3074d15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.095237:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb30d43f/0x5953bbf6b3074d15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.095253:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb30d43f/0x5953bbf6b3074d15 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.095278:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb30d43f/0x5953bbf6b3074d15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x737:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290384.095280:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x736:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290384.095299:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007441f48a/0x5953bbf6b3074d1c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095313:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x736:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:2.0:1784290384.095314:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.095319:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x736:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290384.095321:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.095326:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.095330:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007441f48a/0x5953bbf6b3074d1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095374:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007441f48a/0x5953bbf6b3074d1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095386:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007441f48a/0x5953bbf6b3074d1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095395:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007441f48a/0x5953bbf6b3074d1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095434:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.095453:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.095479:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007441f48a/0x5953bbf6b3074d1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.095489:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.095495:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007441f48a/0x5953bbf6b3074d1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290384.095503:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:92165:x1870961901115648:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2427us (2587us total) trans 4294968631 rc 0/0 00002000:00010000:0.0:1784290384.095513:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x735:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.095517:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007441f48a/0x5953bbf6b3074d1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290384.095533:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4958 00010000:00010000:0.0:1784290384.095537:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bc12f17/0x5953bbf6b3074d23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.095554:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007441f48a/0x5953bbf6b3074d1c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095560:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x735:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:2.0:1784290384.095566:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007441f48a/0x5953bbf6b3074d1c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x736:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095588:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x735:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290384.095596:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.095600:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bc12f17/0x5953bbf6b3074d23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.095602:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.095623:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.095625:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bc12f17/0x5953bbf6b3074d23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095638:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bc12f17/0x5953bbf6b3074d23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095646:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bc12f17/0x5953bbf6b3074d23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095667:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.095677:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.095686:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bc12f17/0x5953bbf6b3074d23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.095696:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.095701:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bc12f17/0x5953bbf6b3074d23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.095713:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bc12f17/0x5953bbf6b3074d23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290384.095713:0:92165:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:92165:1870961901115648:0@lo:5:osp-pre-1-0.0 00002000:00010000:0.0:1784290384.095723:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x734:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:1.0:1784290384.095733:0:92165:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x741:0x0]-[0x2c0000401:0x761:0x0] 00010000:00010000:0.0:1784290384.095742:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4eccbe6/0x5953bbf6b3074d2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.095758:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bc12f17/0x5953bbf6b3074d23 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095758:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x734:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.095772:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x734:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290384.095783:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bc12f17/0x5953bbf6b3074d23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x735:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095785:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4eccbe6/0x5953bbf6b3074d2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095817:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4eccbe6/0x5953bbf6b3074d2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.095821:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.095828:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.095831:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4eccbe6/0x5953bbf6b3074d2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.095833:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.095852:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4eccbe6/0x5953bbf6b3074d2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095873:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.095882:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.095889:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4eccbe6/0x5953bbf6b3074d2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.095900:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.095904:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4eccbe6/0x5953bbf6b3074d2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290384.095926:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x733:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.095929:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4eccbe6/0x5953bbf6b3074d2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095937:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007494bd03/0x5953bbf6b3074d31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.095950:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4eccbe6/0x5953bbf6b3074d2a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095952:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x733:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.095967:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x733:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290384.095980:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4eccbe6/0x5953bbf6b3074d2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x734:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.095982:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007494bd03/0x5953bbf6b3074d31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096016:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007494bd03/0x5953bbf6b3074d31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.096020:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.096025:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.096029:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007494bd03/0x5953bbf6b3074d31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.096030:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.096044:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007494bd03/0x5953bbf6b3074d31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096060:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.096070:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.096076:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007494bd03/0x5953bbf6b3074d31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.096087:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236ce00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.096092:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007494bd03/0x5953bbf6b3074d31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.096101:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007494bd03/0x5953bbf6b3074d31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290384.096105:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x732:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290384.096116:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e925d7e1/0x5953bbf6b3074d38 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.096118:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007494bd03/0x5953bbf6b3074d31 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096140:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x732:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.096152:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x732:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290384.096153:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007494bd03/0x5953bbf6b3074d31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x733:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096163:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e925d7e1/0x5953bbf6b3074d38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.096177:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.096180:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e925d7e1/0x5953bbf6b3074d38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.096184:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.096190:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.096195:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e925d7e1/0x5953bbf6b3074d38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096206:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e925d7e1/0x5953bbf6b3074d38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096225:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.096244:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.096251:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e925d7e1/0x5953bbf6b3074d38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.096260:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.096265:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e925d7e1/0x5953bbf6b3074d38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.096275:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e925d7e1/0x5953bbf6b3074d38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290384.096277:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x731:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290384.096294:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b61dcb/0x5953bbf6b3074d3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.096299:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e925d7e1/0x5953bbf6b3074d38 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096310:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x731:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:2.0:1784290384.096319:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e925d7e1/0x5953bbf6b3074d38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x732:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096320:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x731:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290384.096333:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b61dcb/0x5953bbf6b3074d3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.096374:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.096379:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.096391:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.096393:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b61dcb/0x5953bbf6b3074d3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096446:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b61dcb/0x5953bbf6b3074d3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096455:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b61dcb/0x5953bbf6b3074d3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096501:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290384.096549:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290384.096557:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b61dcb/0x5953bbf6b3074d3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.096569:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236da00 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:0.0:1784290384.096573:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x730:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290384.096575:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b61dcb/0x5953bbf6b3074d3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096594:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d329f88/0x5953bbf6b3074d46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.096595:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b61dcb/0x5953bbf6b3074d3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096610:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x730:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.096618:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x730:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290384.096625:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d329f88/0x5953bbf6b3074d46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.096627:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b61dcb/0x5953bbf6b3074d3f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096649:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d329f88/0x5953bbf6b3074d46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.096653:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b61dcb/0x5953bbf6b3074d3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x731:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096677:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d329f88/0x5953bbf6b3074d46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096687:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d329f88/0x5953bbf6b3074d46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.096697:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.096702:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.096708:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.096731:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.096745:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.096754:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d329f88/0x5953bbf6b3074d46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.096766:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.096771:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d329f88/0x5953bbf6b3074d46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.096781:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d329f88/0x5953bbf6b3074d46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290384.096789:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.096796:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d329f88/0x5953bbf6b3074d46 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096798:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000197cd913/0x5953bbf6b3074d4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.096824:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d329f88/0x5953bbf6b3074d46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x730:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096829:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72f:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.096842:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290384.096848:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000197cd913/0x5953bbf6b3074d4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.096853:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.096858:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.096861:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.096862:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000197cd913/0x5953bbf6b3074d4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096873:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000197cd913/0x5953bbf6b3074d4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096882:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000197cd913/0x5953bbf6b3074d4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096902:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.096920:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.096927:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000197cd913/0x5953bbf6b3074d4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.096936:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236ca00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.096941:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000197cd913/0x5953bbf6b3074d4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290384.096951:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290384.096968:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e4863df/0x5953bbf6b3074d54 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.096974:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000197cd913/0x5953bbf6b3074d4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.096986:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72e:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:2.0:1784290384.096997:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000197cd913/0x5953bbf6b3074d4d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.097004:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290384.097015:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000197cd913/0x5953bbf6b3074d4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.097019:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e4863df/0x5953bbf6b3074d54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.097045:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e4863df/0x5953bbf6b3074d54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.097056:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e4863df/0x5953bbf6b3074d54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.097057:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.097065:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.097071:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e4863df/0x5953bbf6b3074d54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.097073:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.097096:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.097108:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.097116:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e4863df/0x5953bbf6b3074d54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.097126:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482044a00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.097129:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e4863df/0x5953bbf6b3074d54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.097139:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e4863df/0x5953bbf6b3074d54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290384.097152:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.097153:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e4863df/0x5953bbf6b3074d54 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.097164:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b3074d5b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.097174:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72d:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.097187:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290384.097203:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e4863df/0x5953bbf6b3074d54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.097204:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b3074d5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.097243:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b3074d5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.097251:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.097253:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b3074d5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.097256:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.097260:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.097275:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b3074d5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.097295:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.097308:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.097315:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b3074d5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.097326:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482044c00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.097331:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b3074d5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.097363:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b3074d5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.097382:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b3074d5b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.097390:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008a1c741d/0x5953bbf6b3074d5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290384.097397:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290384.097426:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b3074d62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.097439:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.097439:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72c:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:2.0:1784290384.097446:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.097448:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290384.097471:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b3074d62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.097477:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.097486:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b3074d62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.097498:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b3074d62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.097506:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b3074d62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.097533:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.097549:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.097557:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b3074d62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.097567:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.097573:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b3074d62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.097583:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b3074d62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.097597:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b3074d62 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.097605:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076fba929/0x5953bbf6b3074d62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290384.097613:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290384.097623:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b3074d69 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.097630:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.097636:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.097640:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.097646:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72b:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.097652:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290384.097658:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b3074d69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.097669:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b3074d69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.097677:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b3074d69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.097685:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b3074d69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.097712:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.097735:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5de00/0x5953bbf6b3074d70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.097740:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290384.097754:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b3074d69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.097756:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5de00/0x5953bbf6b3074d70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290384.097773:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x72a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.097788:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5de00/0x5953bbf6b3074d70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.097791:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290384.097792:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049f9a593/0x5953bbf6b3074d77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.097802:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b3074d69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.097818:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72a:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.097833:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x72a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290384.097844:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049f9a593/0x5953bbf6b3074d77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.097845:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b3074d69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.097849:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c200/0x5953bbf6b3074d7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.097883:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c200/0x5953bbf6b3074d7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.097893:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049f9a593/0x5953bbf6b3074d77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.097897:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c200/0x5953bbf6b3074d7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.097899:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b3074d69 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.097937:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b3074d69 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.097944:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049f9a593/0x5953bbf6b3074d77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.097955:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049f9a593/0x5953bbf6b3074d77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.097999:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290384.098003:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290384.098009:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049f9a593/0x5953bbf6b3074d77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.098018:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290384.098024:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f9a593/0x5953bbf6b3074d77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290384.098025:0:66008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dfd1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:66008:1870961901115776:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1784290384.098045:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049f9a593/0x5953bbf6b3074d77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.098059:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049f9a593/0x5953bbf6b3074d77 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.098066:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049f9a593/0x5953bbf6b3074d77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x72a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290384.098089:0:66008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1784290384.098092:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x729:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290384.098093:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.098100:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.098104:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b3074d85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.098106:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.098119:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x729:0x0].0x0 since=2125s v=(0 0) 00000100:00100000:2.0:1784290384.098120:0:66008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b2353c0 going to sleep for 11 seconds 00010000:00010000:0.0:1784290384.098126:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x729:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290384.098133:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b3074d85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.098134:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.098150:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b3074d85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290384.098153:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901115776 00000100:00100000:2.0:1784290384.098162:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901115776 00010000:00010000:0.0:1784290384.098164:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b3074d85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.098175:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b3074d85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.098209:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784290384.098212:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3840 00000100:00100000:2.0:1784290384.098226:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66008:x1870961901115776:12345-0@lo:1000:mdt00_004.0 00002000:00010000:0.0:1784290384.098271:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x728:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290384.098280:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036f2784a/0x5953bbf6b3074d8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.098290:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x728:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.098295:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x728:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290384.098301:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036f2784a/0x5953bbf6b3074d8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.098313:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036f2784a/0x5953bbf6b3074d8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290384.098322:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66008:x1870961901115776:12345-0@lo:1000:mdt00_004.0 Request processed in 95us (233us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290384.098327:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036f2784a/0x5953bbf6b3074d8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290384.098400:0:66008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dfd1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:66008:1870961901115776:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1784290384.098400:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036f2784a/0x5953bbf6b3074d8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290384.098450:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3840 00010000:00010000:0.0:1784290384.098477:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784290384.098514:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784290384.098520:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff800/0x5953bbf6b3074d93 lrc: 3/1,0 mode: --/PR res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.098522:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b3074d85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290384.098544:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x727:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290384.098548:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff800/0x5953bbf6b3074d93 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.098549:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.098558:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b3074d85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.098560:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c438605/0x5953bbf6b3074d9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.098595:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff800/0x5953bbf6b3074d93 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.098596:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x727:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:2.0:1784290384.098619:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b3074d85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.098620:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x727:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290384.098637:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c438605/0x5953bbf6b3074d9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.098647:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b3074d85 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.098653:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c438605/0x5953bbf6b3074d9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290384.098658:0:66008:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff800/0x5953bbf6b3074d93 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.098666:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092b84141/0x5953bbf6b3074d85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x729:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.098696:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c438605/0x5953bbf6b3074d9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.098705:0:66008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5de00/0x5953bbf6b3074d70 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.098708:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c438605/0x5953bbf6b3074d9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.098713:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290384.098724:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036f2784a/0x5953bbf6b3074d8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.098738:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5de00/0x5953bbf6b3074d70 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.098758:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.098759:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482044200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290384.098763:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5de00/0x5953bbf6b3074d70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.098768:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036f2784a/0x5953bbf6b3074d8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.098778:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5de00/0x5953bbf6b3074d70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.098783:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036f2784a/0x5953bbf6b3074d8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.098802:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5de00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290384.098810:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5de00/0x5953bbf6b3074d70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.098814:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036f2784a/0x5953bbf6b3074d8c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.098820:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5de00/0x5953bbf6b3074d70 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290384.098825:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x726:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290384.098828:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036f2784a/0x5953bbf6b3074d8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x728:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.098845:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3074da1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.098852:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:3.0:1784290384.098865:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290384.098873:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5de00/0x5953bbf6b3074d70 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.098876:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x726:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.098888:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x726:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.098893:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5de00/0x5953bbf6b3074d70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.098897:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290384.098897:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3074da1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.098906:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c438605/0x5953bbf6b3074d9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.098939:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290384.098942:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3074da1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.098946:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c438605/0x5953bbf6b3074d9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.098948:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c200/0x5953bbf6b3074d7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.098954:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290384.098968:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.098981:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3074da1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.098984:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c200/0x5953bbf6b3074d7e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.098987:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c438605/0x5953bbf6b3074d9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.099012:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c200/0x5953bbf6b3074d7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.099029:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c438605/0x5953bbf6b3074d9a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.099034:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3074da1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.099036:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5c200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290384.099044:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c200/0x5953bbf6b3074d7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.099062:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c438605/0x5953bbf6b3074d9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x727:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.099079:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c200/0x5953bbf6b3074d7e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.099091:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290384.099094:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290384.099095:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9c2443177900) 00010000:00010000:3.0:1784290384.099103:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290384.099103:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3074da1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.099111:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c200/0x5953bbf6b3074d7e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.099116:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.099120:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.099130:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3074da1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.099131:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c200/0x5953bbf6b3074d7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290384.099144:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x725:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290384.099161:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028afd70b/0x5953bbf6b3074da8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.099189:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb600/0x5953bbf6b3074be8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24a9 expref: 9 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.099198:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3074da1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.099200:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x725:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.099215:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x725:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.099221:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff800/0x5953bbf6b3074d93 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24a9 expref: 8 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.099227:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028afd70b/0x5953bbf6b3074da8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.099229:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3074da1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.099267:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d4d504b/0x5953bbf6b3074da1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x726:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.099270:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028afd70b/0x5953bbf6b3074da8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.099271:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c245a793f00) 00010000:00010000:3.0:1784290384.099284:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784290384.099290:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2ff800, rc 0) 00010000:00010000:0.0:1784290384.099296:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028afd70b/0x5953bbf6b3074da8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.099299:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.099305:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.099312:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.099312:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028afd70b/0x5953bbf6b3074da8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290384.099333:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:71098:x1870961896257152:12345-192.168.202.6@tcp:101:rm.0 Request processed in 15662us (15841us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290384.099342:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1222 00010000:00010000:0.0:1784290384.099380:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784290384.099480:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x724:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290384.099491:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b94ffa88/0x5953bbf6b3074daf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.099516:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x724:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.099525:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x724:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290384.099535:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b94ffa88/0x5953bbf6b3074daf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.099557:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b94ffa88/0x5953bbf6b3074daf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.099576:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b94ffa88/0x5953bbf6b3074daf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.099594:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b94ffa88/0x5953bbf6b3074daf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.099633:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784290384.099657:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784290384.099674:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028afd70b/0x5953bbf6b3074da8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.099694:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebfc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290384.099720:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028afd70b/0x5953bbf6b3074da8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290384.099728:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x723:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290384.099739:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028afd70b/0x5953bbf6b3074da8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.099740:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078c48985/0x5953bbf6b3074db6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.099778:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x723:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.099784:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x723:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290384.099791:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028afd70b/0x5953bbf6b3074da8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.099791:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078c48985/0x5953bbf6b3074db6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.099827:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028afd70b/0x5953bbf6b3074da8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x725:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.099833:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078c48985/0x5953bbf6b3074db6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.099859:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078c48985/0x5953bbf6b3074db6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.099861:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290384.099867:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.099871:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b94ffa88/0x5953bbf6b3074daf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.099876:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078c48985/0x5953bbf6b3074db6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.099908:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290384.099912:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b94ffa88/0x5953bbf6b3074daf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.099920:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b94ffa88/0x5953bbf6b3074daf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.099923:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290384.099939:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b94ffa88/0x5953bbf6b3074daf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.099947:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290384.099948:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b94ffa88/0x5953bbf6b3074daf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x724:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.099959:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078c48985/0x5953bbf6b3074db6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.099973:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebe600 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:0.0:1784290384.099974:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x722:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290384.099982:0:26251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001033465d/0x5953bbf6b3074dbd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.099990:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078c48985/0x5953bbf6b3074db6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.099997:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x722:0x0].0x0 since=2125s v=(0 0) 00010000:00010000:0.0:1784290384.100010:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x722:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290384.100013:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078c48985/0x5953bbf6b3074db6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.100019:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001033465d/0x5953bbf6b3074dbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.100038:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.100043:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.100048:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290384.100062:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078c48985/0x5953bbf6b3074db6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.100062:0:26251:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001033465d/0x5953bbf6b3074dbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.100095:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078c48985/0x5953bbf6b3074db6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x723:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.100098:0:26251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001033465d/0x5953bbf6b3074dbd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.100125:0:26251:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001033465d/0x5953bbf6b3074dbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.100135:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290384.100139:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290384.100143:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290384.100164:0:26251:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290384.100172:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290384.100179:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001033465d/0x5953bbf6b3074dbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.100189:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290384.100194:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001033465d/0x5953bbf6b3074dbd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.100203:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001033465d/0x5953bbf6b3074dbd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.100218:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001033465d/0x5953bbf6b3074dbd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.100236:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001033465d/0x5953bbf6b3074dbd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x722:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.100258:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290384.100262:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290384.100265:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1784290384.100469:0:26251:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1795 00000100:00100000:0.0:1784290384.100555:0:26251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:92163:x1870961901115264:12345-0@lo:5:osp-pre-0-0.0 Request processed in 23968us (24343us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290384.100575:0:92163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a51a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92163:1870961901115264:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1784290384.100577:0:26251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4957 00000004:00080000:2.0:1784290384.100597:0:92163:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x741:0x0] from OST, last_created [0x280000401:0x741:0x0]last_used is [0x280000401:0x703:0x0] 00000100:00100000:2.0:1784290384.100677:0:92163:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dfd2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92163:1870961901116032:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1784290384.100688:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784290384.100725:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dfd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901115904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784290384.100736:0:92163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290384.100766:0:92163:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b235d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784290384.100771:0:15642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901116032 00000100:00100000:3.0:1784290384.100778:0:15642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901116032 00000100:00100000:0.0:1784290384.100803:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290384.100831:0:15642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4959 00000100:00100000:3.0:1784290384.100846:0:15642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:92163:x1870961901116032:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1784290384.100863:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901115904 00000100:00100000:0.0:1784290384.100871:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901115904 00002000:00080000:3.0:1784290384.100873:0:15642:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1858 00000100:00100000:0.0:1784290384.100918:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:0.0:1784290384.100934:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901115904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784290384.100953:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290384.101027:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901115904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290384.101043:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:2.0:1784290384.101092:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dfd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901115904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784290384.101625:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290384.101687:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896257280 00000100:00100000:1.0:1784290384.101696:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896257280 00000100:00100000:1.0:1784290384.101765:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1223 00000100:00100000:1.0:1784290384.101777:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+12:71098:x1870961896257280:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:1.0:1784290384.101792:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290384.101810:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8cb000/0x5953bbf6b3074dc4 lrc: 2/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b24b0 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.101852:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca400/0x5953bbf6b3074dcb lrc: 3/1,0 mode: --/PR res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.101864:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca400/0x5953bbf6b3074dcb lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.101875:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca400/0x5953bbf6b3074dcb lrc: 3/1,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290384.101910:0:65989:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0x9:0x0]: returning size 4096 00000004:00200000:1.0:1784290384.101915:0:65989:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1784290384.101944:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8cb000/0x5953bbf6b3074dc4 lrc: 0/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24b0 expref: 14 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.101976:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca400/0x5953bbf6b3074dcb lrc: 3/0,0 mode: PR/PR res: [0x240006991:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24b0 expref: 13 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.101984:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2442ffea00) 00010000:00010000:1.0:1784290384.101988:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784290384.101991:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8ca400, rc 0) 00000100:00100000:1.0:1784290384.102042:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+13:71098:x1870961896257280:12345-192.168.202.6@tcp:101:rm.0 Request processed in 267us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290384.102051:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1223 00000100:00100000:3.0:1784290384.102927:0:15642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:92163:x1870961901116032:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2085us (2191us total) trans 4294968630 rc 0/0 00000100:00100000:3.0:1784290384.102935:0:15642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4959 00000100:00100000:2.0:1784290384.103030:0:92163:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dfd2a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:92163:1870961901116032:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1784290384.103047:0:92163:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x741:0x0]-[0x280000401:0x761:0x0] 00000100:00100000:2.0:1784290384.104679:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290384.104762:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896257536 00000100:00100000:3.0:1784290384.104779:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896257536 00000100:00100000:3.0:1784290384.104822:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1224 00000100:00100000:3.0:1784290384.104831:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+13:71098:x1870961896257536:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:3.0:1784290384.104844:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290384.104859:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff000/0x5953bbf6b3074dd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b24b7 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290384.104921:0:74876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0x9:0x0]: returning size 4096 00010000:00010000:3.0:1784290384.104987:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff000/0x5953bbf6b3074dd2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24b7 expref: 15 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.104999:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c245a793600) 00010000:00010000:3.0:1784290384.105002:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784290384.105006:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff000/0x5953bbf6b3074dd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24b7 expref: 15 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.105021:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2ff000, rc 0) 00000100:00100000:3.0:1784290384.105084:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+14:71098:x1870961896257536:12345-192.168.202.6@tcp:101:rm.0 Request processed in 253us (409us total) trans 81604378752 rc 301/301 00000100:00100000:3.0:1784290384.105094:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1224 00000100:00100000:2.0:1784290384.108274:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290384.108372:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896257664 00000100:00100000:3.0:1784290384.108380:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896257664 00000100:00100000:3.0:1784290384.108444:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 229 00000100:00100000:3.0:1784290384.108457:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+14:71098:x1870961896257664:12345-192.168.202.6@tcp:37:rm.0 00000100:00100000:3.0:1784290384.111670:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+14:71098:x1870961896257664:12345-192.168.202.6@tcp:37:rm.0 Request processed in 3211us (3392us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290384.111688:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 229 00000100:00100000:2.0:1784290384.114859:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290384.114929:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896257920 00000100:00100000:3.0:1784290384.114940:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896257920 00000100:00100000:3.0:1784290384.114991:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 230 00000100:00100000:3.0:1784290384.115004:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c209050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+14:71098:x1870961896257920:12345-192.168.202.6@tcp:35:rm.0 00000100:00100000:3.0:1784290384.115163:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c209050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+15:71098:x1870961896257920:12345-192.168.202.6@tcp:35:rm.0 Request processed in 160us (304us total) trans 81604378753 rc 0/0 00000100:00100000:3.0:1784290384.115177:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 230 00000100:00100000:2.0:1784290384.117146:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290384.117212:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896258176 00000100:00100000:3.0:1784290384.117224:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896258176 00000100:00100000:3.0:1784290384.117278:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1225 00000100:00100000:3.0:1784290384.117293:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+15:71098:x1870961896258176:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:3.0:1784290384.117312:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290384.117329:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff600/0x5953bbf6b3074de0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b24be expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.117497:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff400/0x5953bbf6b3074de7 lrc: 3/1,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.117513:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff400/0x5953bbf6b3074de7 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.117525:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff400/0x5953bbf6b3074de7 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290384.117537:0:66004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0x9:0x0]: returning size 4096 00010000:00010000:3.0:1784290384.117608:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff600/0x5953bbf6b3074de0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24be expref: 18 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.117633:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff400/0x5953bbf6b3074de7 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24be expref: 17 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.117664:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2442ffea00) 00010000:00010000:3.0:1784290384.117670:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784290384.117675:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2ff400, rc 0) 00000100:00100000:3.0:1784290384.117743:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+17:71098:x1870961896258176:12345-192.168.202.6@tcp:101:rm.0 Request processed in 450us (596us total) trans 81604378754 rc 0/0 00000100:00100000:3.0:1784290384.117758:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1225 00000100:00100000:2.0:1784290384.120544:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290384.120659:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896258304 00000100:00100000:0.0:1784290384.120671:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896258304 00000100:00100000:0.0:1784290384.120730:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1226 00000100:00100000:0.0:1784290384.120743:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+17:71098:x1870961896258304:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:0.0:1784290384.120762:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290384.120778:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebec00/0x5953bbf6b3074df5 lrc: 2/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b24c5 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.120833:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3074dfc lrc: 3/1,0 mode: --/PR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.120861:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3074dfc lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.120872:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3074dfc lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290384.120912:0:65990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1784290384.120917:0:65990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784290384.120933:0:65990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3074dfc lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.120961:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebec00/0x5953bbf6b3074df5 lrc: 0/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24c5 expref: 19 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.120980:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3074dfc lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24c5 expref: 18 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.120991:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c2449fa5100) 00010000:00010000:0.0:1784290384.120995:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784290384.120998:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebfa00, rc 0) 00000100:00100000:0.0:1784290384.121054:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+18:71098:x1870961896258304:12345-192.168.202.6@tcp:101:rm.0 Request processed in 313us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290384.121063:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1226 00000100:00100000:2.0:1784290384.123136:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290384.123258:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896258560 00000100:00100000:1.0:1784290384.123269:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896258560 00000100:00100000:1.0:1784290384.123329:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1227 00000100:00100000:1.0:1784290384.123392:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+18:71098:x1870961896258560:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:1.0:1784290384.123442:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290384.123463:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8cb000/0x5953bbf6b3074e03 lrc: 2/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b24cc expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290384.123536:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1784290384.123632:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8cb000/0x5953bbf6b3074e03 lrc: 1/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24cc expref: 20 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.123655:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2442ffea00) 00010000:00010000:1.0:1784290384.123662:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784290384.123671:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8cb000/0x5953bbf6b3074e03 lrc: 0/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24cc expref: 20 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.123716:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8cb000, rc 0) 00000100:00100000:1.0:1784290384.123772:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+19:71098:x1870961896258560:12345-192.168.202.6@tcp:101:rm.0 Request processed in 432us (640us total) trans 81604378755 rc 301/301 00000100:00100000:1.0:1784290384.123783:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1227 00000100:00100000:2.0:1784290384.126725:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290384.126792:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896258688 00000100:00100000:3.0:1784290384.126804:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896258688 00000100:00100000:3.0:1784290384.126875:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 231 00000100:00100000:3.0:1784290384.126898:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+19:71098:x1870961896258688:12345-192.168.202.6@tcp:37:rm.0 00000100:00100000:3.0:1784290384.130168:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+19:71098:x1870961896258688:12345-192.168.202.6@tcp:37:rm.0 Request processed in 3277us (3444us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290384.130180:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 231 00000100:00100000:2.0:1784290384.132791:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290384.132871:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896258944 00000100:00100000:3.0:1784290384.132881:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896258944 00000100:00100000:3.0:1784290384.132931:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 232 00000100:00100000:3.0:1784290384.132944:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+19:71098:x1870961896258944:12345-192.168.202.6@tcp:35:rm.0 00000100:00100000:3.0:1784290384.133100:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+20:71098:x1870961896258944:12345-192.168.202.6@tcp:35:rm.0 Request processed in 157us (312us total) trans 81604378756 rc 0/0 00000100:00100000:3.0:1784290384.133112:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 232 00000100:00100000:2.0:1784290384.134816:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290384.134894:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896259200 00000100:00100000:3.0:1784290384.134903:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896259200 00000100:00100000:3.0:1784290384.134951:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1228 00000100:00100000:3.0:1784290384.134962:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+20:71098:x1870961896259200:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:3.0:1784290384.134995:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290384.135012:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff600/0x5953bbf6b3074e11 lrc: 2/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b24d3 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.135084:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff000/0x5953bbf6b3074e18 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.135100:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff000/0x5953bbf6b3074e18 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.135111:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff000/0x5953bbf6b3074e18 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290384.135121:0:66008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1784290384.135188:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff600/0x5953bbf6b3074e11 lrc: 0/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24d3 expref: 23 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.135209:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff000/0x5953bbf6b3074e18 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24d3 expref: 22 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.135219:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c2449fa5100) 00010000:00010000:3.0:1784290384.135223:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784290384.135227:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2ff000, rc 0) 00000100:00100000:3.0:1784290384.135278:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+22:71098:x1870961896259200:12345-192.168.202.6@tcp:101:rm.0 Request processed in 317us (465us total) trans 81604378757 rc 0/0 00000100:00100000:3.0:1784290384.135287:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1228 00000100:00100000:2.0:1784290384.137179:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290384.137315:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896259328 00000100:00100000:1.0:1784290384.137326:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896259328 00000100:00100000:1.0:1784290384.137456:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1229 00000100:00100000:1.0:1784290384.137470:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:71098:x1870961896259328:12345-192.168.202.6@tcp:41:rm.0 00000004:00000024:1.0:1784290384.137517:0:65989:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7846010880 avail 7382958080 00000100:00100000:1.0:1784290384.137591:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:71098:x1870961896259328:12345-192.168.202.6@tcp:41:rm.0 Request processed in 121us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290384.137606:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1229 00000100:00100000:2.0:1784290384.139678:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290384.139744:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896259584 00000100:00100000:3.0:1784290384.139754:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896259584 00000100:00100000:3.0:1784290384.139807:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1230 00000100:00100000:3.0:1784290384.139830:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+22:71098:x1870961896259584:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:3.0:1784290384.139874:0:74876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784290384.139900:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab800/0x5953bbf6b3074bcc lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2494 expref: 22 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.139920:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff9c2475807f00) 00010000:00010000:3.0:1784290384.139936:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3074dfc lrc: 0/0,0 mode: --/PR res: [0x240006991:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24c5 expref: 21 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.139948:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c2449fa5100) 00010000:00010000:3.0:1784290384.139952:0:74876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290384.139968:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe000/0x5953bbf6b3074e26 lrc: 3/0,1 mode: --/CW res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.139981:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe000/0x5953bbf6b3074e26 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.139991:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe000/0x5953bbf6b3074e26 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140003:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe400/0x5953bbf6b3074e2d lrc: 3/0,1 mode: --/PW res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140011:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe400/0x5953bbf6b3074e2d lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140019:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe400/0x5953bbf6b3074e2d lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140099:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ffa00/0x5953bbf6b3074e34 lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140121:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ffa00/0x5953bbf6b3074e34 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140131:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ffa00/0x5953bbf6b3074e34 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784290384.140439:0:74876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x4c:0x0].2, 64 off8320 00000004:00080000:3.0:1784290384.140453:0:74876:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 2125380110995ns, next at 2126380108799ns, rc = 0 00010000:00010000:3.0:1784290384.140504:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff600/0x5953bbf6b3074e3b lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140517:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff600/0x5953bbf6b3074e3b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140529:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff600/0x5953bbf6b3074e3b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140539:0:74876:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff600/0x5953bbf6b3074e3b lrc: 4/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140547:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff600/0x5953bbf6b3074e3b lrc: 4/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140555:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff600/0x5953bbf6b3074e3b lrc: 3/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140579:0:74876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290384.140595:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ffa00/0x5953bbf6b3074e34 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140603:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ffa00/0x5953bbf6b3074e34 lrc: 2/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140622:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ffa00/0x5953bbf6b3074e34 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140632:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2ffa00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290384.140637:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ffa00/0x5953bbf6b3074e34 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140648:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ffa00/0x5953bbf6b3074e34 lrc: 4/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.140659:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290384.140664:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff9c245a793800) 00010000:00010000:3.0:1784290384.140672:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784290384.140679:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff600/0x5953bbf6b3074e3b lrc: 2/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140680:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ffa00/0x5953bbf6b3074e34 lrc: 2/0,0 mode: --/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140714:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ffa00/0x5953bbf6b3074e34 lrc: 0/0,0 mode: --/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.140721:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2ff600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290384.140733:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff600/0x5953bbf6b3074e3b lrc: 2/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140740:0:74876:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe000/0x5953bbf6b3074e26 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.140759:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff600/0x5953bbf6b3074e3b lrc: 3/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140760:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe000/0x5953bbf6b3074e26 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140799:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe000/0x5953bbf6b3074e26 lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140813:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe000/0x5953bbf6b3074e26 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.140814:0:8418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff9c245a793800) 00010000:00010000:2.0:1784290384.140830:0:8418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784290384.140833:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fe000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290384.140840:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff600/0x5953bbf6b3074e3b lrc: 1/0,0 mode: --/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140851:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe000/0x5953bbf6b3074e26 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.140864:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff600/0x5953bbf6b3074e3b lrc: 0/0,0 mode: --/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140869:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe000/0x5953bbf6b3074e26 lrc: 5/0,0 mode: CW/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140908:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c2449fa5100) 00010000:00010000:3.0:1784290384.140912:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290384.140917:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe000/0x5953bbf6b3074e26 lrc: 3/0,0 mode: --/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.140923:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.140927:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe000/0x5953bbf6b3074e26 lrc: 0/0,0 mode: --/CW res: [0x240006991:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.140931:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290384.140939:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1784290384.140950:0:74876:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f25deb2e reply state 0000000089194c59 transno 81604378758 ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe400/0x5953bbf6b3074e2d lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140970:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe400/0x5953bbf6b3074e2d lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.140980:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0xb1bed465 (ffff9c2475807400) 00010000:00010000:3.0:1784290384.140983:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290384.140986:0:74876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290384.141049:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+22:71098:x1870961896259584:12345-192.168.202.6@tcp:36:rm.0 Request processed in 1220us (1378us total) trans 81604378758 rc 0/0 00000100:00100000:3.0:1784290384.141059:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1230 00000100:00100000:2.0:1784290384.143277:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290384.143377:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896259840 00000100:00100000:3.0:1784290384.143387:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896259840 00000100:00100000:3.0:1784290384.143462:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 233 00000100:00100000:3.0:1784290384.143474:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+22:71098:x1870961896259840:12345-192.168.202.6@tcp:35:rm.0 00000100:00100000:3.0:1784290384.143626:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+23:71098:x1870961896259840:12345-192.168.202.6@tcp:35:rm.0 Request processed in 153us (354us total) trans 81604378759 rc 0/0 00000100:00100000:3.0:1784290384.143650:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 233 00000100:00100000:2.0:1784290384.145457:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290384.145518:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896260096 00000100:00100000:3.0:1784290384.145529:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896260096 00000100:00100000:3.0:1784290384.145583:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1231 00000100:00100000:3.0:1784290384.145595:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+23:71098:x1870961896260096:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:3.0:1784290384.145638:0:66004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784290384.145663:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff000/0x5953bbf6b3074e18 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24d3 expref: 23 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.145699:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c24585bf800/0x5953bbf6b3074933 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2463 expref: 22 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.145721:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c2449fa5100) 00010000:00010000:3.0:1784290384.145745:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca400/0x5953bbf6b3074dcb lrc: 0/0,0 mode: --/PR res: [0x240006991:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24b0 expref: 21 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.145764:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2442ffea00) 00010000:00010000:3.0:1784290384.145771:0:66004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290384.145788:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe800/0x5953bbf6b3074e42 lrc: 3/0,1 mode: --/CW res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.145801:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe800/0x5953bbf6b3074e42 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.145811:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe800/0x5953bbf6b3074e42 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.145826:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff200/0x5953bbf6b3074e49 lrc: 3/0,1 mode: --/PW res: [0x240006991:0x9:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.145849:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff200/0x5953bbf6b3074e49 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.145858:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff200/0x5953bbf6b3074e49 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.145923:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3074e50 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.145934:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3074e50 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.145943:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3074e50 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290384.146104:0:66004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1784290384.146118:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3074e50 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.146127:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3074e50 lrc: 2/0,0 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.146136:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3074e50 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.146142:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2ffc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290384.146147:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3074e50 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.146154:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3074e50 lrc: 4/0,0 mode: EX/EX res: [0x240006991:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.146183:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0x0 (ffff9c245a793500) 00010000:00010000:3.0:1784290384.146186:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784290384.146191:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3074e50 lrc: 2/0,0 mode: --/EX res: [0x240006991:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.146199:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3074e50 lrc: 0/0,0 mode: --/EX res: [0x240006991:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.146221:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe800/0x5953bbf6b3074e42 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.146229:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe800/0x5953bbf6b3074e42 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.146236:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe800/0x5953bbf6b3074e42 lrc: 3/0,0 mode: CW/CW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.146244:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe800/0x5953bbf6b3074e42 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.146251:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fe800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290384.146254:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe800/0x5953bbf6b3074e42 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.146261:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe800/0x5953bbf6b3074e42 lrc: 5/0,0 mode: CW/CW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.146269:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2442ffea00) 00010000:00010000:3.0:1784290384.146272:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290384.146276:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe800/0x5953bbf6b3074e42 lrc: 3/0,0 mode: --/CW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.146295:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe800/0x5953bbf6b3074e42 lrc: 0/0,0 mode: --/CW res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290384.146307:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000056d80ddb reply state 000000009e671bea transno 81604378760 ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff200/0x5953bbf6b3074e49 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.146319:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff200/0x5953bbf6b3074e49 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.146328:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0xf7117594 (ffff9c245a793600) 00010000:00010000:3.0:1784290384.146331:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290384.146334:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290384.146461:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+22:71098:x1870961896260096:12345-192.168.202.6@tcp:36:rm.0 Request processed in 866us (1004us total) trans 81604378760 rc 0/0 00000100:00100000:3.0:1784290384.146473:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1231 00000100:00100000:2.0:1784290384.148269:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290384.148394:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290384.148456:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896260224 00000100:00100000:1.0:1784290384.148467:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896260224 00000100:00100000:3.0:1784290384.148538:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896260480 00000100:00100000:1.0:1784290384.148548:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 674 00000100:00100000:3.0:1784290384.148553:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896260480 00000100:00100000:1.0:1784290384.148571:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:2399:x1870961896260224:12345-192.168.202.6@tcp:103:rm.0 00010000:00010000:1.0:1784290384.148594:0:19591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1784290384.148626:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 234 00010000:00010000:1.0:1784290384.148631:0:19591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff800/0x5953bbf6b3074d93 lrc: 0/0,0 mode: --/PR res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24a9 expref: 8 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290384.148652:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+22:71098:x1870961896260480:12345-192.168.202.6@tcp:35:rm.0 00010000:00010000:1.0:1784290384.148677:0:19591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c245a793f00) 00010000:00010000:1.0:1784290384.148699:0:19591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784290384.148764:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2399:x1870961896260224:12345-192.168.202.6@tcp:103:rm.0 Request processed in 202us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290384.148776:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 674 00000100:00100000:3.0:1784290384.148857:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+23:71098:x1870961896260480:12345-192.168.202.6@tcp:35:rm.0 Request processed in 212us (460us total) trans 81604378761 rc 0/0 00000100:00100000:3.0:1784290384.148869:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 234 00000100:00100000:2.0:1784290384.150269:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290384.150396:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896260736 00000100:00100000:0.0:1784290384.150438:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896260736 00000100:00100000:0.0:1784290384.150499:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1232 00000100:00100000:0.0:1784290384.150512:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+23:71098:x1870961896260736:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:0.0:1784290384.150554:0:65990:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784290384.150587:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff400/0x5953bbf6b3074de7 lrc: 0/0,0 mode: --/CR res: [0x240006991:0x9:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24be expref: 23 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.150612:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247c263600/0x5953bbf6b3074917 lrc: 0/0,0 mode: --/PR res: [0x240006991:0x9:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b245c expref: 22 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.150627:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2442ffea00) 00010000:00010000:0.0:1784290384.150637:0:65990:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290384.150682:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.150693:0:65990:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.150705:0:65990:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290384.150730:0:65990:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:65990:1870961901116160:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1784290384.150782:0:65990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290384.150823:0:65990:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d953c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290384.150846:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901116160 00000100:00100000:1.0:1784290384.150857:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901116160 00000100:00100000:1.0:1784290384.150935:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3841 00000100:00100000:1.0:1784290384.150948:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65990:x1870961901116160:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1784290384.150964:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290384.150982:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3074e5e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074e57 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.151011:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3074ba2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b244e expref: 6 pid: 92177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.151026:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3074e5e lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074e57 expref: 9 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.151057:0:8413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3074ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b244e expref: 6 pid: 92177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.151073:0:8413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3074ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b244e expref: 6 pid: 92177 timeout: 2225 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290384.151088:0:8413:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8413:1870961901116288:192.168.202.6@tcp:104: 00000100:00100000:1.0:1784290384.151189:0:8413:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e78300 going to sleep for 11 seconds 00000100:00100000:1.0:1784290384.152804:0:8413:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8413:1870961901116288:192.168.202.6@tcp:104: 00010000:00010000:1.0:1784290384.152835:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3074e5e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074e57 expref: 9 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.152850:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:1.0:1784290384.152865:0:8413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290384.152872:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3074e5e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074e57 expref: 9 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.152887:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8cb000, rc 0) 00000100:00100000:1.0:1784290384.152975:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65990:x1870961901116160:12345-0@lo:101:mdt00_002.0 Request processed in 2026us (2188us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290384.152986:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3841 00000100:00100000:0.0:1784290384.153054:0:65990:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:65990:1870961901116160:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1784290384.153082:0:65990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074e5e expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.153098:0:65990:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074e5e expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290384.153132:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290384.153262:0:19593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896260864 00000100:00100000:3.0:1784290384.153272:0:19593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896260864 00010000:00010000:3.0:1784290384.153299:0:19593:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3074ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b244e expref: 7 pid: 92177 timeout: 2225 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290384.153401:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2587 00000100:00100000:3.0:1784290384.153456:0:19593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2399:x1870961896260864:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784290384.153472:0:19593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290384.153482:0:19593:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3074ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b244e expref: 7 pid: 92177 timeout: 2225 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.153501:0:19593:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3074ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b244e expref: 7 pid: 92177 timeout: 2225 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.153522:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3074ba2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b244e expref: 7 pid: 92177 timeout: 2225 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.153539:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:3.0:1784290384.153546:0:19593:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3074e5e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074e57 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.153560:0:19593:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3074e5e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x5953bbf6b3074e57 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.153570:0:19593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3074e5e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x5953bbf6b3074e57 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.153601:0:19593:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3074e5e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074e57 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290384.153614:0:19593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000_UUID:19593:1870961901116416:0@lo:105: 00000100:00100000:3.0:1784290384.153667:0:19593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290384.153742:0:19593:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dac63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290384.153755:0:7428:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784290384.153783:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901116416 00000100:00100000:2.0:1784290384.153791:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901116416 00000100:00100000:2.0:1784290384.153841:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1784290384.153853:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24468d8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:19593:x1870961901116416:12345-0@lo:105: 00010000:00010000:2.0:1784290384.153869:0:7428:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074e5e expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.153884:0:7428:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074e5e expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.153896:0:7428:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074e5e expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.153906:0:7428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x5953bbf6b3074e5e expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.153916:0:7428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x5953bbf6b3074e5e expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.153927:0:7428:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x5953bbf6b3074e5e expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.153972:0:7428:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9c2345ebec00) 00000100:00100000:2.0:1784290384.154036:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24468d8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:19593:x1870961901116416:12345-0@lo:105: Request processed in 181us (366us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290384.154041:0:65990:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074e5e expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290384.154052:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1784290384.154086:0:19593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_008:lustre-MDT0000_UUID:19593:1870961901116416:0@lo:105: 00010000:00010000:0.0:1784290384.154088:0:65990:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074e5e expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.154122:0:19593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:0.0:1784290384.154131:0:65990:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1784290384.154189:0:19593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2399:x1870961896260864:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 736us (1065us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290384.154194:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf000/0x5953bbf6b3074e65 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290384.154208:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2587 00010000:00010000:0.0:1784290384.154229:0:65990:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf000/0x5953bbf6b3074e65 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.154250:0:65990:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf000/0x5953bbf6b3074e65 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290384.154281:0:65990:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:65990:1870961901116544:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1784290384.154336:0:65990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290384.154405:0:65990:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d953c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290384.154510:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901116544 00000100:00100000:3.0:1784290384.154519:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901116544 00000100:00100000:3.0:1784290384.154562:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3842 00000100:00100000:3.0:1784290384.154571:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65990:x1870961901116544:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1784290384.154586:0:23867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290384.154605:0:23867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe600/0x5953bbf6b3074e6c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074e65 expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.154629:0:23867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe600/0x5953bbf6b3074e6c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074e65 expref: 10 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.154649:0:23867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe600/0x5953bbf6b3074e6c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074e65 expref: 10 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.154665:0:23867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9c245a793d00) 00010000:00010000:3.0:1784290384.154671:0:23867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290384.154675:0:23867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2fe600, rc 0) 00000100:00100000:3.0:1784290384.154750:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:65990:x1870961901116544:12345-0@lo:101:mdt00_002.0 Request processed in 175us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290384.154764:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3842 00000100:00100000:0.0:1784290384.154802:0:65990:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:65990:1870961901116544:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1784290384.154821:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf000/0x5953bbf6b3074e65 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074e6c expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.154835:0:65990:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf000/0x5953bbf6b3074e65 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074e6c expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784290384.154851:0:65990:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1784290384.154891:0:65990:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:65990:1870961901116672:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784290384.154930:0:65990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290384.154963:0:65990:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784290384.155052:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901116672 00000100:00100000:2.0:1784290384.155063:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901116672 00000100:00100000:2.0:1784290384.155123:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3843 00000100:00100000:2.0:1784290384.155144:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:65990:x1870961901116672:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784290384.155272:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:65990:x1870961901116672:12345-0@lo:1000:mdt00_002.0 Request processed in 136us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290384.155283:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3843 00000100:00100000:0.0:1784290384.155366:0:65990:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:65990:1870961901116672:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784290384.155458:0:65990:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:65990:1870961901116800:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784290384.155496:0:65990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290384.155534:0:65990:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784290384.155567:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901116800 00000100:00100000:2.0:1784290384.155575:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901116800 00000100:00100000:2.0:1784290384.155614:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3844 00000100:00100000:2.0:1784290384.155624:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:65990:x1870961901116800:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784290384.155726:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:65990:x1870961901116800:12345-0@lo:1000:mdt00_002.0 Request processed in 102us (227us total) trans 0 rc 1/1 00000100:00100000:2.0:1784290384.155735:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3844 00000100:00100000:0.0:1784290384.155785:0:65990:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:65990:1870961901116800:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1784290384.155836:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebe800/0x5953bbf6b3074e73 lrc: 3/0,1 mode: --/EX res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.155846:0:65990:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebe800/0x5953bbf6b3074e73 lrc: 3/0,1 mode: --/EX res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.155856:0:65990:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebe800/0x5953bbf6b3074e73 lrc: 3/0,1 mode: --/EX res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290384.155871:0:65990:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:65990:1870961901116928:0@lo:101:mdt00_002.0 00000100:00100000:0.0:1784290384.155904:0:65990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290384.155936:0:65990:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d953c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290384.155987:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901116928 00000100:00100000:1.0:1784290384.156001:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901116928 00000100:00100000:1.0:1784290384.156062:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3845 00000100:00100000:1.0:1784290384.156074:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:65990:x1870961901116928:12345-0@lo:101:mdt00_002.0 00010000:00010000:1.0:1784290384.156088:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290384.156105:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb800/0x5953bbf6b3074e7a lrc: 2/0,0 mode: --/EX res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074e73 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.156131:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb800/0x5953bbf6b3074e7a lrc: 3/0,0 mode: EX/EX res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074e73 expref: 11 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.156148:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb800/0x5953bbf6b3074e7a lrc: 3/0,0 mode: EX/EX res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074e73 expref: 11 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.156159:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2475807600) 00010000:00010000:1.0:1784290384.156164:0:8413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784290384.156168:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8cb800, rc 0) 00000100:00100000:1.0:1784290384.156230:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:65990:x1870961901116928:12345-0@lo:101:mdt00_002.0 Request processed in 157us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290384.156239:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3845 00000100:00100000:0.0:1784290384.156284:0:65990:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:65990:1870961901116928:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1784290384.156303:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebe800/0x5953bbf6b3074e73 lrc: 4/0,1 mode: EX/EX res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074e7a expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.156316:0:65990:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebe800/0x5953bbf6b3074e73 lrc: 4/0,1 mode: EX/EX res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074e7a expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.156390:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebfe00/0x5953bbf6b3074e81 lrc: 3/0,1 mode: --/EX res: [0x240006991:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.156404:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebfe00/0x5953bbf6b3074e81 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.156463:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebfe00/0x5953bbf6b3074e81 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784290384.156777:0:65990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a4:0x1:0x0].2, 432 off34200 00000040:00080000:0.0:1784290384.156828:0:65990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000c751:0x1:0x0].2, 512 off34432 00000004:00080000:0.0:1784290384.156836:0:65990:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c2345d953c0 with version 9 00000004:00080000:1.0:1784290384.156900:0:75392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9c2344dd4900 version 9 rpc_version 9 00000020:00100000:1.0:1784290384.156943:0:75392:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784290384.156958:0:75392:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c246a4fa680 x1870961901117184/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1760/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784290384.156984:0:75392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4fa680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75392:1870961901117184:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784290384.157029:0:75392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290384.157061:0:75392:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e78300 going to sleep for 11 seconds 00000100:00100000:3.0:1784290384.157139:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901117184 00000100:00100000:3.0:1784290384.157150:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901117184 00000100:00100000:3.0:1784290384.157206:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3846 00000100:00100000:3.0:1784290384.157229:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75392:x1870961901117184:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784290384.159909:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75392:x1870961901117184:12345-0@lo:1000:osp_up0-1.0 Request processed in 2679us (2875us total) trans 115964116994 rc 0/0 00000100:00100000:3.0:1784290384.159921:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3846 00000100:00100000:1.0:1784290384.160012:0:75392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4fa680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75392:1870961901117184:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1784290384.160107:0:65990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x240006991:0x9:0x0]: returning size 4096 00010000:00010000:0.0:1784290384.160165:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebfe00/0x5953bbf6b3074e81 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.160184:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebfe00/0x5953bbf6b3074e81 lrc: 2/0,0 mode: EX/EX res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.160198:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebfe00/0x5953bbf6b3074e81 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.160211:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebfe00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290384.160219:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebfe00/0x5953bbf6b3074e81 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.160234:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebfe00/0x5953bbf6b3074e81 lrc: 4/0,0 mode: EX/EX res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.160255:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2461de5f00) 00010000:00010000:0.0:1784290384.160260:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290384.160268:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebfe00/0x5953bbf6b3074e81 lrc: 2/0,0 mode: --/EX res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.160280:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebfe00/0x5953bbf6b3074e81 lrc: 0/0,0 mode: --/EX res: [0x240006991:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.160323:0:65990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebe800/0x5953bbf6b3074e73 lrc: 4/0,1 mode: EX/EX res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074e7a expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.160335:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebe800/0x5953bbf6b3074e73 lrc: 4/0,1 mode: EX/EX res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3074e7a expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.160374:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebe800/0x5953bbf6b3074e73 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3074e7a expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.160403:0:65990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1784290384.160444:0:65990:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1784290384.160447:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290384.160452:0:65990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074e5e expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.160460:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebe800/0x5953bbf6b3074e73 lrc: 2/0,0 mode: EX/EX res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3074e7a expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.160469:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3074e5e expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.160485:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebe800 already unused, calling callback (ffffffffc1ac6ed0) 00010000:00010000:0.0:1784290384.160491:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3074e5e expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.160497:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebe800/0x5953bbf6b3074e73 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3074e7a expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784290384.160524:0:6477:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebe800/0x5953bbf6b3074e73 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3074e7a expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.160539:0:65990:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1784290384.160551:0:65990:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1784290384.160566:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf000/0x5953bbf6b3074e65 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074e6c expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.160568:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebe800/0x5953bbf6b3074e73 lrc: 2/0,0 mode: --/EX res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074e7a expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.160569:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290384.160585:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3074e5e expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.160620:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784290384.160622:0:65990:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf000/0x5953bbf6b3074e65 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074e6c expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.160625:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebec00 already unused, calling callback (ffffffffc1ac6ed0) 00010000:00010000:3.0:1784290384.160637:0:19681:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3074e5e expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290384.160666:0:19681:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3074e5e expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.160678:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebe800/0x5953bbf6b3074e73 lrc: 1/0,0 mode: --/EX res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074e7a expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290384.160703:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebe800/0x5953bbf6b3074e73 lrc: 0/0,0 mode: --/EX res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074e7a expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290384.160722:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901117312:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784290384.160741:0:19681:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074e5e expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290384.160756:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+22:71098:x1870961896260736:12345-192.168.202.6@tcp:36:rm.0 Request processed in 10239us (10483us total) trans 81604378762 rc 0/0 00010000:00010000:1.0:1784290384.160778:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.160781:0:19681:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784290384.160786:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290384.160788:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1232 00010000:00010000:1.0:1784290384.160798:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290384.160806:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784290384.160809:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074e5e expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.160824:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebec00/0x5953bbf6b3074e57 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074e5e expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290384.160854:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290384.160856:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901117440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784290384.160863:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290384.160872:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290384.160925:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901117312 00000100:00100000:3.0:1784290384.160946:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901117312 00000100:00100000:1.0:1784290384.160948:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290384.161035:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901117440 00000100:00100000:3.0:1784290384.161042:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901117440 00000100:00100000:2.0:1784290384.161053:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:0.0:1784290384.161082:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:2.0:1784290384.161083:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+13:3619:x1870961901117312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290384.161109:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784290384.161115:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+13:3620:x1870961901117440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290384.161136:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb800/0x5953bbf6b3074e7a lrc: 0/0,0 mode: --/EX res: [0x240006991:0x9:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074e73 expref: 13 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290384.161143:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290384.161180:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3074e5e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074e57 expref: 12 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290384.161187:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0x0 (ffff9c2475807600) 00010000:00010000:2.0:1784290384.161211:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290384.161223:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:0.0:1784290384.161234:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784290384.161289:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3619:x1870961901117312:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290384.161302:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:1.0:1784290384.161332:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901117312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290384.161398:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+10:3620:x1870961901117440:12345-0@lo:103:ldlm_bl.0 Request processed in 237us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290384.161439:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:3.0:1784290384.161581:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901117440:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290384.551617:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290385.413714:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290385.413756:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290385.413782:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290385.413816:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290385.413819:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896260992 00000100:00100000:1.0:1784290385.413829:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896261120 00000100:00100000:0.0:1784290385.413833:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896260992 00000100:00100000:1.0:1784290385.413839:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896261120 00000100:00100000:2.0:1784290385.413856:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290385.413876:0:26263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896261504 00000100:00100000:3.0:1784290385.413886:0:26263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896261504 00000100:00100000:1.0:1784290385.413932:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896261248 00000100:00100000:1.0:1784290385.413940:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896261248 00000100:00100000:0.0:1784290385.413941:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:0.0:1784290385.413962:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2398:x1870961896260992:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290385.413966:0:26263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896261376 00000100:00100000:3.0:1784290385.413973:0:26263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896261376 00000100:00100000:2.0:1784290385.413979:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4960 00000100:00100000:1.0:1784290385.413993:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 720 00000100:00100000:2.0:1784290385.414001:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2396:x1870961896261504:12345-192.168.202.6@tcp:9:kworker.0 00000100:00100000:1.0:1784290385.414012:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2397:x1870961896261120:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290385.414021:0:26263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1595 00000020:00000080:2.0:1784290385.414033:0:26258:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30748df 00000100:00100000:3.0:1784290385.414039:0:26263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2397:x1870961896261376:12345-192.168.202.6@tcp:400:kworker.0 00000100:00080000:2.0:1784290385.414049:0:26258:0:(import.c:65:import_set_state_nolock()) ffff9c246dcfe800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1784290385.414053:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2398:x1870961896260992:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 96us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290385.414064:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 73 00000100:00100000:1.0:1784290385.414074:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2397:x1870961896261120:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 67us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290385.414084:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 720 00000100:00100000:3.0:1784290385.414100:0:26263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475f3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2397:x1870961896261376:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 66us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290385.414115:0:26263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1595 00000001:00000004:2.0:1784290385.414116:0:26258:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968631 00000100:00100000:1.0:1784290385.414117:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 721 00000100:00100000:1.0:1784290385.414138:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247580a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+22:2398:x1870961896261248:12345-192.168.202.6@tcp:400:kworker.0 00000100:00080000:3.0:1784290385.414148:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784290385.414190:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247580a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+22:2398:x1870961896261248:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 56us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290385.414201:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 721 00010000:00010000:3.0:1784290385.414215:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290385.414299:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+2:2396:x1870961896261504:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 307us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290385.414309:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4960 00010000:00010000:2.0:1784290385.575469:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290386.087582:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901117568:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784290386.087679:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290386.087763:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901117568 00000100:00100000:0.0:1784290386.087777:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901117568 00000100:00080000:2.0:1784290386.087861:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290386.087876:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:0.0:1784290386.087897:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901117568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784290386.087949:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784290386.088040:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475808700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901117568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 150us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290386.088051:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:2.0:1784290386.088102:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901117568:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1784290386.088547:0:75395:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 2127328204186ns, next at 2128328199542ns, rc = 0 00000100:00100000:3.0:1784290386.088554:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901117696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1784290386.088599:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290386.088673:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901117696 00000100:00100000:0.0:1784290386.088680:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901117696 00000100:00080000:2.0:1784290386.088739:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784290386.088746:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:0.0:1784290386.088764:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901117696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1784290386.088789:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290386.088851:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901117696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290386.088862:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:3.0:1784290386.088900:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901117696:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1784290386.599637:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784290386.836780:0:92727:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 134: replay creation of a file created in a pool ========================================================== 08:13:06 (1784290386) 00000020:00000080:1.0:1784290387.249315:0:92776:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffdc8cd8ae0 20000000:00000080:1.0:1784290387.249331:0:92776:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9c247b252400 uarg=0000000000000000 00000040:00100000:1.0:1784290387.250020:0:92776:0:(llog.c:1072:llog_reverse_process()) index 51 : idx 49 00000040:00100000:1.0:1784290387.250028:0:92776:0:(llog.c:1072:llog_reverse_process()) index 47 : idx 1 00000040:00080000:1.0:1784290387.250110:0:92776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].52, 224 off17176 20000000:01000000:1.0:1784290387.250126:0:92776:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:1.0:1784290387.250138:0:92776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].53, 112 off17288 00000040:00080000:1.0:1784290387.250150:0:92776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].54, 224 off17512 00000040:00080000:1.0:1784290387.250196:0:92776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 224 off16208 20000000:01000000:1.0:1784290387.250203:0:92776:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:1.0:1784290387.250213:0:92776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 120 off16328 00000040:00080000:1.0:1784290387.250399:0:92776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].49, 224 off16608 00000040:00080000:1.0:1784290387.250710:0:92776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].46, 224 off16240 20000000:01000000:1.0:1784290387.250720:0:92776:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:1.0:1784290387.250735:0:92776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].47, 120 off16360 00000040:00080000:1.0:1784290387.250828:0:92776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].49, 224 off16608 10000000:01000000:1.0:1784290387.250845:0:92776:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1784290387.250865:0:92776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b3074e88 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.250884:0:92776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c24585bee00/0x5953bbf6b30749aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30749a3 expref: 23 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.250891:0:92776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c246dd27800/0x5953bbf6b3074a83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074a7c expref: 23 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.250897:0:92776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c23450aa000/0x5953bbf6b3074ab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074aad expref: 23 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.250902:0:92776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c24585bf000/0x5953bbf6b3074ad0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074ac9 expref: 23 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.250907:0:92776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c24585be400/0x5953bbf6b3074afa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074af3 expref: 23 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.250921:0:92776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c24585bfa00/0x5953bbf6b3074b08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074b01 expref: 23 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.250926:0:92776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c24585bec00/0x5953bbf6b3074b24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074b1d expref: 23 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.250931:0:92776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c247c263a00/0x5953bbf6b3074b32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074b2b expref: 23 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.250937:0:92776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b3074b5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074b55 expref: 23 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.250944:0:92776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c24585bf400/0x5953bbf6b3074b71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b247f expref: 9 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.250949:0:92776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c246dd26400/0x5953bbf6b3074b7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b248d expref: 9 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.250954:0:92776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b3074e88 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.250989:0:92776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c246dd26400/0x5953bbf6b3074b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b248d expref: 9 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.251000:0:92776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c246dd26400/0x5953bbf6b3074b7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b248d expref: 9 pid: 92149 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290387.251013:0:92776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d03800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901117824:192.168.202.6@tcp:104: 00010000:00010000:1.0:1784290387.251097:0:92776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c24585bf400/0x5953bbf6b3074b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b247f expref: 9 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.251110:0:92776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c24585bf400/0x5953bbf6b3074b71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b247f expref: 9 pid: 92154 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290387.251117:0:92776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d02a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901117952:192.168.202.6@tcp:104: 00010000:00010000:1.0:1784290387.251147:0:92776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b3074b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3074b55 expref: 23 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.251154:0:92776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b3074b5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3074b55 expref: 23 pid: 92154 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290387.251162:0:92776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d00e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901118080:0@lo:104: 00000100:00100000:1.0:1784290387.251203:0:92776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784290387.251229:0:92776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c247c263a00/0x5953bbf6b3074b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3074b2b expref: 23 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.251237:0:92776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c247c263a00/0x5953bbf6b3074b32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3074b2b expref: 23 pid: 92152 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290387.251244:0:92776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d00380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901118208:0@lo:104: 00000100:00100000:1.0:1784290387.251262:0:92776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784290387.251286:0:92776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c24585bec00/0x5953bbf6b3074b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3074b1d expref: 23 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.251293:0:92776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c24585bec00/0x5953bbf6b3074b24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3074b1d expref: 23 pid: 92154 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290387.251300:0:92776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901118336:0@lo:104: 00000100:00100000:0.0:1784290387.251309:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901118080 00000100:00100000:1.0:1784290387.251318:0:92776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290387.251318:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901118080 00000100:00100000:3.0:1784290387.251393:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901118208 00000100:00100000:3.0:1784290387.251405:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901118208 00000100:00100000:2.0:1784290387.251412:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901118336 00000100:00100000:2.0:1784290387.251421:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901118336 00000100:00100000:0.0:1784290387.251428:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1784290387.251449:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:92776:x1870961901118080:12345-0@lo:104: 00010000:00010000:1.0:1784290387.251455:0:92776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c24585bfa00/0x5953bbf6b3074b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3074b01 expref: 23 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290387.251464:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00010000:00010000:0.0:1784290387.251465:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c24585be000/0x5953bbf6b3074b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074b5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.251485:0:92776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c24585bfa00/0x5953bbf6b3074b08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3074b01 expref: 23 pid: 92149 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290387.251496:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:92776:x1870961901118208:12345-0@lo:104: 00000100:00100000:2.0:1784290387.251497:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1784290387.251524:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:92776:x1870961901118336:12345-0@lo:104: 00000100:00100000:1.0:1784290387.251527:0:92776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901118464:0@lo:104: 00010000:00010000:3.0:1784290387.251532:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3074b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074b32 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290387.251536:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1784290387.251540:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c246dd26600/0x5953bbf6b3074b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074b24 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.251562:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:92776:x1870961901118080:12345-0@lo:104: Request processed in 114us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290387.251571:0:92776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290387.251584:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00010000:00010000:1.0:1784290387.251604:0:92776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c24585be400/0x5953bbf6b3074afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3074af3 expref: 23 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.251609:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901118464 00010000:00010000:1.0:1784290387.251615:0:92776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c24585be400/0x5953bbf6b3074afa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3074af3 expref: 23 pid: 92151 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.251616:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901118464 00000100:00100000:1.0:1784290387.251633:0:92776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901118592:0@lo:104: 00000100:00100000:0.0:1784290387.251655:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00010000:00010000:3.0:1784290387.251660:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1784290387.251669:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784290387.251670:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:92776:x1870961901118208:12345-0@lo:104: Request processed in 185us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290387.251674:0:92776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290387.251687:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:92776:x1870961901118336:12345-0@lo:104: Request processed in 165us (359us total) trans 0 rc 0/0 00010000:00010000:1.0:1784290387.251694:0:92776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c24585bf000/0x5953bbf6b3074ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3074ac9 expref: 23 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.251698:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:92776:x1870961901118464:12345-0@lo:104: 00000100:00100000:3.0:1784290387.251720:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00010000:00010000:0.0:1784290387.251734:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c247c262000/0x5953bbf6b3074b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074b08 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290387.251739:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00010000:00010000:1.0:1784290387.251739:0:92776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c24585bf000/0x5953bbf6b3074ad0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3074ac9 expref: 23 pid: 92149 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290387.251748:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901118592 00000100:00100000:3.0:1784290387.251762:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901118592 00000100:00100000:1.0:1784290387.251769:0:92776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901118720:0@lo:104: 00010000:00010000:2.0:1784290387.251773:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784290387.251780:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c24585be000/0x5953bbf6b3074b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074b5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.251790:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585be000 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:2.0:1784290387.251795:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c24585be000/0x5953bbf6b3074b55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3074b5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.251806:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c24585be000/0x5953bbf6b3074b55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3074b5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290387.251813:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1784290387.251831:0:92776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784290387.251831:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784290387.251832:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:92776:x1870961901118592:12345-0@lo:104: 10000000:00010000:2.0:1784290387.251832:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c24585be000/0x5953bbf6b3074b55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3074b5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.251856:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:92776:x1870961901118464:12345-0@lo:104: Request processed in 171us (288us total) trans 0 rc 0/0 00010000:00010000:3.0:1784290387.251860:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c247c263c00/0x5953bbf6b3074af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074afa expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290387.251860:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1784290387.251873:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00010000:00010000:1.0:1784290387.251880:0:92776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c23450aa000/0x5953bbf6b3074ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3074aad expref: 23 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.251898:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901118720 00010000:00010000:2.0:1784290387.251905:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c24585be000/0x5953bbf6b3074b55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074b5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.251907:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901118720 00010000:00010000:1.0:1784290387.251913:0:92776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c23450aa000/0x5953bbf6b3074ab4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3074aad expref: 23 pid: 92152 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.251918:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784290387.251930:0:92776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901118848:0@lo:104: 00000100:00100000:0.0:1784290387.251947:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00010000:00010000:3.0:1784290387.251958:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:2.0:1784290387.251961:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c24585be000/0x5953bbf6b3074b55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074b5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.251966:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:92776:x1870961901118720:12345-0@lo:104: 00000100:00100000:3.0:1784290387.251973:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:92776:x1870961901118592:12345-0@lo:104: Request processed in 142us (296us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290387.251989:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c23450ab400/0x5953bbf6b3074ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074ad0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290387.251994:0:92776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784290387.252010:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c24585be000/0x5953bbf6b3074b55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074b5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290387.252016:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00010000:00010000:1.0:1784290387.252029:0:92776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c246dd27800/0x5953bbf6b3074a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3074a7c expref: 23 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.252042:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784290387.252044:0:92776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c246dd27800/0x5953bbf6b3074a83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3074a7c expref: 23 pid: 92154 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.252048:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3074b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074b32 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290387.252059:0:92776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901119104:0@lo:104: 00000100:00100000:3.0:1784290387.252060:0:6471:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1784290387.252060:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aba00 already unused, calling callback (ffffffffc14a9c20) 00010000:00010000:0.0:1784290387.252063:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 10000000:00010000:2.0:1784290387.252073:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3074b2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3074b32 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.252087:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:92776:x1870961901118720:12345-0@lo:104: Request processed in 128us (263us total) trans 0 rc 0/0 00010000:00010000:2.0:1784290387.252088:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3074b2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3074b32 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.252097:0:92776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c24585bee00/0x5953bbf6b30749aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b30749a3 expref: 23 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290387.252118:0:6471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1784290387.252127:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3074b2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3074b32 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.252133:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00010000:00010000:1.0:1784290387.252137:0:92776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c24585bee00/0x5953bbf6b30749aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b30749a3 expref: 23 pid: 92149 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290387.252139:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1784290387.252143:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901118848 00000100:00100000:3.0:1784290387.252155:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901118848 00000100:00100000:0.0:1784290387.252156:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901119104 00000100:00100000:1.0:1784290387.252161:0:92776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901119232:0@lo:104: 00000100:00100000:0.0:1784290387.252164:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901119104 00010000:00010000:2.0:1784290387.252166:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3074b2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074b32 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.252173:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784290387.252181:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3074b2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074b32 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.252187:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3074b2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074b32 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.252194:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00010000:00010000:2.0:1784290387.252198:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:1.0:1784290387.252200:0:92776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784290387.252211:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c246dd26600/0x5953bbf6b3074b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074b24 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.252211:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:92776:x1870961901119104:12345-0@lo:104: 00000100:00100000:1.0:1784290387.252216:0:92776:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23432cfb40 going to sleep for 11 seconds 00010000:00010000:2.0:1784290387.252229:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26600 already unused, calling callback (ffffffffc14a9c20) 00010000:00010000:0.0:1784290387.252229:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c24585bea00/0x5953bbf6b3074a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074a83 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290387.252237:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c246dd26600/0x5953bbf6b3074b1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3074b24 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.252245:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c246dd26600/0x5953bbf6b3074b1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3074b24 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290387.252252:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c246dd26600/0x5953bbf6b3074b1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3074b24 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290387.252254:0:92776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d00e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901118080:0@lo:104: 10000000:01000000:2.0:1784290387.252267:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1784290387.252284:0:92776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d00380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901118208:0@lo:104: 00010000:00010000:0.0:1784290387.252287:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:2.0:1784290387.252288:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c246dd26600/0x5953bbf6b3074b1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074b24 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.252297:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784290387.252299:0:92776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901118336:0@lo:104: 00000100:00100000:0.0:1784290387.252299:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:92776:x1870961901119104:12345-0@lo:104: Request processed in 90us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290387.252313:0:92776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901118464:0@lo:104: 00010000:00010000:2.0:1784290387.252317:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c246dd26600/0x5953bbf6b3074b1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074b24 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.252319:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1784290387.252328:0:92776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901118592:0@lo:104: 00010000:00010000:2.0:1784290387.252331:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c246dd26600/0x5953bbf6b3074b1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074b24 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290387.252390:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901119232 00000100:00100000:3.0:1784290387.252397:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901119232 00010000:00010000:2.0:1784290387.252398:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:1.0:1784290387.252403:0:92776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901118720:0@lo:104: 00000100:00100000:0.0:1784290387.252403:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00010000:00010000:2.0:1784290387.252405:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247c262000/0x5953bbf6b3074b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074b08 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.252420:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c262000 already unused, calling callback (ffffffffc14a9c20) 00000100:00100000:0.0:1784290387.252426:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe7c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:92776:x1870961901118848:12345-0@lo:104: 10000000:00010000:2.0:1784290387.252427:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247c262000/0x5953bbf6b3074b01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3074b08 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290387.252437:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1784290387.252437:0:92776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901119104:0@lo:104: 00010000:00010000:0.0:1784290387.252454:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c24585be200/0x5953bbf6b3074aad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074ab4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290387.252469:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:92776:x1870961901119232:12345-0@lo:104: 00010000:00010000:3.0:1784290387.252496:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30749a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b30749aa expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.252496:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247c262000/0x5953bbf6b3074b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3074b08 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290387.252504:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1784290387.252520:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe7c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:92776:x1870961901118848:12345-0@lo:104: Request processed in 103us (540us total) trans 0 rc 0/0 10000000:00010000:2.0:1784290387.252521:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247c262000/0x5953bbf6b3074b01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3074b08 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.252534:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 10000000:01000000:2.0:1784290387.252535:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290387.252553:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784290387.252561:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247c262000/0x5953bbf6b3074b01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074b08 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.252562:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247c263c00/0x5953bbf6b3074af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074afa expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.252590:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784290387.252606:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c263c00 already unused, calling callback (ffffffffc14a9c20) 00010000:00010000:2.0:1784290387.252609:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247c262000/0x5953bbf6b3074b01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074b08 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290387.252611:0:19681:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247c263c00/0x5953bbf6b3074af3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3074afa expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290387.252622:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1784290387.252642:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:92776:x1870961901119232:12345-0@lo:104: Request processed in 183us (442us total) trans 0 rc 0/0 00010000:00010000:2.0:1784290387.252644:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247c262000/0x5953bbf6b3074b01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074b08 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.252644:0:19681:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247c263c00/0x5953bbf6b3074af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3074afa expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290387.252678:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 10000000:00010000:1.0:1784290387.252695:0:19681:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247c263c00/0x5953bbf6b3074af3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3074afa expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.252702:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:2.0:1784290387.252708:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 10000000:01000000:1.0:1784290387.252708:0:19681:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784290387.252715:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c23450ab400/0x5953bbf6b3074ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074ad0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.252723:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab400 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:2.0:1784290387.252726:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c23450ab400/0x5953bbf6b3074ac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3074ad0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.252732:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450ab400/0x5953bbf6b3074ac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3074ad0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.252738:0:19681:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247c263c00/0x5953bbf6b3074af3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074afa expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290387.252739:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450ab400/0x5953bbf6b3074ac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3074ad0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.252745:0:19681:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784290387.252747:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896261632 00000100:00100000:0.0:1784290387.252755:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896261632 00010000:00010000:1.0:1784290387.252756:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247c263c00/0x5953bbf6b3074af3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074afa expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290387.252757:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290387.252769:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247c263c00/0x5953bbf6b3074af3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074afa expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290387.252783:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c246dd26400/0x5953bbf6b3074b7f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b248d expref: 10 pid: 92149 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.252784:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c23450ab400/0x5953bbf6b3074ac9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074ad0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.252786:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784290387.252794:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c24585bea00/0x5953bbf6b3074a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074a83 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290387.252799:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784290387.252808:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784290387.252816:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c24585be200/0x5953bbf6b3074aad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074ab4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.252819:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c23450ab400/0x5953bbf6b3074ac9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074ad0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.252822:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585bea00 already unused, calling callback (ffffffffc14a9c20) 00000100:00100000:0.0:1784290387.252832:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2588 10000000:00010000:1.0:1784290387.252836:0:19681:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c24585bea00/0x5953bbf6b3074a7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3074a83 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290387.252847:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24585be200 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:3.0:1784290387.252862:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c24585be200/0x5953bbf6b3074aad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3074ab4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.252863:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450ab400/0x5953bbf6b3074ac9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074ad0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.252863:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a541180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2399:x1870961896261632:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784290387.252897:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290387.252913:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c24585be200/0x5953bbf6b3074aad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3074ab4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290387.252915:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c246dd26400/0x5953bbf6b3074b7f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b248d expref: 10 pid: 92149 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.252917:0:19681:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c24585bea00/0x5953bbf6b3074a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3074a83 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.252919:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290387.252934:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30749a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b30749aa expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784290387.252966:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c24585be200/0x5953bbf6b3074aad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3074ab4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290387.252969:0:19681:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c24585bea00/0x5953bbf6b3074a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3074a83 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.252970:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa400 already unused, calling callback (ffffffffc14a9c20) 00010000:00010000:0.0:1784290387.252978:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c246dd26400/0x5953bbf6b3074b7f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b248d expref: 10 pid: 92149 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290387.252982:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30749a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b30749aa expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290387.253007:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784290387.253031:0:19681:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784290387.253034:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30749a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b30749aa expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290387.253045:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:2.0:1784290387.253047:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30749a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b30749aa expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290387.253053:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784290387.253069:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c24585be200/0x5953bbf6b3074aad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074ab4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.253070:0:19681:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c24585bea00/0x5953bbf6b3074a7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074a83 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.253074:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30749a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30749aa expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.253095:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a541180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2399:x1870961896261632:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 238us (404us total) trans 0 rc 0/0 00010000:00010000:3.0:1784290387.253112:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784290387.253113:0:19681:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784290387.253122:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784290387.253132:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2588 00010000:00010000:3.0:1784290387.253139:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c24585be200/0x5953bbf6b3074aad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074ab4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.253140:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c24585bea00/0x5953bbf6b3074a7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074a83 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.253141:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30749a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30749aa expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290387.253182:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c24585be200/0x5953bbf6b3074aad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074ab4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.253184:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:2.0:1784290387.253185:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b30749a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30749aa expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.253187:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c24585bea00/0x5953bbf6b3074a7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074a83 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290387.253252:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290387.253258:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290387.253259:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290387.253266:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290387.253268:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290387.253270:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290387.253275:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290387.253276:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290387.253282:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290387.253286:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896261760 00000100:00100000:0.0:1784290387.253292:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896261760 00010000:00010000:2.0:1784290387.253295:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290387.253309:0:92776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd26400/0x5953bbf6b3074b7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b248d expref: 10 pid: 92149 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290387.253310:0:19591:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c24585bf400/0x5953bbf6b3074b71 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b247f expref: 10 pid: 92154 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290387.253325:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901119488:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290387.253373:0:92776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d03800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901117824:192.168.202.6@tcp:104: 00000100:00100000:0.0:1784290387.253403:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2589 00000100:00100000:3.0:1784290387.253404:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247580b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901119360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290387.253416:0:92776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d02a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901117952:192.168.202.6@tcp:104: 00000100:00100000:2.0:1784290387.253424:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290387.253425:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a540e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:2400:x1870961896261760:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784290387.253438:0:19591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784290387.253442:0:92776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901118848:0@lo:104: 00010000:00010000:0.0:1784290387.253444:0:19591:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c24585bf400/0x5953bbf6b3074b71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b247f expref: 9 pid: 92154 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290387.253462:0:19591:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c24585bf400/0x5953bbf6b3074b71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b247f expref: 9 pid: 92154 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290387.253471:0:92776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92776:1870961901119232:0@lo:104: 00010000:00010000:0.0:1784290387.253480:0:19591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c24585bf400/0x5953bbf6b3074b71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b247f expref: 9 pid: 92154 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290387.253483:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290387.253485:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901120128:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290387.253514:0:19591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784290387.253536:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901119872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290387.253544:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784290387.253555:0:92776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b3074e88 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.253558:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a540e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:2400:x1870961896261760:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 141us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290387.253570:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2589 00000100:00100000:2.0:1784290387.253588:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784290387.253596:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901119488 00000100:00100000:3.0:1784290387.253602:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290387.253603:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901119488 00000100:00100000:2.0:1784290387.253607:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246d95ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901119616:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290387.253627:0:19591:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c24585bec00/0x5953bbf6b3074b24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074b1d expref: 24 pid: 92154 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290387.253649:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1784290387.253662:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290387.253668:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247580b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901118976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290387.253677:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901119360 00000100:00100000:0.0:1784290387.253686:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901119360 00000100:00100000:2.0:1784290387.253701:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901120000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290387.253706:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901120128 00010000:00010000:0.0:1784290387.253711:0:19591:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c247c263a00/0x5953bbf6b3074b32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074b2b expref: 25 pid: 92152 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290387.253713:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901120128 00010000:00010000:1.0:1784290387.253735:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c246dd27800/0x5953bbf6b3074a83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074a7c expref: 26 pid: 92154 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.253741:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901119872 00000100:00100000:3.0:1784290387.253750:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290387.253752:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901119872 00000100:00100000:2.0:1784290387.253770:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901119616 00000100:00100000:2.0:1784290387.253777:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901119616 00000100:00100000:1.0:1784290387.253781:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901118976 00010000:00010000:0.0:1784290387.253781:0:19591:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c24585bf000/0x5953bbf6b3074ad0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074ac9 expref: 27 pid: 92149 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290387.253788:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901118976 00000100:00100000:3.0:1784290387.253795:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901119744:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290387.253802:0:19592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c24585bfa00/0x5953bbf6b3074b08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074b01 expref: 29 pid: 92149 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.253810:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00010000:00010000:1.0:1784290387.253814:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b3074b5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074b55 expref: 29 pid: 92154 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.253828:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245818f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2e54cd1c-9dbd-4e31-b60e-998135d46053+29:3617:x1870961901119488:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784290387.253842:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290387.253846:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591 00010000:00010000:0.0:1784290387.253848:0:19591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290387.253858:0:19591:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c24585bec00/0x5953bbf6b3074b24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074b1d expref: 29 pid: 92154 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290387.253860:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00100000:2.0:1784290387.253867:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+29:3620:x1870961901119360:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784290387.253870:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901120256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290387.253885:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e54cd1c-9dbd-4e31-b60e-998135d46053+29:3617:x1870961901120128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290387.253891:0:19592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290387.253891:0:19591:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c24585bec00/0x5953bbf6b3074b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3074b1d expref: 29 pid: 92154 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.253902:0:19592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c247c263a00/0x5953bbf6b3074b32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074b2b expref: 29 pid: 92152 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.253902:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290387.253916:0:19591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c24585bec00/0x5953bbf6b3074b24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3074b1d expref: 29 pid: 92154 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.253917:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c246dd27800/0x5953bbf6b3074a83 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074a7c expref: 29 pid: 92154 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290387.253925:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784290387.253958:0:19592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c247c263a00/0x5953bbf6b3074b32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3074b2b expref: 28 pid: 92152 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.253971:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c246dd27800/0x5953bbf6b3074a83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3074a7c expref: 28 pid: 92154 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290387.253983:0:19591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290387.253996:0:19592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247c263a00/0x5953bbf6b3074b32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3074b2b expref: 28 pid: 92152 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.254012:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd27800/0x5953bbf6b3074a83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3074a7c expref: 27 pid: 92154 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.254017:0:19592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784290387.254037:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245818f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2e54cd1c-9dbd-4e31-b60e-998135d46053+26:3617:x1870961901119488:12345-0@lo:103:ldlm_bl.0 Request processed in 213us (621us total) trans 0 rc 0/0 00010000:00010000:1.0:1784290387.254040:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784290387.254045:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00010000:00010000:3.0:1784290387.254050:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290387.254084:0:10356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901119744 00000100:00100000:3.0:1784290387.254089:0:10356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901119744 00000100:00100000:2.0:1784290387.254096:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+25:3620:x1870961901119360:12345-0@lo:103:ldlm_bl.0 Request processed in 236us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290387.254109:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591 00000100:00100000:1.0:1784290387.254109:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e54cd1c-9dbd-4e31-b60e-998135d46053+26:3617:x1870961901120128:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290387.254112:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901120256 00010000:00010000:3.0:1784290387.254120:0:10356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c24585be400/0x5953bbf6b3074afa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074af3 expref: 26 pid: 92151 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.254124:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901120256 00000100:00100000:1.0:1784290387.254131:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00000100:00100000:2.0:1784290387.254147:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00010000:00010000:0.0:1784290387.254153:0:19591:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c24585bee00/0x5953bbf6b30749aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b30749a3 expref: 25 pid: 92149 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290387.254166:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+25:3620:x1870961901119872:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290387.254173:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:3.0:1784290387.254184:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00010000:00010000:2.0:1784290387.254184:0:19592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784290387.254188:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e54cd1c-9dbd-4e31-b60e-998135d46053+25:3617:x1870961901119616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290387.254204:0:19592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c24585bf000/0x5953bbf6b3074ad0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074ac9 expref: 25 pid: 92149 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290387.254212:0:10356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2e54cd1c-9dbd-4e31-b60e-998135d46053+25:3620:x1870961901118976:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290387.254230:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00010000:00010000:1.0:1784290387.254235:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290387.254243:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290387.254248:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c24585bfa00/0x5953bbf6b3074b08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074b01 expref: 25 pid: 92149 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.254251:0:19592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c24585bf000/0x5953bbf6b3074ad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3074ac9 expref: 25 pid: 92149 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.254257:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2e54cd1c-9dbd-4e31-b60e-998135d46053+25:3620:x1870961901119744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784290387.254258:0:10356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b3074b5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074b55 expref: 25 pid: 92154 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290387.254294:0:19591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290387.254301:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c24585bfa00/0x5953bbf6b3074b08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3074b01 expref: 25 pid: 92149 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290387.254304:0:19591:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c24585be400/0x5953bbf6b3074afa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074af3 expref: 25 pid: 92151 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.254332:0:19592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c24585bf000/0x5953bbf6b3074ad0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3074ac9 expref: 25 pid: 92149 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290387.254360:0:10356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b3074b5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3074b55 expref: 25 pid: 92154 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.254402:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c24585bfa00/0x5953bbf6b3074b08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3074b01 expref: 24 pid: 92149 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290387.254407:0:19591:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c24585be400/0x5953bbf6b3074afa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3074af3 expref: 24 pid: 92151 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.254445:0:19592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290387.254456:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd27c00/0x5953bbf6b3074b5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3074b55 expref: 23 pid: 92154 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.254463:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290387.254466:0:19591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c24585be400/0x5953bbf6b3074afa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3074af3 expref: 22 pid: 92151 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290387.254473:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784290387.254485:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:3620:x1870961901119872:12345-0@lo:103:ldlm_bl.0 Request processed in 327us (891us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290387.254486:0:19591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784290387.254495:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00100000:2.0:1784290387.254533:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597 00000100:00100000:1.0:1784290387.254541:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:3617:x1870961901119616:12345-0@lo:103:ldlm_bl.0 Request processed in 353us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290387.254551:0:10356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:3620:x1870961901118976:12345-0@lo:103:ldlm_bl.0 Request processed in 338us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290387.254553:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:3620:x1870961901120256:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290387.254558:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:3620:x1870961901119744:12345-0@lo:103:ldlm_bl.0 Request processed in 312us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290387.254560:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00010000:00010000:2.0:1784290387.254590:0:19592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1784290387.254594:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00010000:00010000:2.0:1784290387.254598:0:19592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c24585bee00/0x5953bbf6b30749aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b30749a3 expref: 19 pid: 92149 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.254607:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00010000:00010000:2.0:1784290387.254610:0:19592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c24585bee00/0x5953bbf6b30749aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b30749a3 expref: 19 pid: 92149 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.254624:0:19592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c24585bee00/0x5953bbf6b30749aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b30749a3 expref: 18 pid: 92149 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.254639:0:19592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784290387.254666:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290387.254685:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:3620:x1870961901120256:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290387.254694:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597 00000100:00100000:1.0:1784290387.254714:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901120000 00000100:00100000:0.0:1784290387.254716:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247580b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901118976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290387.254719:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901120000 00010000:00010000:1.0:1784290387.254750:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c23450aa000/0x5953bbf6b3074ab4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074aad expref: 16 pid: 92152 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290387.254755:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901119744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784290387.254768:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2475809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901119488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290387.254783:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901120256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784290387.254796:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901120128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290387.254800:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:0.0:1784290387.254816:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247580b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901119360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290387.254825:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245818f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:3617:x1870961901120000:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784290387.254834:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246d95ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901119616:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290387.254840:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784290387.254847:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468890e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901119872:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290387.254850:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c23450aa000/0x5953bbf6b3074ab4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074aad expref: 16 pid: 92152 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.254867:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c23450aa000/0x5953bbf6b3074ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3074aad expref: 16 pid: 92152 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.254879:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c23450aa000/0x5953bbf6b3074ab4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3074aad expref: 16 pid: 92152 timeout: 2228 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.254896:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b3074e88 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.254902:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b3074e88 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.254912:0:7430:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b3074e88 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.254917:0:7430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b3074e88 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.254923:0:7430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b3074e88 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.254928:0:7430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b3074e88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.254932:0:7430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cba00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290387.254935:0:7430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b3074e88 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.254940:0:7430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b3074e88 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.254956:0:7430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b3074e88 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290387.254963:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290387.254975:0:92776:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b3074e88 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.254983:0:92776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b3074e88 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290387.254988:0:92776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b3074e88 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290387.254998:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245818f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:3617:x1870961901120000:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290387.255011:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00100000:3.0:1784290387.255042:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901120000:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784290387.623526:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784290388.519440:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784290388.519448:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c246dd94000 from 52 10000000:01000000:3.0:1784290388.519454:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784290388.519519:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffc00/0x5953bbf6b3074e8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.519532:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffc00/0x5953bbf6b3074e8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.519542:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffc00/0x5953bbf6b3074e8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290388.519572:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901120384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.519661:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290388.519707:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784290388.519763:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901120384 00000100:00100000:1.0:1784290388.519776:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901120384 00000100:00100000:1.0:1784290388.519836:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784290388.519844:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:6485:x1870961901120384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290388.519859:0:92149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290388.519875:0:92149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247f8cb200/0x5953bbf6b3074e96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074e8f expref: -99 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290388.519900:0:92149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247f8cb200/0x5953bbf6b3074e96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074e8f expref: 16 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290388.519908:0:92149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247f8cb200/0x5953bbf6b3074e96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074e8f expref: 16 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290388.519915:0:92149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8cb200, rc 0) 00000100:00100000:1.0:1784290388.519995:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901120384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290388.520001:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784290388.520075:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901120384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290388.520095:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffc00/0x5953bbf6b3074e8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074e96 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.520128:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffc00/0x5953bbf6b3074e8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074e96 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290388.520204:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901120512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.520234:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290388.520254:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784290388.520288:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901120512 00000100:00100000:0.0:1784290388.520296:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901120512 00000100:00100000:0.0:1784290388.520334:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1784290388.520398:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901120512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290388.520534:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901120512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.520542:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784290388.520603:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901120512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.520636:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901120640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.520680:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290388.520705:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784290388.520735:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901120640 00000100:00100000:0.0:1784290388.520742:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901120640 00000100:00100000:0.0:1784290388.520774:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784290388.520781:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901120640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290388.520881:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901120640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.520889:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784290388.520916:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901120640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290388.521266:0:92777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a541180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92777:1870961901120768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290388.521314:0:92777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290388.521355:0:92777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458ac2600 going to sleep for 11 seconds 00000100:00100000:1.0:1784290388.521403:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901120768 00000100:00100000:1.0:1784290388.521409:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901120768 00000100:00100000:1.0:1784290388.521437:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784290388.521443:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:92777:x1870961901120768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290388.521524:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:92777:x1870961901120768:12345-0@lo:502:llog_process_th.0 Request processed in 80us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290388.521530:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784290388.521560:0:92777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a541180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92777:1870961901120768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290388.521609:0:92777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a541180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92777:1870961901120896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290388.521645:0:92777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290388.521678:0:92777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24502f8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784290388.521682:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901120896 00000100:00100000:1.0:1784290388.521692:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901120896 00000100:00100000:1.0:1784290388.521715:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784290388.521720:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:92777:x1870961901120896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290388.521774:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:92777:x1870961901120896:12345-0@lo:502:llog_process_th.0 Request processed in 53us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290388.521781:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784290388.521798:0:92777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a541180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92777:1870961901120896:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784290388.521826:0:92777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1784290388.521936:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1784290388.521964:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290388.521970:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffc00/0x5953bbf6b3074e8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074e96 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.521979:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffc00/0x5953bbf6b3074e8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074e96 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290388.521987:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1784290388.521988:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 46 10000000:01000000:3.0:1784290388.521990:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784290388.522007:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3074e9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.522013:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3074e9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.522026:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3074e9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290388.522038:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901121024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.522068:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290388.522088:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784290388.522111:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901121024 00000100:00100000:0.0:1784290388.522118:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901121024 00000100:00100000:0.0:1784290388.522149:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784290388.522157:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901121024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290388.522175:0:92151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290388.522185:0:92151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b3074ea4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074e9d expref: -99 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290388.522201:0:92151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b3074ea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074e9d expref: 17 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290388.522212:0:92151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b3074ea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074e9d expref: 17 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290388.522219:0:92151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebee00, rc 0) 00000100:00100000:0.0:1784290388.522261:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901121024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.522271:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784290388.522300:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901121024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290388.522313:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3074e9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ea4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.522320:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3074e9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074ea4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290388.522396:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901121152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.522423:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290388.522452:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784290388.522456:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901121152 00000100:00100000:0.0:1784290388.522464:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901121152 00000100:00100000:0.0:1784290388.522495:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784290388.522503:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901121152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290388.522579:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901121152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 76us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.522587:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1784290388.522613:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901121152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.522636:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901121280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.522674:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290388.522689:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784290388.522712:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901121280 00000100:00100000:1.0:1784290388.522717:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901121280 00000100:00100000:1.0:1784290388.522739:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784290388.522745:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901121280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290388.522810:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901121280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290388.522815:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784290388.522853:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901121280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290388.523112:0:92778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92778:1870961901121408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290388.523147:0:92778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290388.523164:0:92778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245a881000 going to sleep for 11 seconds 00000100:00100000:0.0:1784290388.523187:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901121408 00000100:00100000:0.0:1784290388.523194:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901121408 00000100:00100000:0.0:1784290388.523223:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1784290388.523231:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:92778:x1870961901121408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290388.523312:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:92778:x1870961901121408:12345-0@lo:502:llog_process_th.0 Request processed in 81us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.523330:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784290388.523389:0:92778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92778:1870961901121408:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784290388.523413:0:92778:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784290388.523421:0:92778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290388.523423:0:92778:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:1.0:1784290388.523427:0:92778:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1784290388.523476:0:92778:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00080000:10000000:1.0:1784290388.523930:0:92778:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x50:0x0] (8/32) registered 00000001:00080000:2.0:1784290388.525238:0:92145:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116994 is committed 00080000:10000000:1.0:1784290388.525533:0:92778:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00080000:10000000:1.0:1784290388.526586:0:92778:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00000100:00100000:1.0:1784290388.527422:0:92778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92778:1870961901121536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290388.527455:0:92778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290388.527484:0:92778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234310b900 going to sleep for 11 seconds 00000100:00100000:0.0:1784290388.527496:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901121536 00000100:00100000:0.0:1784290388.527502:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901121536 00000100:00100000:0.0:1784290388.527533:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1784290388.527541:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:92778:x1870961901121536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290388.527615:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:92778:x1870961901121536:12345-0@lo:502:llog_process_th.0 Request processed in 75us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.527626:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784290388.527640:0:92778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92778:1870961901121536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290388.527673:0:92778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92778:1870961901121664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290388.527698:0:92778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290388.527713:0:92778:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234310b900 going to sleep for 11 seconds 00000100:00100000:2.0:1784290388.527733:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901121664 00000100:00100000:2.0:1784290388.527739:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901121664 00000100:00100000:2.0:1784290388.527764:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784290388.527769:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:92778:x1870961901121664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290388.527841:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:92778:x1870961901121664:12345-0@lo:502:llog_process_th.0 Request processed in 71us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290388.527854:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784290388.527868:0:92778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92778:1870961901121664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784290388.527888:0:92778:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784290388.527893:0:92778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290388.527894:0:92778:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre-MDT0000-m new lustre.pool_134 00000040:00080000:1.0:1784290388.527897:0:92778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000020:01000000:3.0:1784290388.527987:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 46-49 (rc=0) 10000000:01000000:3.0:1784290388.528003:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784290388.528008:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3074e9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ea4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.528024:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3074e9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ea4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290388.528031:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784290388.528032:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c23452c5000 from 52 10000000:01000000:3.0:1784290388.528034:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784290388.528050:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b3074eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.528056:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b3074eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.528062:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b3074eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290388.528072:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901121792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.528103:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290388.528123:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784290388.528145:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901121792 00000100:00100000:1.0:1784290388.528151:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901121792 00000100:00100000:1.0:1784290388.528177:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784290388.528182:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901121792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290388.528189:0:92152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290388.528196:0:92152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247f8cbc00/0x5953bbf6b3074eb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074eab expref: -99 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290388.528209:0:92152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247f8cbc00/0x5953bbf6b3074eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074eab expref: 18 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290388.528215:0:92152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247f8cbc00/0x5953bbf6b3074eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074eab expref: 18 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290388.528221:0:92152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8cbc00, rc 0) 00000100:00100000:1.0:1784290388.528254:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901121792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290388.528259:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784290388.528295:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901121792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290388.528306:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b3074eab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074eb2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.528313:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b3074eab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074eb2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290388.528395:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901121920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.528420:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290388.528451:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784290388.528465:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901121920 00000100:00100000:0.0:1784290388.528473:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901121920 00000100:00100000:0.0:1784290388.528506:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784290388.528514:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901121920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290388.528598:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901121920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.528607:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1784290388.528610:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901121920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.528647:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901122048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.528684:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290388.528698:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784290388.528718:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901122048 00000100:00100000:0.0:1784290388.528724:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901122048 00000100:00100000:0.0:1784290388.528753:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1784290388.528759:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901122048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290388.528843:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901122048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.528854:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784290388.528859:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901122048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290388.529125:0:92779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a541180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92779:1870961901122176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290388.529168:0:92779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290388.529191:0:92779:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dac6600 going to sleep for 11 seconds 00000100:00100000:2.0:1784290388.529207:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901122176 00000100:00100000:2.0:1784290388.529212:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901122176 00000100:00100000:2.0:1784290388.529238:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784290388.529244:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:92779:x1870961901122176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290388.529315:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:92779:x1870961901122176:12345-0@lo:502:llog_process_th.0 Request processed in 68us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290388.529321:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1784290388.529330:0:92779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a541180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92779:1870961901122176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290388.529407:0:92779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a541180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92779:1870961901122304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290388.529441:0:92779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290388.529473:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901122304 00000100:00100000:0.0:1784290388.529474:0:92779:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dac6600 going to sleep for 11 seconds 00000100:00100000:1.0:1784290388.529479:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901122304 00000100:00100000:1.0:1784290388.529509:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784290388.529516:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:92779:x1870961901122304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290388.529583:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:92779:x1870961901122304:12345-0@lo:502:llog_process_th.0 Request processed in 66us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290388.529589:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1784290388.529596:0:92779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a541180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92779:1870961901122304:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784290388.529623:0:92779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1784290388.529717:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1784290388.529733:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290388.529738:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b3074eab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074eb2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.529746:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b3074eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074eb2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290388.529752:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1784290388.529754:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:3.0:1784290388.529755:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1784290388.529771:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3074eb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.529777:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3074eb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.529783:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3074eb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290388.529794:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901122432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.529823:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290388.529852:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784290388.529876:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901122432 00000100:00100000:0.0:1784290388.529883:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901122432 00000100:00100000:0.0:1784290388.529914:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784290388.529920:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901122432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290388.529928:0:92149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290388.529937:0:92149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebe200/0x5953bbf6b3074ec0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074eb9 expref: -99 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290388.529953:0:92149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebe200/0x5953bbf6b3074ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074eb9 expref: 19 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290388.529963:0:92149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebe200/0x5953bbf6b3074ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074eb9 expref: 19 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290388.529971:0:92149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebe200, rc 0) 00000100:00100000:0.0:1784290388.530013:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901122432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.530024:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784290388.530050:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901122432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290388.530062:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3074eb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ec0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.530068:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3074eb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074ec0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290388.530102:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901122560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.530126:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290388.530140:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784290388.530153:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901122560 00000100:00100000:0.0:1784290388.530159:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901122560 00000100:00100000:0.0:1784290388.530188:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784290388.530195:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901122560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290388.530282:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901122560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.530293:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784290388.530298:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901122560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.530324:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901122688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.530410:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290388.530449:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901122688 00000100:00100000:3.0:1784290388.530452:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784290388.530457:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901122688 00000100:00100000:2.0:1784290388.530487:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784290388.530494:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901122688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290388.530599:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901122688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290388.530606:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784290388.530610:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901122688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.530845:0:92780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92780:1870961901122816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290388.530877:0:92780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290388.530891:0:92780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784290388.530947:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901122816 00000100:00100000:1.0:1784290388.530953:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901122816 00000100:00100000:1.0:1784290388.530984:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784290388.530990:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:92780:x1870961901122816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290388.531290:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:92780:x1870961901122816:12345-0@lo:502:llog_process_th.0 Request processed in 299us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290388.531301:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784290388.531334:0:92780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92780:1870961901122816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784290388.531396:0:92780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784290388.531405:0:92780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290388.531408:0:92780:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre-MDT0001-m new lustre.pool_134 00000020:00000080:3.0:1784290388.531415:0:92780:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1784290388.531466:0:92780:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:3.0:1784290388.531481:0:92780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92780:1870961901122944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290388.531516:0:92780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290388.531537:0:92780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784290388.531558:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901122944 00000100:00100000:0.0:1784290388.531565:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901122944 00000100:00100000:0.0:1784290388.531596:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784290388.531606:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:92780:x1870961901122944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290388.531693:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:92780:x1870961901122944:12345-0@lo:502:llog_process_th.0 Request processed in 88us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.531704:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784290388.531724:0:92780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92780:1870961901122944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290388.531760:0:92780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92780:1870961901123072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290388.531790:0:92780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290388.531803:0:92780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784290388.531818:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901123072 00000100:00100000:0.0:1784290388.531824:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901123072 00000100:00100000:0.0:1784290388.531853:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784290388.531860:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:92780:x1870961901123072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290388.531942:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:92780:x1870961901123072:12345-0@lo:502:llog_process_th.0 Request processed in 81us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.531950:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784290388.531954:0:92780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92780:1870961901123072:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784290388.531985:0:92780:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290388.531989:0:92780:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290388.531990:0:92780:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre-MDT0001-m new lustre.pool_134 00000040:00080000:3.0:1784290388.531993:0:92780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 50 count 49 00000020:01000000:2.0:1784290388.532103:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-49 (rc=0) 10000000:01000000:2.0:1784290388.532126:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784290388.532133:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3074eb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ec0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290388.532142:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3074eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ec0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290388.532150:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784290388.532152:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c246ff27800 from 52 10000000:01000000:2.0:1784290388.532154:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784290388.532172:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5cc00/0x5953bbf6b3074ec7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290388.532185:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2458d5cc00/0x5953bbf6b3074ec7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290388.532192:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2458d5cc00/0x5953bbf6b3074ec7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290388.532204:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901123200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290388.532229:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290388.532250:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24803793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290388.532270:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901123200 00000100:00100000:0.0:1784290388.532276:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901123200 00000100:00100000:0.0:1784290388.532303:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784290388.532310:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901123200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290388.532318:0:92154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290388.532328:0:92154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3074ece lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074ec7 expref: -99 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290388.532390:0:92154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3074ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074ec7 expref: 20 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290388.532407:0:92154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3074ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074ec7 expref: 20 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290388.532415:0:92154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebea00, rc 0) 00000100:00100000:0.0:1784290388.532451:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901123200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.532460:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1784290388.532484:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901123200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290388.532497:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2458d5cc00/0x5953bbf6b3074ec7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ece expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290388.532504:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2458d5cc00/0x5953bbf6b3074ec7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074ece expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290388.532546:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901123328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290388.532573:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290388.532602:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24803793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290388.532605:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901123328 00000100:00100000:1.0:1784290388.532611:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901123328 00000100:00100000:1.0:1784290388.532641:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1784290388.532646:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901123328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290388.532711:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901123328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 64us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290388.532717:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1784290388.532739:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901123328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290388.532761:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901123456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290388.532791:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290388.532805:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24803793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290388.532821:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901123456 00000100:00100000:1.0:1784290388.532826:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901123456 00000100:00100000:1.0:1784290388.532847:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784290388.532851:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901123456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290388.532910:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901123456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 57us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290388.532922:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784290388.532928:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901123456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290388.533146:0:92781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92781:1870961901123584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290388.533176:0:92781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290388.533190:0:92781:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2480379840 going to sleep for 11 seconds 00000100:00100000:0.0:1784290388.533210:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901123584 00000100:00100000:0.0:1784290388.533215:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901123584 00000100:00100000:0.0:1784290388.533243:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1784290388.533251:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:92781:x1870961901123584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290388.533327:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:92781:x1870961901123584:12345-0@lo:502:llog_process_th.0 Request processed in 76us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.533335:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784290388.533385:0:92781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92781:1870961901123584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290388.533420:0:92781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92781:1870961901123712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290388.533446:0:92781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290388.533466:0:92781:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2480379840 going to sleep for 11 seconds 00000100:00100000:0.0:1784290388.533470:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901123712 00000100:00100000:0.0:1784290388.533476:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901123712 00000100:00100000:0.0:1784290388.533505:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1784290388.533513:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:92781:x1870961901123712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290388.533578:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:92781:x1870961901123712:12345-0@lo:502:llog_process_th.0 Request processed in 65us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.533587:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784290388.533602:0:92781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92781:1870961901123712:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784290388.533622:0:92781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1784290388.533710:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1784290388.533731:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290388.533737:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5cc00/0x5953bbf6b3074ec7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ece expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.533746:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2458d5cc00/0x5953bbf6b3074ec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ece expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290388.533753:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1784290388.533754:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1784290388.533756:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784290388.533772:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b3074ed5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.533778:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b3074ed5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.533795:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b3074ed5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290388.533807:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901123840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.533837:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290388.533858:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784290388.533907:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901123840 00000100:00100000:1.0:1784290388.533914:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901123840 00000100:00100000:1.0:1784290388.533944:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784290388.533950:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901123840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290388.533958:0:92152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290388.533965:0:92152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247f8ca600/0x5953bbf6b3074edc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074ed5 expref: -99 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290388.533978:0:92152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247f8ca600/0x5953bbf6b3074edc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074ed5 expref: 21 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290388.533985:0:92152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247f8ca600/0x5953bbf6b3074edc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074ed5 expref: 21 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290388.533990:0:92152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8ca600, rc 0) 00000100:00100000:1.0:1784290388.534026:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901123840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290388.534031:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784290388.534062:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901123840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290388.534074:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b3074ed5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074edc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.534081:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b3074ed5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074edc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290388.534117:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901123968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.534140:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290388.534155:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784290388.534173:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901123968 00000100:00100000:1.0:1784290388.534178:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901123968 00000100:00100000:1.0:1784290388.534201:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1784290388.534206:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901123968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290388.534271:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901123968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290388.534277:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784290388.534304:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901123968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.534326:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901124096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.534411:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290388.534441:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784290388.534444:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901124096 00000100:00100000:0.0:1784290388.534452:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901124096 00000100:00100000:0.0:1784290388.534486:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784290388.534494:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901124096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290388.534585:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901124096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.534593:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784290388.534609:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901124096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784290388.535159:0:92782:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1784290388.535238:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1784290388.535259:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784290388.535265:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b3074ed5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074edc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290388.535272:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b3074ed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074edc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290388.535279:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784290388.535281:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c247d3d2000 from 52 10000000:01000000:2.0:1784290388.535283:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784290388.535298:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b3074ee3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290388.535304:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b3074ee3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290388.535309:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b3074ee3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290388.535331:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901124224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290388.535398:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290388.535431:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2480379840 going to sleep for 11 seconds 00000100:00100000:0.0:1784290388.535431:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901124224 00000100:00100000:0.0:1784290388.535438:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901124224 00000100:00100000:0.0:1784290388.535472:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784290388.535480:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901124224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290388.535487:0:92154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290388.535496:0:92154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b3074eea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074ee3 expref: -99 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290388.535511:0:92154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b3074eea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074ee3 expref: 22 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290388.535520:0:92154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b3074eea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074ee3 expref: 22 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290388.535527:0:92154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebe000, rc 0) 00000100:00100000:0.0:1784290388.535561:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901124224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.535568:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784290388.535599:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901124224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290388.535610:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b3074ee3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074eea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290388.535616:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b3074ee3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074eea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290388.535651:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901124352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290388.535672:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290388.535687:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2480379840 going to sleep for 11 seconds 00000100:00100000:1.0:1784290388.535699:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901124352 00000100:00100000:1.0:1784290388.535709:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901124352 00000100:00100000:1.0:1784290388.535733:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784290388.535737:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901124352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290388.535790:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901124352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 53us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290388.535796:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784290388.535818:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901124352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290388.535840:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901124480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290388.535872:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290388.535886:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2480379840 going to sleep for 11 seconds 00000100:00100000:1.0:1784290388.535899:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901124480 00000100:00100000:1.0:1784290388.535904:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901124480 00000100:00100000:1.0:1784290388.535924:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784290388.535928:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901124480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290388.535986:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901124480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 56us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290388.535992:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784290388.536001:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901124480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290388.536183:0:92783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92783:1870961901124608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290388.536210:0:92783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290388.536223:0:92783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2480379cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290388.536234:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901124608 00000100:00100000:0.0:1784290388.536240:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901124608 00000100:00100000:0.0:1784290388.536269:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784290388.536276:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:92783:x1870961901124608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290388.536401:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:92783:x1870961901124608:12345-0@lo:502:llog_process_th.0 Request processed in 123us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290388.536417:0:92783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92783:1870961901124608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290388.536423:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784290388.536454:0:92783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92783:1870961901124736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290388.536486:0:92783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290388.536504:0:92783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2480379cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290388.536512:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901124736 00000100:00100000:0.0:1784290388.536518:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901124736 00000100:00100000:0.0:1784290388.536546:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784290388.536553:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:92783:x1870961901124736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290388.536621:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:92783:x1870961901124736:12345-0@lo:502:llog_process_th.0 Request processed in 67us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.536630:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784290388.536636:0:92783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92783:1870961901124736:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784290388.536658:0:92783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1784290388.536709:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1784290388.536741:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290388.536752:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b3074ee3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074eea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.536759:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b3074ee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074eea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290388.536766:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1784290388.536767:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1784290388.536769:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784290388.536783:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3074ef1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.536789:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3074ef1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.536795:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3074ef1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290388.536805:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901124864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.536831:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290388.536848:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105240 going to sleep for 11 seconds 00000100:00100000:1.0:1784290388.536862:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901124864 00000100:00100000:1.0:1784290388.536867:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901124864 00000100:00100000:1.0:1784290388.536890:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784290388.536894:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901124864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290388.536900:0:92152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290388.536907:0:92152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247f8cbe00/0x5953bbf6b3074ef8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074ef1 expref: -99 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290388.536918:0:92152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247f8cbe00/0x5953bbf6b3074ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074ef1 expref: 23 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290388.536924:0:92152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247f8cbe00/0x5953bbf6b3074ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074ef1 expref: 23 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290388.536929:0:92152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8cbe00, rc 0) 00000100:00100000:1.0:1784290388.536968:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901124864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290388.536978:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784290388.536987:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901124864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290388.537002:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3074ef1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ef8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290388.537009:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3074ef1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074ef8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290388.537039:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901124992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.537072:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290388.537086:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105240 going to sleep for 11 seconds 00000100:00100000:1.0:1784290388.537104:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901124992 00000100:00100000:1.0:1784290388.537109:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901124992 00000100:00100000:1.0:1784290388.537130:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784290388.537134:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901124992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290388.537194:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901124992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 58us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290388.537204:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784290388.537209:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901124992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.537237:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901125120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290388.537273:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290388.537287:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105240 going to sleep for 11 seconds 00000100:00100000:0.0:1784290388.537311:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901125120 00000100:00100000:0.0:1784290388.537318:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901125120 00000100:00100000:0.0:1784290388.537392:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1784290388.537403:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901125120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290388.537485:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901125120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.537498:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784290388.537516:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901125120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784290388.538082:0:92784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1784290388.538161:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1784290388.538180:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1784290388.538185:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3074ef1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ef8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290388.538194:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3074ef1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074ef8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290388.538201:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784290388.538202:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9c2480260000 from 1 10000000:01000000:2.0:1784290388.538204:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784290388.538219:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b3074eff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290388.538224:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b3074eff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290388.538230:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b3074eff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290388.538242:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901125248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290388.538265:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290388.538290:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2480379cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290388.538306:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901125248 00000100:00100000:0.0:1784290388.538312:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901125248 00000100:00100000:0.0:1784290388.538411:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784290388.538431:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901125248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290388.538438:0:92154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290388.538447:0:92154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebf200/0x5953bbf6b3074f06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074eff expref: -99 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290388.538463:0:92154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebf200/0x5953bbf6b3074f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074eff expref: 24 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290388.538472:0:92154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebf200/0x5953bbf6b3074f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074eff expref: 24 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290388.538487:0:92154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebf200, rc 0) 00000100:00100000:0.0:1784290388.538522:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901125248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.538529:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1784290388.538552:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901125248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290388.538578:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b3074eff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290388.538586:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b3074eff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074f06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290388.538620:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901125376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290388.538641:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290388.538663:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2480379cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290388.538672:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901125376 00000100:00100000:1.0:1784290388.538676:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901125376 00000100:00100000:1.0:1784290388.538700:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784290388.538704:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901125376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290388.538745:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901125376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 39us (102us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784290388.538751:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1784290388.538765:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901125376:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1784290388.538784:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784290388.538788:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b3074eff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290388.538793:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b3074eff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290388.647545:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290388.805542:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290388.805607:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896261888 00000100:00100000:1.0:1784290388.805620:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896261888 00000100:00100000:1.0:1784290388.805680:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 114 00000100:00100000:1.0:1784290388.805690:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70750:x1870961896261888:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290388.805705:0:92149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290388.805720:0:92149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247f8caa00/0x5953bbf6b3074f0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b24da expref: -99 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290388.805746:0:92149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247f8caa00/0x5953bbf6b3074f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24da expref: 9 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290388.805768:0:92149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247f8caa00/0x5953bbf6b3074f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24da expref: 9 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290388.805776:0:92149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8caa00, rc 0) 00000100:00100000:1.0:1784290388.805838:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896261888:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 150us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290388.805844:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 114 00000100:00100000:1.0:1784290388.806908:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290388.806975:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896262016 00000100:00100000:0.0:1784290388.806987:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896262016 00000100:00100000:0.0:1784290388.807048:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 115 00000100:00100000:0.0:1784290388.807064:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896262016:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290388.807242:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896262016:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 185us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.807249:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 115 00000100:00100000:2.0:1784290388.808055:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290388.808138:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896262144 00000100:00100000:0.0:1784290388.808144:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896262144 00000100:00100000:0.0:1784290388.808175:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 116 00000100:00100000:0.0:1784290388.808181:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896262144:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290388.808275:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896262144:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 94us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.808282:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 116 00000100:00100000:2.0:1784290388.809419:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290388.809472:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896262272 00000100:00100000:1.0:1784290388.809478:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896262272 00000100:00100000:1.0:1784290388.809514:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 117 00000100:00100000:1.0:1784290388.809520:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:71689:x1870961896262272:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784290388.809624:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:71689:x1870961896262272:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 103us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290388.809630:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 117 00000100:00100000:1.0:1784290388.810410:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290388.810454:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896262400 00000100:00100000:0.0:1784290388.810461:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896262400 00000100:00100000:0.0:1784290388.810493:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 118 00000100:00100000:0.0:1784290388.810500:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:71689:x1870961896262400:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784290388.810580:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:71689:x1870961896262400:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 79us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.810595:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 118 00000100:00100000:2.0:1784290388.811577:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290388.811632:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896262528 00000100:00100000:0.0:1784290388.811640:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896262528 00000100:00100000:0.0:1784290388.811669:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 119 00000100:00100000:0.0:1784290388.811676:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896262528:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290388.811684:0:92151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290388.811699:0:92151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b3074f14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b24e1 expref: -99 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290388.811720:0:92151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b3074f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24e1 expref: 10 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290388.811728:0:92151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b3074f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24e1 expref: 10 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290388.811736:0:92151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebfe00, rc 0) 00000100:00100000:0.0:1784290388.811771:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70750:x1870961896262528:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 90us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290388.811784:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 119 00000100:00100000:2.0:1784290388.812443:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290388.812490:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896262656 00000100:00100000:0.0:1784290388.812495:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896262656 00000100:00100000:0.0:1784290388.812520:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 120 00000100:00100000:0.0:1784290388.812525:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70750:x1870961896262656:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290388.812576:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70750:x1870961896262656:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 51us (134us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784290388.812582:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 120 00000100:00100000:1.0:1784290389.159538:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901125504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784290389.159580:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901125888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784290389.159606:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901125632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784290389.159642:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290389.159643:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290389.159712:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901125888 00000100:00100000:0.0:1784290389.159712:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290389.159723:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901125888 00000100:00100000:0.0:1784290389.159777:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1870961901126144:0@lo:400:kworker.0 00000100:00100000:2.0:1784290389.159778:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901125504 00000100:00100000:3.0:1784290389.159785:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901125632 00000100:00100000:2.0:1784290389.159789:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901125504 00000100:00100000:3.0:1784290389.159795:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901125632 00000100:00100000:0.0:1784290389.159838:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290389.159850:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:2.0:1784290389.159859:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3847 00000100:00100000:3.0:1784290389.159870:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901125888:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290389.159880:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3620:x1870961901125504:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784290389.159889:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901126656:0@lo:400:kworker.0 00002000:00000024:3.0:1784290389.159904:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784290389.159906:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901125760:0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784290389.159913:0:8412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444548608 avail 1298309120 00000100:00100000:0.0:1784290389.159926:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290389.159996:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1870961901127168:0@lo:400:kworker.0 00000100:00100000:3.0:1784290389.160007:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901125888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290389.160013:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290389.160023:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00100000:2.0:1784290389.160025:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3620:x1870961901125504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290389.160051:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290389.160056:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901126272:0@lo:400:kworker.0 00000100:00100000:2.0:1784290389.160059:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3847 00000100:00100000:3.0:1784290389.160063:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:3.0:1784290389.160084:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901125632:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784290389.160110:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901125760 00002000:00000024:3.0:1784290389.160112:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784290389.160116:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901125760 00000100:00100000:1.0:1784290389.160123:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290389.160155:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901126144 00000100:00100000:1.0:1784290389.160161:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901126784:0@lo:400:kworker.0 00000100:00100000:0.0:1784290389.160162:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901126144 00000100:00100000:2.0:1784290389.160164:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3848 00000100:00100000:3.0:1784290389.160176:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901125632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290389.160182:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901125760:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784290389.160205:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000004:00000024:2.0:1784290389.160210:0:8412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445105664 avail 1298866176 00000100:00100000:1.0:1784290389.160211:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290389.160246:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901127168 00000100:00100000:0.0:1784290389.160251:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901127168 00000100:00100000:3.0:1784290389.160266:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901126272 00000100:00100000:2.0:1784290389.160274:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343893800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901125760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290389.160275:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901126272 00000100:00100000:2.0:1784290389.160288:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3848 00000100:00100000:0.0:1784290389.160300:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:1.0:1784290389.160316:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901125760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784290389.160326:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1870961901126144:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784290389.160332:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784290389.160338:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784290389.160343:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784290389.160351:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784290389.160405:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:3.0:1784290389.160424:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1870961901127168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290389.160430:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901126656 00000100:00100000:1.0:1784290389.160431:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1870961901126400:0@lo:400:kworker.0 00000100:00100000:2.0:1784290389.160438:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901126656 00000100:00100000:0.0:1784290389.160441:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1870961901126144:12345-0@lo:400:kworker.0 Request processed in 113us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290389.160454:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:0.0:1784290389.160493:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:3.0:1784290389.160498:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1870961901127168:12345-0@lo:400:kworker.0 Request processed in 80us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290389.160505:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901126784 00000100:00100000:0.0:1784290389.160513:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901126272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290389.160515:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901126784 00000100:00100000:1.0:1784290389.160517:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290389.160518:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:3.0:1784290389.160575:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901126400 00000100:00100000:1.0:1784290389.160576:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961901126912:0@lo:400:kworker.0 00000100:00100000:3.0:1784290389.160583:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901126400 00000100:00100000:2.0:1784290389.160601:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1596 00000100:00100000:0.0:1784290389.160607:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901126272:12345-0@lo:400:kworker.0 Request processed in 102us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290389.160621:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1784290389.160622:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901126656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290389.160622:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290389.160634:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:3.0:1784290389.160637:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1870961901126400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290389.160670:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901126912 00000100:00100000:0.0:1784290389.160675:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901126912 00000100:00100000:1.0:1784290389.160677:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901125888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290389.160692:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901126656:12345-0@lo:400:kworker.0 Request processed in 76us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290389.160706:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1596 00000100:00100000:3.0:1784290389.160713:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1870961901126400:12345-0@lo:400:kworker.0 Request processed in 73us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290389.160715:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:1.0:1784290389.160726:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1870961901126400:0@lo:400:kworker.0 00000100:00100000:0.0:1784290389.160736:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1870961901126912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290389.160738:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:2.0:1784290389.160739:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1597 00000100:00100000:1.0:1784290389.160742:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1784290389.160751:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901126016:0@lo:400:kworker.0 00000100:00100000:2.0:1784290389.160765:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901126784:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784290389.160786:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784290389.160790:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784290389.160796:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290389.160822:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290389.160863:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1870961901126912:12345-0@lo:400:kworker.0 Request processed in 130us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290389.160871:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901126656:0@lo:400:kworker.0 00000100:00100000:2.0:1784290389.160872:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343892680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901126784:12345-0@lo:400:kworker.0 Request processed in 117us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290389.160889:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901126528:0@lo:400:kworker.0 00000100:00100000:0.0:1784290389.160900:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1784290389.160906:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1597 00000100:00100000:3.0:1784290389.160910:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1870961901127168:0@lo:400:kworker.0 00000100:00100000:3.0:1784290389.160943:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1870961901126144:0@lo:400:kworker.0 00000100:00100000:1.0:1784290389.160953:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290389.160965:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901125632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784290389.160989:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901126016 00000100:00100000:2.0:1784290389.160996:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901126016 00000100:00100000:1.0:1784290389.161002:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901127040:0@lo:400:kworker.0 00000100:00100000:0.0:1784290389.161010:0:3620:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116994 gen 3 00000004:00080000:0.0:1784290389.161017:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116993 committed transno 115964116994 00000100:00100000:1.0:1784290389.161034:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290389.161048:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000004:00080000:0.0:1784290389.161051:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116994 committed transno 115964116994 00000100:00100000:2.0:1784290389.161063:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3619:x1870961901126016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290389.161088:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901127040 00000100:00100000:3.0:1784290389.161094:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901127040 00000100:00100000:0.0:1784290389.161094:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901125504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784290389.161095:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961901126912:0@lo:400:kworker.0 00000100:00100000:2.0:1784290389.161115:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3619:x1870961901126016:12345-0@lo:400:kworker.0 Request processed in 52us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290389.161124:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1784290389.161150:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3849 00000100:00100000:1.0:1784290389.161164:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901126016:0@lo:400:kworker.0 00000100:00100000:3.0:1784290389.161171:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901127040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290389.161177:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901126272:0@lo:400:kworker.0 00000100:00100000:2.0:1784290389.161206:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901126528 00000100:00100000:0.0:1784290389.161207:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901126784:0@lo:400:kworker.0 00000100:00100000:2.0:1784290389.161214:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901126528 00000100:00100000:3.0:1784290389.161244:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901127040:12345-0@lo:400:kworker.0 Request processed in 78us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290389.161252:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3849 00000100:00100000:1.0:1784290389.161267:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901127040:0@lo:400:kworker.0 00000100:00080000:0.0:1784290389.161269:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784290389.161279:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:2.0:1784290389.161288:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901126528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290389.161330:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901126528:12345-0@lo:400:kworker.0 Request processed in 44us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290389.161335:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1784290389.161341:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901126528:0@lo:400:kworker.0 00010000:00010000:1.0:1784290389.672654:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784290389.673804:0:75386:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00010000:00010000:3.0:1784290389.673902:0:75386:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf000/0x5953bbf6b3074e65 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3074e6c expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290389.673921:0:75386:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf000/0x5953bbf6b3074e65 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3074e6c expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290389.673965:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aae00/0x5953bbf6b3074bc5 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290389.673978:0:75386:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf000/0x5953bbf6b3074e65 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074e6c expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290389.673982:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aae00/0x5953bbf6b3074bc5 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290389.673994:0:75386:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784290389.674006:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aae00/0x5953bbf6b3074bc5 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290389.674018:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aae00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290389.674040:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aae00/0x5953bbf6b3074bc5 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290389.674050:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aae00/0x5953bbf6b3074bc5 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290389.674068:0:75386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf000/0x5953bbf6b3074e65 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074e6c expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290389.674070:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0xb1bed465 (ffff9c2475807400) 00000100:00100000:2.0:1784290389.674076:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1784290389.674083:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290389.674092:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aae00/0x5953bbf6b3074bc5 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290389.674103:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450aae00/0x5953bbf6b3074bc5 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290389.674114:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901127424:0@lo:6:osp-syn-0-1.0 00000001:00080000:3.0:1784290389.674118:0:75386:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378762 is committed 00010000:00010000:1.0:1784290389.674130:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe400/0x5953bbf6b3074e2d lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290389.674132:0:75386:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9c2345d95f00 refcount 2 committed 0 result 0 batchid 77309411373 00000020:00080000:3.0:1784290389.674145:0:75386:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9c23453d3200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9c2345d953c0 00010000:00010000:1.0:1784290389.674150:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe400/0x5953bbf6b3074e2d lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290389.674166:0:75386:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x20000c751:0x1:0x0].2 00000020:00080000:3.0:1784290389.674176:0:75386:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9c23453d3100 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c2342ee8400 00010000:00010000:1.0:1784290389.674177:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe400/0x5953bbf6b3074e2d lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290389.674183:0:75386:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400090a4:0x1:0x0].2 00010000:00010000:1.0:1784290389.674196:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fe400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290389.674201:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe400/0x5953bbf6b3074e2d lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784290389.674214:0:75386:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00000100:00100000:2.0:1784290389.674224:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784290389.674236:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe400/0x5953bbf6b3074e2d lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290389.674263:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xa:0x0].0xb1bed465 (ffff9c2475807400) 00010000:00010000:1.0:1784290389.674267:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290389.674271:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe400/0x5953bbf6b3074e2d lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290389.674278:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fe400/0x5953bbf6b3074e2d lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xa:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290389.674303:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff200/0x5953bbf6b3074e49 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290389.674309:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1784290389.674313:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff200/0x5953bbf6b3074e49 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290389.674323:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff200/0x5953bbf6b3074e49 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290389.674330:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2ff200 already unused, calling callback (ffffffffc1aba4f0) 00000100:00100000:3.0:1784290389.674352:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901127296:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1784290389.674355:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff200/0x5953bbf6b3074e49 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290389.674416:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff200/0x5953bbf6b3074e49 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290389.674434:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0x9:0x0].0xf7117594 (ffff9c245a793600) 00010000:00010000:1.0:1784290389.674440:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290389.674446:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff200/0x5953bbf6b3074e49 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290389.674467:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff200/0x5953bbf6b3074e49 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0x9:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290389.674482:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1784290389.674546:0:75406:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411373 committed batchid 77309411372 00000100:00100000:3.0:1784290389.674564:0:10356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901127296 00000100:00100000:3.0:1784290389.674574:0:10356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901127296 00000100:00100000:2.0:1784290389.674637:0:8999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901127424 00000020:00080000:1.0:1784290389.674638:0:75406:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411372 00000100:00100000:2.0:1784290389.674646:0:8999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901127424 00000100:00100000:3.0:1784290389.674662:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:3.0:1784290389.674692:0:10356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3617:x1870961901127296:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:3.0:1784290389.674713:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290389.674738:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe600/0x5953bbf6b3074e6c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074e65 expref: 8 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290389.674755:0:10356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9c245a793d00) 00010000:00010000:3.0:1784290389.674764:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784290389.674819:0:8999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4961 00000100:00100000:3.0:1784290389.674824:0:10356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+7:3617:x1870961901127296:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 136us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290389.674838:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:2.0:1784290389.674846:0:8999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901127424:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1784290389.674877:0:8999:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:578 count 1 00000100:00100000:3.0:1784290389.674896:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901127296:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:2.0:1784290389.674903:0:8999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b3074f1b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290389.674939:0:8999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074be1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24a2 expref: 5 pid: 26252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290389.674963:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x242:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1784290389.674968:0:8999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784290389.674973:0:8999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b3074f1b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290389.675005:0:8999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074be1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24a2 expref: 5 pid: 26252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290389.675022:0:8999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074be1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24a2 expref: 5 pid: 26252 timeout: 2230 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290389.675043:0:8999:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b96300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8999:1870961901127552:192.168.202.6@tcp:104: 00000100:00100000:2.0:1784290389.675153:0:8999:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2480379cc0 going to sleep for 11 seconds 00000001:00080000:2.0:1784290389.675766:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968630 is committed 00000100:00100000:1.0:1784290389.676444:0:8999:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b96300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8999:1870961901127552:192.168.202.6@tcp:104: 00010000:00010000:1.0:1784290389.676470:0:8999:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b3074f1b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1784290389.676586:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 711f3c77-e791-4aa8-86ee-bc854fd0bcc5 00000020:00000080:0.0:1784290389.676593:0:9482:0:(genops.c:906:class_export_put()) final put ffff9c244a794800/711f3c77-e791-4aa8-86ee-bc854fd0bcc5 00000001:00080000:0.0:1784290389.676631:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968631 is committed 00000020:00000080:1.0:1784290389.676659:0:42926:0:(genops.c:865:class_export_destroy()) destroying export ffff9c244a794800/711f3c77-e791-4aa8-86ee-bc854fd0bcc5 for lustre-OST0001 00000100:00100000:2.0:1784290389.676696:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000020:00000080:1.0:1784290389.676733:0:42926:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246dcfe800 for lustre-OST0001 00000100:00100000:0.0:1784290389.676737:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896262784 00000100:00100000:0.0:1784290389.676745:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896262784 00000100:00080000:1.0:1784290389.676789:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784290389.676789:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074be1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24a2 expref: 6 pid: 26252 timeout: 2230 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290389.676827:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2599 00000100:00100000:0.0:1784290389.676839:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2399:x1870961896262784:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784290389.676849:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290389.676855:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074be1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24a2 expref: 6 pid: 26252 timeout: 2230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290389.676879:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074be1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24a2 expref: 6 pid: 26252 timeout: 2230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290389.676905:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000abe1b6b0/0x5953bbf6b3074be1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24a2 expref: 6 pid: 26252 timeout: 2230 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290389.676917:0:9491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784290389.676921:0:9491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x242:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784290389.676927:0:9491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b3074f1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290389.676936:0:9491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b3074f1b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290389.676959:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784290389.677002:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2399:x1870961896262784:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 164us (308us total) trans 0 rc 0/0 00010000:00010000:1.0:1784290389.677003:0:8999:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b3074f1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290389.677023:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2599 00010000:00010000:1.0:1784290389.677032:0:8999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b3074f1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290389.677050:0:8999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b3074f1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290389.677064:0:8999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b3074f1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290389.677099:0:8999:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290389.677213:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290389.677223:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b3074f1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290389.677235:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5c200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290389.677241:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b3074f1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290389.677251:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b3074f1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290389.677279:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b3074f1b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290389.677305:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b3074f1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290389.677315:0:8999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3620:x1870961901127424:12345-0@lo:6:osp-syn-0-1.0 Request processed in 2477us (3096us total) trans 4294968631 rc 0/0 00000100:00100000:1.0:1784290389.677329:0:8999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4961 00010000:00010000:3.0:1784290389.677413:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290389.677419:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290389.677424:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784290389.677441:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c2468ad5880/2, rc 0, transno 4294968631 00000100:00100000:2.0:1784290389.677450:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901127424:0@lo:6:osp-syn-0-1.0 00000020:00000080:1.0:1784290390.052134:0:92881:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffcea26c2d0 20000000:00000080:1.0:1784290390.052150:0:92881:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9c247b252000 uarg=0000000000000000 00000040:00100000:1.0:1784290390.052922:0:92881:0:(llog.c:1072:llog_reverse_process()) index 54 : idx 49 20000000:01000000:1.0:1784290390.052929:0:92881:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 53 cmd:0xce020 lustre.pool_134 00000040:00080000:1.0:1784290390.053010:0:92881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].55, 224 off17736 20000000:01000000:1.0:1784290390.053027:0:92881:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1784290390.053063:0:92881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].56, 136 off17872 00000040:00080000:1.0:1784290390.053083:0:92881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].57, 224 off18096 00000040:00080000:1.0:1784290390.053154:0:92881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].50, 224 off16832 20000000:01000000:1.0:1784290390.053164:0:92881:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1784290390.053189:0:92881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].51, 144 off16976 00000040:00080000:1.0:1784290390.053206:0:92881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].52, 224 off17200 00000040:00080000:1.0:1784290390.053269:0:92881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].50, 224 off16832 20000000:01000000:1.0:1784290390.053279:0:92881:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1784290390.053305:0:92881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].51, 144 off16976 00000040:00080000:1.0:1784290390.053322:0:92881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].52, 224 off17200 10000000:01000000:1.0:1784290390.053335:0:92881:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1784290390.053434:0:92881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b3074f22 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.053453:0:92881:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c247f8cb200/0x5953bbf6b3074e96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074e8f expref: 23 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.053462:0:92881:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b3074ea4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074e9d expref: 23 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.053469:0:92881:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c247f8cbc00/0x5953bbf6b3074eb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074eab expref: 23 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.053487:0:92881:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2345ebe200/0x5953bbf6b3074ec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074eb9 expref: 23 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.053493:0:92881:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3074ece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074ec7 expref: 23 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.053498:0:92881:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c247f8ca600/0x5953bbf6b3074edc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074ed5 expref: 23 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.053504:0:92881:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b3074eea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074ee3 expref: 23 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.053510:0:92881:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c247f8cbe00/0x5953bbf6b3074ef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074ef1 expref: 23 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.053515:0:92881:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2345ebf200/0x5953bbf6b3074f06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074eff expref: 23 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.053523:0:92881:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c247f8caa00/0x5953bbf6b3074f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24da expref: 9 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.053530:0:92881:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b3074f14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24e1 expref: 9 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.053536:0:92881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b3074f22 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.053574:0:92881:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b3074f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24e1 expref: 9 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.053596:0:92881:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b3074f14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24e1 expref: 9 pid: 92151 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290390.053641:0:92881:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343890000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901127680:192.168.202.6@tcp:104: 00010000:00010000:1.0:1784290390.053762:0:92881:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c247f8caa00/0x5953bbf6b3074f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24da expref: 9 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.053787:0:92881:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c247f8caa00/0x5953bbf6b3074f0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24da expref: 9 pid: 92149 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290390.053795:0:92881:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901127808:192.168.202.6@tcp:104: 00010000:00010000:1.0:1784290390.053824:0:92881:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2345ebf200/0x5953bbf6b3074f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3074eff expref: 23 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.053832:0:92881:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2345ebf200/0x5953bbf6b3074f06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3074eff expref: 23 pid: 92154 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290390.053842:0:92881:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343893b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901127936:0@lo:104: 00000100:00100000:1.0:1784290390.053897:0:92881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784290390.053927:0:92881:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c247f8cbe00/0x5953bbf6b3074ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3074ef1 expref: 23 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.053942:0:92881:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c247f8cbe00/0x5953bbf6b3074ef8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3074ef1 expref: 23 pid: 92152 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290390.053952:0:92881:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343890e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901128064:0@lo:104: 00000100:00100000:1.0:1784290390.053974:0:92881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290390.054006:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901127936 00000100:00100000:0.0:1784290390.054016:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901127936 00010000:00010000:1.0:1784290390.054020:0:92881:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b3074eea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3074ee3 expref: 23 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.054031:0:92881:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b3074eea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3074ee3 expref: 23 pid: 92154 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290390.054041:0:92881:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343892d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901128192:0@lo:104: 00000100:00100000:1.0:1784290390.054065:0:92881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290390.054079:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901128064 00000100:00100000:0.0:1784290390.054086:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901128064 00010000:00010000:1.0:1784290390.054094:0:92881:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c247f8ca600/0x5953bbf6b3074edc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3074ed5 expref: 23 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.054104:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901128192 00010000:00010000:1.0:1784290390.054106:0:92881:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c247f8ca600/0x5953bbf6b3074edc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3074ed5 expref: 23 pid: 92152 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.054114:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901128192 00000100:00100000:1.0:1784290390.054120:0:92881:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901128320:0@lo:104: 00000100:00100000:3.0:1784290390.054124:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1784290390.054138:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1784290390.054144:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343890a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:92881:x1870961901127936:12345-0@lo:104: 00000100:00100000:1.0:1784290390.054154:0:92881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290390.054161:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901128320 00000100:00100000:0.0:1784290390.054162:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343891500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:92881:x1870961901128064:12345-0@lo:104: 00010000:00010000:3.0:1784290390.054166:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b3074eff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074f06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.054167:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901128320 00010000:00010000:1.0:1784290390.054178:0:92881:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3074ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3074ec7 expref: 23 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.054183:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3074ef1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074ef8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.054194:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00010000:00010000:1.0:1784290390.054201:0:92881:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3074ece lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3074ec7 expref: 23 pid: 92154 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.054213:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343891180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:92881:x1870961901128192:12345-0@lo:104: 00000100:00100000:1.0:1784290390.054224:0:92881:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901128448:0@lo:104: 00010000:00010000:2.0:1784290390.054237:0:7428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b3074ee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074eea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290390.054286:0:92881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784290390.054321:0:92881:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2345ebe200/0x5953bbf6b3074ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3074eb9 expref: 23 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.054331:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1784290390.054332:0:92881:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2345ebe200/0x5953bbf6b3074ec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3074eb9 expref: 23 pid: 92149 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290390.054384:0:92881:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901128576:0@lo:104: 00010000:00010000:2.0:1784290390.054386:0:7428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784290390.054402:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343891180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:92881:x1870961901128192:12345-0@lo:104: Request processed in 188us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290390.054402:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343891500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:92881:x1870961901128064:12345-0@lo:104: Request processed in 242us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290390.054411:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00010000:00010000:3.0:1784290390.054422:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784290390.054430:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1784290390.054440:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343890a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:92881:x1870961901127936:12345-0@lo:104: Request processed in 299us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290390.054454:0:7428:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784290390.054456:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1784290390.054462:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901128448 00010000:00010000:1.0:1784290390.054465:0:92881:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c247f8cbc00/0x5953bbf6b3074eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3074eab expref: 23 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290390.054471:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901128448 00010000:00010000:1.0:1784290390.054478:0:92881:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c247f8cbc00/0x5953bbf6b3074eb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3074eab expref: 23 pid: 92152 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.054486:0:7428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290390.054495:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1784290390.054500:0:92881:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901128704:0@lo:104: 00000100:00100000:2.0:1784290390.054506:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901128576 00000100:00100000:2.0:1784290390.054513:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901128576 00000100:00100000:3.0:1784290390.054516:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:92881:x1870961901128320:12345-0@lo:104: 00000100:00100000:0.0:1784290390.054523:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1784290390.054534:0:92881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784290390.054535:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b3074ed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074edc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290390.054544:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469cca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:92881:x1870961901128448:12345-0@lo:104: 00000100:00100000:2.0:1784290390.054545:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901128704 00000100:00100000:2.0:1784290390.054552:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901128704 00010000:00010000:0.0:1784290390.054561:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c2458d5cc00/0x5953bbf6b3074ec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074ece expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.054565:0:92881:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b3074ea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3074e9d expref: 23 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.054577:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00010000:00010000:1.0:1784290390.054594:0:92881:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b3074ea4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3074e9d expref: 23 pid: 92151 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.054596:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:92881:x1870961901128576:12345-0@lo:104: 00010000:00010000:3.0:1784290390.054603:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:2.0:1784290390.054616:0:7428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3074eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074ec0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290390.054619:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:92881:x1870961901128320:12345-0@lo:104: Request processed in 109us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290390.054620:0:92881:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901128832:0@lo:104: 00010000:00010000:0.0:1784290390.054638:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1784290390.054653:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1784290390.054654:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469cca850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:92881:x1870961901128448:12345-0@lo:104: Request processed in 116us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290390.054669:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1784290390.054670:0:92881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290390.054685:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901128832 00000100:00100000:3.0:1784290390.054691:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901128832 00010000:00010000:1.0:1784290390.054710:0:92881:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c247f8cb200/0x5953bbf6b3074e96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3074e8f expref: 23 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290390.054711:0:7428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1784290390.054724:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:92881:x1870961901128576:12345-0@lo:104: Request processed in 131us (242us total) trans 0 rc 0/0 00010000:00010000:1.0:1784290390.054727:0:92881:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c247f8cb200/0x5953bbf6b3074e96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3074e8f expref: 23 pid: 92149 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290390.054737:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1784290390.054743:0:92881:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901128960:0@lo:104: 00000100:00100000:2.0:1784290390.054755:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1784290390.054756:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:92881:x1870961901128704:12345-0@lo:104: 00000100:00100000:3.0:1784290390.054769:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00010000:00010000:0.0:1784290390.054769:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b3074eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074eb2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290390.054780:0:92881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784290390.054791:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00000100:00100000:3.0:1784290390.054794:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:92881:x1870961901128832:12345-0@lo:104: 00010000:00010000:2.0:1784290390.054800:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b3074eff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074f06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290390.054810:0:92881:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b318900 going to sleep for 11 seconds 00010000:00010000:3.0:1784290390.054811:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3074e9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074ea4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290390.054812:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5da00 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:2.0:1784290390.054821:0:19681:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b3074eff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3074f06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.054829:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00010000:00010000:2.0:1784290390.054837:0:19681:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b3074eff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3074f06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290390.054838:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:92881:x1870961901128704:12345-0@lo:104: Request processed in 92us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290390.054842:0:92881:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343893b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901127936:0@lo:104: 00000100:00100000:0.0:1784290390.054855:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1784290390.054877:0:92881:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343890e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901128064:0@lo:104: 00000100:00100000:0.0:1784290390.054878:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901128960 10000000:00010000:2.0:1784290390.054879:0:19681:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b3074eff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3074f06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290390.054886:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901128960 00010000:00010000:3.0:1784290390.054889:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 10000000:01000000:2.0:1784290390.054892:0:19681:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1784290390.054901:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:92881:x1870961901128832:12345-0@lo:104: Request processed in 112us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290390.054901:0:92881:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343892d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901128192:0@lo:104: 00000100:00100000:0.0:1784290390.054914:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1784290390.054926:0:92881:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901128320:0@lo:104: 00000100:00100000:3.0:1784290390.054927:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1784290390.054929:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:92881:x1870961901128960:12345-0@lo:104: 00010000:00010000:2.0:1784290390.054933:0:19681:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b3074eff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074f06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.054940:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffc00/0x5953bbf6b3074e8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074e96 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290390.054957:0:92881:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901128448:0@lo:104: 00010000:00010000:2.0:1784290390.054960:0:19681:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784290390.054969:0:92881:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901128576:0@lo:104: 00010000:00010000:2.0:1784290390.054985:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b3074eff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074f06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290390.054989:0:92881:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901128704:0@lo:104: 00010000:00010000:2.0:1784290390.055004:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2458d5da00/0x5953bbf6b3074eff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074f06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290390.055016:0:92881:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901128832:0@lo:104: 00010000:00010000:2.0:1784290390.055042:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1784290390.055044:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00010000:00010000:2.0:1784290390.055058:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3074ef1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074ef8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290390.055059:0:92881:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901128960:0@lo:104: 00000100:00100000:0.0:1784290390.055064:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:92881:x1870961901128960:12345-0@lo:104: Request processed in 134us (286us total) trans 0 rc 0/0 00010000:00010000:3.0:1784290390.055068:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1784290390.055087:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b3074ee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074eea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290390.055106:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00010000:00010000:2.0:1784290390.055110:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fee00 already unused, calling callback (ffffffffc14a9c20) 00010000:00010000:3.0:1784290390.055114:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5c800 already unused, calling callback (ffffffffc14a9c20) 00010000:00010000:1.0:1784290390.055126:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 10000000:00010000:3.0:1784290390.055130:0:8418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b3074ee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3074eea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290390.055130:0:19681:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3074ef1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3074ef8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.055137:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b3074ed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074edc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.055158:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1784290390.055178:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c2458d5cc00/0x5953bbf6b3074ec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074ece expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290390.055184:0:8418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b3074ee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3074eea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.055184:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2ffa00 already unused, calling callback (ffffffffc14a9c20) 00010000:00010000:2.0:1784290390.055185:0:19681:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3074ef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3074ef8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290390.055198:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b3074ed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3074edc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.055222:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5cc00 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:3.0:1784290390.055236:0:8418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b3074ee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3074eea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290390.055240:0:19681:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3074ef1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3074ef8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290390.055242:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c2458d5cc00/0x5953bbf6b3074ec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3074ece expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.055247:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b3074ed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3074edc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290390.055287:0:19681:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1784290390.055294:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b3074ed5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3074edc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.055296:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2458d5cc00/0x5953bbf6b3074ec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3074ece expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290390.055341:0:19681:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3074ef1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074ef8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290390.055349:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1784290390.055431:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2458d5cc00/0x5953bbf6b3074ec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3074ece expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290390.055433:0:19681:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1784290390.055447:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784290390.055459:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3074ef1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074ef8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.055467:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b3074ed5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074edc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290390.055469:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3074ef1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074ef8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.055480:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c2458d5cc00/0x5953bbf6b3074ec7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074ece expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.055489:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1784290390.055501:0:8418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784290390.055504:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784290390.055506:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1784290390.055507:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b3074ed5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074edc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290390.055514:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3074eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074ec0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.055523:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c2458d5cc00/0x5953bbf6b3074ec7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074ece expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.055527:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b3074ed5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074edc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290390.055528:0:8418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b3074ee3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074eea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290390.055540:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fe000 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:2.0:1784290390.055549:0:19681:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3074eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3074ec0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.055557:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2458d5cc00/0x5953bbf6b3074ec7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074ece expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290390.055561:0:8418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784290390.055574:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b3074ee3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074eea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290390.055580:0:19681:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3074eb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3074ec0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.055598:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784290390.055607:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b3074eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074eb2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290390.055612:0:19681:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3074eb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3074ec0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290390.055626:0:19681:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784290390.055632:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784290390.055641:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3074e9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074ea4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290390.055647:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c800/0x5953bbf6b3074ee3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074eea expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.055648:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2ff000 already unused, calling callback (ffffffffc14a9c20) 00010000:00010000:2.0:1784290390.055652:0:19681:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3074eb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074ec0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.055654:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fe800 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:1.0:1784290390.055657:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b3074eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3074eb2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290390.055664:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3074e9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3074ea4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290390.055683:0:19681:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784290390.055687:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290390.055691:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b3074eab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3074eb2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.055694:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3074e9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3074ea4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290390.055696:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffc00/0x5953bbf6b3074e8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3074e96 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290390.055697:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3074eb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074ec0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290390.055714:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b3074eab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3074eb2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290390.055726:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3074e9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3074ea4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290390.055732:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2ffc00 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:3.0:1784290390.055742:0:8418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffc00/0x5953bbf6b3074e8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3074e96 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290390.055745:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784290390.055757:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784290390.055763:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3074eb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074ec0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290390.055776:0:8418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffc00/0x5953bbf6b3074e8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3074e96 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.055777:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b3074eab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074eb2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290390.055779:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290390.055785:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290390.055788:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3074e9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074ea4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290390.055790:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290390.055807:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1784290390.055813:0:8418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffc00/0x5953bbf6b3074e8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3074e96 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.055813:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784290390.055817:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901129088:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290390.055820:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b3074eab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074eb2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.055825:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3074e9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074ea4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290390.055847:0:8418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290390.055850:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b3074eab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074eb2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.055853:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3074e9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074ea4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.055867:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784290390.055888:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290390.055891:0:8418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffc00/0x5953bbf6b3074e8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074e96 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.055893:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290390.055895:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290390.055900:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290390.055902:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290390.055908:0:8418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784290390.055911:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290390.055925:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffc00/0x5953bbf6b3074e8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074e96 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.055931:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901129600:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784290390.055935:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffc00/0x5953bbf6b3074e8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3074e96 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290390.055945:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901129344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290390.055953:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901129088 00010000:00010000:3.0:1784290390.055959:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290390.055968:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290390.055969:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901129088 00010000:00010000:3.0:1784290390.055973:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290390.055978:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290390.055993:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290390.056004:0:19591:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2345ebf200/0x5953bbf6b3074f06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074eff expref: 24 pid: 92154 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290390.056006:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290390.056014:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901130112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290390.056046:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901129856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290390.056048:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901129600 00000100:00100000:0.0:1784290390.056053:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901129600 00000100:00100000:3.0:1784290390.056070:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901129344 00010000:00010000:0.0:1784290390.056075:0:19591:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b3074eea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074ee3 expref: 25 pid: 92154 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.056077:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290390.056080:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901129344 00000100:00100000:1.0:1784290390.056091:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784290390.056106:0:19592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c247f8ca600/0x5953bbf6b3074edc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074ed5 expref: 26 pid: 92152 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.056127:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784290390.056134:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901130112 00000100:00100000:2.0:1784290390.056140:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901129472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290390.056148:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784290390.056150:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901130112 00000100:00100000:3.0:1784290390.056152:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901129856 00000100:00100000:3.0:1784290390.056159:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901129856 00000100:00100000:1.0:1784290390.056160:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901129216:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290390.056199:0:19591:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c247f8cb200/0x5953bbf6b3074e96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074e8f expref: 28 pid: 92149 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.056209:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784290390.056210:0:19592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c247f8cbc00/0x5953bbf6b3074eb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074eab expref: 28 pid: 92152 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290390.056256:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901129472 00000100:00100000:0.0:1784290390.056267:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901129472 00000100:00100000:3.0:1784290390.056269:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:2.0:1784290390.056282:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901129984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784290390.056294:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+29:3620:x1870961901129088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290390.056306:0:19591:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3074ece lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074ec7 expref: 29 pid: 92154 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290390.056315:0:19592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290390.056328:0:19592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2345ebf200/0x5953bbf6b3074f06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074eff expref: 29 pid: 92154 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290390.056350:0:19592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2345ebf200/0x5953bbf6b3074f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3074eff expref: 29 pid: 92154 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290390.056439:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:2.0:1784290390.056444:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290390.056459:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2e54cd1c-9dbd-4e31-b60e-998135d46053+29:3620:x1870961901129600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784290390.056468:0:19592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebf200/0x5953bbf6b3074f06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3074eff expref: 29 pid: 92154 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.056477:0:19591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784290390.056478:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:3.0:1784290390.056489:0:19592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290390.056492:0:19591:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b3074eea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074ee3 expref: 28 pid: 92154 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.056501:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901129984 00000100:00100000:2.0:1784290390.056507:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901129984 00010000:00010000:0.0:1784290390.056511:0:19591:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b3074eea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3074ee3 expref: 28 pid: 92154 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290390.056530:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b3074ea4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074e9d expref: 29 pid: 92151 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.056536:0:19591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b3074eea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3074ee3 expref: 29 pid: 92154 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290390.056545:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+29:3620:x1870961901129088:12345-0@lo:103:ldlm_bl.0 Request processed in 258us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290390.056552:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896262912 00010000:00010000:0.0:1784290390.056558:0:19591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784290390.056559:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896262912 00000100:00100000:1.0:1784290390.056560:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290390.056567:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00010000:00010000:2.0:1784290390.056580:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b3074f14 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24e1 expref: 10 pid: 92151 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290390.056599:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896263040 00000100:00100000:1.0:1784290390.056606:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896263040 00000100:00100000:0.0:1784290390.056617:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2e54cd1c-9dbd-4e31-b60e-998135d46053+27:3620:x1870961901129600:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290390.056622:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00100000:0.0:1784290390.056634:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:2.0:1784290390.056640:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+27:3618:x1870961901129344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290390.056642:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c247f8caa00/0x5953bbf6b3074f0d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24da expref: 11 pid: 92149 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290390.056655:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1784290390.056662:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603 00010000:00010000:2.0:1784290390.056666:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c247f8ca600/0x5953bbf6b3074edc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074ed5 expref: 26 pid: 92152 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290390.056677:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245818d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+26:3620:x1870961901130112:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290390.056682:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00010000:00010000:2.0:1784290390.056683:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c247f8ca600/0x5953bbf6b3074edc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3074ed5 expref: 26 pid: 92152 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290390.056699:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605 00000100:00100000:0.0:1784290390.056701:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2e54cd1c-9dbd-4e31-b60e-998135d46053+26:3618:x1870961901129856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784290390.056708:0:19592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290390.056715:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247f8ca600/0x5953bbf6b3074edc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3074ed5 expref: 26 pid: 92152 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.056717:0:19591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290390.056721:0:19592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c247f8cb200/0x5953bbf6b3074e96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074e8f expref: 26 pid: 92149 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290390.056724:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+26:3620:x1870961901129472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290390.056732:0:19591:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c247f8cbc00/0x5953bbf6b3074eb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074eab expref: 26 pid: 92152 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290390.056748:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290390.056751:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290390.056757:0:19592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c247f8cb200/0x5953bbf6b3074e96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3074e8f expref: 25 pid: 92149 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.056761:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3074ece lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074ec7 expref: 25 pid: 92154 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.056781:0:19591:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c247f8cbc00/0x5953bbf6b3074eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3074eab expref: 25 pid: 92152 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.056789:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+25:3618:x1870961901129344:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290390.056799:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00010000:00010000:3.0:1784290390.056809:0:19592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247f8cb200/0x5953bbf6b3074e96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3074e8f expref: 25 pid: 92149 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.056809:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3074ece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3074ec7 expref: 25 pid: 92154 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.056822:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2606 00000100:00100000:2.0:1784290390.056837:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3620:x1870961901129984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290390.056847:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290390.056850:0:19591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247f8cbc00/0x5953bbf6b3074eb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3074eab expref: 23 pid: 92152 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290390.056856:0:19592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290390.056856:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b3074ea4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074e9d expref: 23 pid: 92151 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.056858:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b3074ece lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3074ec7 expref: 23 pid: 92154 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.056879:0:19591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290390.056895:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b3074ea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3074e9d expref: 21 pid: 92151 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290390.056898:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245818d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:3620:x1870961901130112:12345-0@lo:103:ldlm_bl.0 Request processed in 225us (829us total) trans 0 rc 0/0 00010000:00010000:1.0:1784290390.056914:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784290390.056916:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:3618:x1870961901129856:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290390.056920:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603 00010000:00010000:2.0:1784290390.056922:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebee00/0x5953bbf6b3074ea4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3074e9d expref: 21 pid: 92151 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290390.056936:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00010000:00010000:2.0:1784290390.056958:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784290390.056965:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:3620:x1870961901129472:12345-0@lo:103:ldlm_bl.0 Request processed in 249us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290390.056973:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2607 00000100:00100000:1.0:1784290390.056992:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605 00000100:00100000:0.0:1784290390.056995:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+11:2400:x1870961896262912:12345-192.168.202.6@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1784290390.057005:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:3620:x1870961901129984:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (660us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290390.057007:0:19591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1784290390.057014:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2608 00010000:00010000:0.0:1784290390.057020:0:19591:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b3074f14 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24e1 expref: 11 pid: 92151 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.057030:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2606 00000100:00100000:3.0:1784290390.057036:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+11:2399:x1870961896263040:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784290390.057044:0:19591:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b3074f14 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24e1 expref: 11 pid: 92151 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290390.057066:0:19592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784290390.057078:0:92881:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343890000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901127680:192.168.202.6@tcp:104: 00010000:00010000:3.0:1784290390.057084:0:19592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c247f8caa00/0x5953bbf6b3074f0d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24da expref: 11 pid: 92149 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.057096:0:19591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b3074f14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24e1 expref: 11 pid: 92151 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290390.057104:0:92881:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92881:1870961901127808:192.168.202.6@tcp:104: 00010000:00010000:3.0:1784290390.057109:0:19592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c247f8caa00/0x5953bbf6b3074f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24da expref: 11 pid: 92149 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290390.057141:0:19592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247f8caa00/0x5953bbf6b3074f0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24da expref: 11 pid: 92149 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.057143:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784290390.057158:0:19591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290390.057171:0:19592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784290390.057202:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901129728:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290390.057207:0:92881:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b3074f22 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290390.057240:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:2400:x1870961896262912:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 239us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290390.057241:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:2399:x1870961896263040:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 202us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290390.057263:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290390.057272:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2607 00000100:00100000:1.0:1784290390.057282:0:10356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901129216 00000100:00100000:1.0:1784290390.057290:0:10356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901129216 00000100:00100000:3.0:1784290390.057297:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2608 00000100:00100000:0.0:1784290390.057316:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901129728 00000100:00100000:2.0:1784290390.057317:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a541180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901129344:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290390.057324:0:10356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c247f8cbe00/0x5953bbf6b3074ef8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074ef1 expref: 17 pid: 92152 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290390.057329:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901129728 00000100:00100000:2.0:1784290390.057344:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901129856:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290390.057422:0:19591:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2345ebe200/0x5953bbf6b3074ec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074eb9 expref: 18 pid: 92149 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290390.057447:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609 00000100:00100000:3.0:1784290390.057463:0:19593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:3618:x1870961901129216:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290390.057469:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2610 00010000:00010000:3.0:1784290390.057476:0:19593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290390.057485:0:19593:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c247f8cbe00/0x5953bbf6b3074ef8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074ef1 expref: 18 pid: 92152 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290390.057492:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245818dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:3618:x1870961901129728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784290390.057505:0:19593:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c247f8cbe00/0x5953bbf6b3074ef8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3074ef1 expref: 18 pid: 92152 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.057508:0:19591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290390.057522:0:19591:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2345ebe200/0x5953bbf6b3074ec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3074eb9 expref: 18 pid: 92149 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290390.057529:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247f8cbe00/0x5953bbf6b3074ef8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3074ef1 expref: 18 pid: 92152 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.057552:0:19591:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2345ebe200/0x5953bbf6b3074ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3074eb9 expref: 17 pid: 92149 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290390.057561:0:19593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290390.057573:0:19591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebe200/0x5953bbf6b3074ec0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3074eb9 expref: 17 pid: 92149 timeout: 2231 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.057575:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468890380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901129472:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290390.057600:0:19591:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b3074f22 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.057601:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901129984:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290390.057640:0:19591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b3074f22 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 92881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.057650:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901130112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290390.057666:0:19591:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b3074f22 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.057674:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901129088:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290390.057695:0:19591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b3074f22 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.057705:0:19591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b3074f22 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.057711:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901129600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784290390.057719:0:19593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:3618:x1870961901129216:12345-0@lo:103:ldlm_bl.0 Request processed in 255us (584us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290390.057733:0:19591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b3074f22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290390.057745:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609 00010000:00010000:0.0:1784290390.057752:0:19591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8ca400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290390.057760:0:19591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b3074f22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.057771:0:19591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b3074f22 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290390.057810:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901129216:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290390.057812:0:19591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b3074f22 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290390.057827:0:19591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290390.057843:0:92881:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b3074f22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.057854:0:92881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b3074f22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.057860:0:92881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b3074f22 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290390.057875:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245818dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:3618:x1870961901129728:12345-0@lo:103:ldlm_bl.0 Request processed in 394us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290390.057885:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2610 00000100:00100000:2.0:1784290390.057921:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901129728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290390.213555:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290390.213668:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896263168 00000100:00100000:1.0:1784290390.213685:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896263168 00000100:00100000:1.0:1784290390.213761:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 122 00000100:00100000:1.0:1784290390.213779:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70750:x1870961896263168:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290390.213802:0:92149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290390.213826:0:92149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b3074f29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b24e8 expref: -99 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.213863:0:92149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b3074f29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24e8 expref: 9 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.213914:0:92149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b3074f29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24e8 expref: 9 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290390.213927:0:92149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8ca400, rc 0) 00000100:00100000:1.0:1784290390.214004:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896263168:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 231us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290390.214014:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 122 00000100:00100000:2.0:1784290390.215444:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290390.215526:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896263296 00000100:00100000:3.0:1784290390.215537:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896263296 00000100:00100000:3.0:1784290390.215597:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 123 00000100:00100000:3.0:1784290390.215610:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896263296:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290390.215784:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896263296:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 175us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290390.215795:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 123 00000100:00100000:2.0:1784290390.216928:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290390.217017:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896263424 00000100:00100000:0.0:1784290390.217030:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896263424 00000100:00100000:0.0:1784290390.217099:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 124 00000100:00100000:0.0:1784290390.217116:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d3cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896263424:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290390.217263:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d3cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896263424:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 149us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290390.217291:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 124 00000100:00100000:2.0:1784290390.218849:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290390.218993:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896263552 00000100:00100000:1.0:1784290390.219004:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896263552 00000100:00100000:1.0:1784290390.219062:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 125 00000100:00100000:1.0:1784290390.219090:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343b49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:71733:x1870961896263552:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784290390.219224:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343b49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:71733:x1870961896263552:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 149us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290390.219235:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 125 00000100:00100000:2.0:1784290390.220213:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290390.220402:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896263680 00000100:00100000:1.0:1784290390.220413:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896263680 00000100:00100000:1.0:1784290390.220466:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 126 00000100:00100000:1.0:1784290390.220478:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:71733:x1870961896263680:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784290390.220596:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:71733:x1870961896263680:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 117us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290390.220606:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 126 00000100:00100000:2.0:1784290390.222086:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290390.222226:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896263808 00000100:00100000:3.0:1784290390.222236:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896263808 00000100:00100000:3.0:1784290390.222284:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 127 00000100:00100000:3.0:1784290390.222320:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896263808:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290390.222334:0:92151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290390.222427:0:92151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247d2ffc00/0x5953bbf6b3074f30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b24ef expref: -99 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290390.222454:0:92151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247d2ffc00/0x5953bbf6b3074f30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24ef expref: 10 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290390.222467:0:92151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247d2ffc00/0x5953bbf6b3074f30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24ef expref: 10 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290390.222477:0:92151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2ffc00, rc 0) 00000100:00100000:3.0:1784290390.222527:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70750:x1870961896263808:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 210us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290390.222537:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 127 00000100:00100000:2.0:1784290390.223559:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290390.223636:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896263936 00000100:00100000:0.0:1784290390.223657:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896263936 00000100:00100000:0.0:1784290390.223709:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 128 00000100:00100000:0.0:1784290390.223720:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24759f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70750:x1870961896263936:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290390.223810:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24759f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70750:x1870961896263936:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 89us (253us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784290390.223824:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 128 00000100:00100000:2.0:1784290390.533445:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290390.533483:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290390.533493:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896264192 00000100:00100000:3.0:1784290390.533502:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896264192 00000100:00100000:2.0:1784290390.533506:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290390.533538:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290390.533561:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896264448 00000100:00100000:0.0:1784290390.533568:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896264448 00000100:00100000:3.0:1784290390.533570:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896264320 00000100:00080000:1.0:1784290390.533571:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784290390.533575:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896264320 00000100:00100000:2.0:1784290390.533588:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 728 00000100:00100000:1.0:1784290390.533594:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896264064 00000100:00100000:1.0:1784290390.533600:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896264064 00000100:00100000:2.0:1784290390.533602:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2399:x1870961896264192:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290390.533626:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 729 00000100:00100000:0.0:1784290390.533627:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1598 00000100:00100000:0.0:1784290390.533649:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2399:x1870961896264448:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290390.533650:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2400:x1870961896264320:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290390.533650:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 129 00000100:00100000:1.0:1784290390.533677:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24759f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2400:x1870961896264064:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290390.533680:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2399:x1870961896264192:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 81us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290390.533702:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 728 00000100:00100000:0.0:1784290390.533703:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2399:x1870961896264448:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 62us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290390.533713:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2400:x1870961896264320:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 72us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290390.533717:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1598 00000100:00100000:3.0:1784290390.533732:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 729 00000100:00100000:1.0:1784290390.533732:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24759f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2400:x1870961896264064:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 56us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290390.533743:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 129 00000100:00080000:0.0:1784290390.533761:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1784290390.695586:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290391.207629:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901130368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290391.207631:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901130240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290391.207746:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290391.207828:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290391.207867:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901130240 00000100:00100000:0.0:1784290391.207884:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901130240 00000100:00100000:2.0:1784290391.207915:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901130368 00000100:00100000:2.0:1784290391.207926:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901130368 00000100:00080000:1.0:1784290391.207999:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784290391.208012:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290391.208015:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:2.0:1784290391.208036:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:0.0:1784290391.208045:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901130240:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784290391.208083:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1870961901130368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784290391.208126:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00002000:00000024:0.0:1784290391.208128:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784290391.208262:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1870961901130368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 206us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290391.208272:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901130240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 234us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290391.208286:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:0.0:1784290391.208301:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:3.0:1784290391.208331:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901130368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290391.208450:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901130240:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1784290391.719724:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784290391.911493:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784290391.911505:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c246dd94000 from 55 10000000:01000000:3.0:1784290391.911512:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784290391.911595:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b3074f37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290391.911625:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b3074f37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290391.911637:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b3074f37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290391.911668:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901130496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290391.911764:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290391.911817:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784290391.911915:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901130496 00000100:00100000:1.0:1784290391.911935:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901130496 00000100:00100000:1.0:1784290391.912033:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1784290391.912047:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24759f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:6485:x1870961901130496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290391.912081:0:92149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290391.912105:0:92149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247f8cb600/0x5953bbf6b3074f3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074f37 expref: -99 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290391.912144:0:92149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247f8cb600/0x5953bbf6b3074f3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074f37 expref: 16 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290391.912160:0:92149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247f8cb600/0x5953bbf6b3074f3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074f37 expref: 16 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290391.912172:0:92149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8cb600, rc 0) 00000100:00100000:1.0:1784290391.912285:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24759f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901130496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 240us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290391.912321:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1784290391.912443:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901130496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290391.912492:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b3074f37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f3e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290391.912511:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b3074f37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074f3e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290391.912630:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901130624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290391.912663:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290391.912694:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784290391.912739:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901130624 00000100:00100000:0.0:1784290391.912763:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901130624 00000100:00100000:0.0:1784290391.912823:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1784290391.912835:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24759f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901130624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290391.913014:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24759f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901130624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 181us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290391.913034:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1784290391.913159:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901130624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290391.913221:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901130752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290391.913310:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290391.913331:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784290391.913414:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901130752 00000100:00100000:0.0:1784290391.913424:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901130752 00000100:00100000:0.0:1784290391.913478:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1784290391.913493:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24759f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901130752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290391.913664:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24759f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901130752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290391.913676:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784290391.913717:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901130752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290391.914404:0:92882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92882:1870961901130880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290391.914475:0:92882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290391.914519:0:92882:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784290391.914619:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901130880 00000100:00100000:1.0:1784290391.914632:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901130880 00000100:00100000:1.0:1784290391.914688:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784290391.914699:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24759f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:92882:x1870961901130880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290391.914858:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24759f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:92882:x1870961901130880:12345-0@lo:502:llog_process_th.0 Request processed in 154us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290391.914874:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1784290391.914904:0:92882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92882:1870961901130880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290391.914962:0:92882:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92882:1870961901131008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290391.914997:0:92882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290391.915040:0:92882:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344dd4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290391.915100:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901131008 00000100:00100000:1.0:1784290391.915110:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901131008 00000100:00100000:1.0:1784290391.915154:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1784290391.915163:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:92882:x1870961901131008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290391.915295:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:92882:x1870961901131008:12345-0@lo:502:llog_process_th.0 Request processed in 131us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290391.915306:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1784290391.915362:0:92882:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92882:1870961901131008:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784290391.915413:0:92882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1784290391.915626:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:2.0:1784290391.915651:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784290391.915659:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b3074f37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f3e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.915668:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b3074f37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f3e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290391.915689:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1784290391.915691:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 50 10000000:01000000:2.0:1784290391.915692:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1784290391.915711:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074f45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.915717:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074f45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.915723:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074f45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290391.915734:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901131136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.915771:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.915799:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9480 going to sleep for 11 seconds 00000100:00100000:0.0:1784290391.915894:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901131136 00000100:00100000:0.0:1784290391.915906:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901131136 00000100:00100000:0.0:1784290391.915961:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1784290391.915972:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24759f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901131136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290391.915985:0:92151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290391.915999:0:92151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebe200/0x5953bbf6b3074f4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074f45 expref: -99 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290391.916023:0:92151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebe200/0x5953bbf6b3074f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074f45 expref: 17 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290391.916036:0:92151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebe200/0x5953bbf6b3074f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074f45 expref: 17 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290391.916047:0:92151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebe200, rc 0) 00000100:00100000:0.0:1784290391.916131:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24759f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901131136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290391.916141:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1784290391.916207:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901131136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290391.916221:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074f45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f4c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.916229:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074f45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074f4c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290391.916310:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901131264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.916428:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.916473:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9480 going to sleep for 11 seconds 00000100:00100000:0.0:1784290391.916530:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901131264 00000100:00100000:0.0:1784290391.916544:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901131264 00000100:00100000:0.0:1784290391.916599:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1784290391.916608:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901131264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290391.916744:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901131264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290391.916757:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1784290391.916783:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901131264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.916816:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901131392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.916881:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.916912:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9480 going to sleep for 11 seconds 00000100:00100000:1.0:1784290391.916952:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901131392 00000100:00100000:1.0:1784290391.916964:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901131392 00000100:00100000:1.0:1784290391.917021:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784290391.917034:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901131392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290391.917178:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901131392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290391.917194:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1784290391.917260:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901131392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.917801:0:92883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92883:1870961901131520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290391.917838:0:92883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.917860:0:92883:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9180 going to sleep for 11 seconds 00000100:00100000:1.0:1784290391.917963:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901131520 00000100:00100000:1.0:1784290391.917975:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901131520 00000100:00100000:1.0:1784290391.918042:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784290391.918054:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:92883:x1870961901131520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290391.918218:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:92883:x1870961901131520:12345-0@lo:502:llog_process_th.0 Request processed in 163us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290391.918232:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1784290391.918312:0:92883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92883:1870961901131520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784290391.918390:0:92883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784290391.918408:0:92883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290391.918412:0:92883:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:2.0:1784290391.918420:0:92883:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1784290391.918451:0:92883:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000020:01000004:2.0:1784290391.918966:0:92884:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c246dd94000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1784290391.918971:0:92884:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c246dd94000 4 00000100:00100000:0.0:1784290391.919043:0:92883:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343890a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92883:1870961901131648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290391.919140:0:92883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290391.919203:0:92883:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246d46ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1784290391.919293:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901131648 00000100:00100000:3.0:1784290391.919305:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901131648 00000100:00100000:3.0:1784290391.919441:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1784290391.919454:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:92883:x1870961901131648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290391.919604:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:92883:x1870961901131648:12345-0@lo:502:llog_process_th.0 Request processed in 150us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290391.919620:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784290391.919682:0:92883:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343890a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92883:1870961901131648:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784290391.919725:0:92883:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784290391.919735:0:92883:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290391.919738:0:92883:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1784290391.919745:0:92883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:3.0:1784290391.919856:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 50-52 (rc=0) 10000000:01000000:3.0:1784290391.919905:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784290391.919918:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074f45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f4c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290391.919934:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074f45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f4c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290391.919959:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784290391.919962:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c23452c5000 from 55 10000000:01000000:3.0:1784290391.919966:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784290391.919994:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff400/0x5953bbf6b3074f53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290391.920005:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff400/0x5953bbf6b3074f53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290391.920017:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff400/0x5953bbf6b3074f53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290391.920040:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901131776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290391.920082:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290391.920124:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344dd4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784290391.920146:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901131776 00000100:00100000:0.0:1784290391.920154:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901131776 00000100:00100000:0.0:1784290391.920204:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784290391.920213:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901131776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290391.920234:0:92154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290391.920247:0:92154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b3074f5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074f53 expref: -99 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290391.920270:0:92154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b3074f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074f53 expref: 18 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290391.920296:0:92154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b3074f5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074f53 expref: 18 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290391.920308:0:92154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebfe00, rc 0) 00000100:00100000:0.0:1784290391.920499:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901131776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 277us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290391.920514:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1784290391.920529:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901131776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290391.920560:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff400/0x5953bbf6b3074f53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f5a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.920573:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff400/0x5953bbf6b3074f53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074f5a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290391.920648:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901131904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.920682:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.920712:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784290391.920754:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901131904 00000100:00100000:1.0:1784290391.920766:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901131904 00000100:00100000:1.0:1784290391.920821:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1784290391.920831:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901131904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290391.920972:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901131904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290391.920984:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784290391.921025:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901131904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.921073:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901132032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.921146:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.921176:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784290391.921215:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901132032 00000100:00100000:1.0:1784290391.921224:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901132032 00000100:00100000:1.0:1784290391.921277:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1784290391.921285:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901132032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290391.921495:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901132032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290391.921515:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784290391.921561:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901132032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.921889:0:92885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92885:1870961901132160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290391.921945:0:92885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.921986:0:92885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290391.922017:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901132160 00000100:00100000:3.0:1784290391.922031:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901132160 00000100:00100000:3.0:1784290391.922086:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1784290391.922097:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:92885:x1870961901132160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290391.922267:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:92885:x1870961901132160:12345-0@lo:502:llog_process_th.0 Request processed in 169us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290391.922279:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1784290391.922297:0:92885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92885:1870961901132160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290391.922424:0:92885:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92885:1870961901132288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290391.922483:0:92885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.922519:0:92885:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290391.922555:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901132288 00000100:00100000:0.0:1784290391.922567:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901132288 00000100:00100000:0.0:1784290391.922628:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784290391.922641:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:92885:x1870961901132288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290391.922780:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:92885:x1870961901132288:12345-0@lo:502:llog_process_th.0 Request processed in 139us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290391.922793:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1784290391.922804:0:92885:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92885:1870961901132288:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784290391.922844:0:92885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:3.0:1784290391.922979:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:3.0:1784290391.923028:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290391.923038:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff400/0x5953bbf6b3074f53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f5a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290391.923053:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff400/0x5953bbf6b3074f53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f5a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290391.923084:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1784290391.923087:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 50 10000000:01000000:3.0:1784290391.923090:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1784290391.923121:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3074f61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290391.923131:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3074f61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290391.923142:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3074f61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290391.923163:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901132416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290391.923210:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290391.923257:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344dd43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290391.923435:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901132416 00000100:00100000:1.0:1784290391.923447:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901132416 00000100:00100000:1.0:1784290391.923501:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784290391.923515:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901132416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290391.923528:0:92152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290391.923542:0:92152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247f8cbe00/0x5953bbf6b3074f68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074f61 expref: -99 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290391.923565:0:92152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247f8cbe00/0x5953bbf6b3074f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074f61 expref: 19 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290391.923602:0:92152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247f8cbe00/0x5953bbf6b3074f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074f61 expref: 19 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290391.923612:0:92152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8cbe00, rc 0) 00000100:00100000:1.0:1784290391.923674:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901132416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290391.923687:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1784290391.923723:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901132416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290391.923747:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3074f61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f68 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290391.923761:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3074f61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074f68 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290391.923831:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901132544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290391.923870:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290391.923912:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344dd43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290391.923939:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901132544 00000100:00100000:1.0:1784290391.923947:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901132544 00000100:00100000:1.0:1784290391.923989:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1784290391.923997:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901132544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290391.924113:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901132544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290391.924123:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1784290391.924165:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901132544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290391.924214:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901132672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290391.924291:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290391.924321:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344dd43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290391.924511:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901132672 00000100:00100000:0.0:1784290391.924525:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901132672 00000100:00100000:0.0:1784290391.924589:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784290391.924603:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901132672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290391.924745:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901132672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290391.924757:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1784290391.924796:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901132672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290391.925262:0:92886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92886:1870961901132800:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290391.925317:0:92886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290391.925425:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901132800 00000100:00100000:0.0:1784290391.925434:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901132800 00000100:00100000:3.0:1784290391.925439:0:92886:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344dd4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784290391.925498:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784290391.925518:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:92886:x1870961901132800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290391.925674:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:92886:x1870961901132800:12345-0@lo:502:llog_process_th.0 Request processed in 161us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290391.925685:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784290391.925726:0:92886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92886:1870961901132800:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784290391.925763:0:92886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784290391.925776:0:92886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290391.925779:0:92886:0:(obd_config.c:1561:class_process_config()) marker 45 (0x1) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1784290391.925786:0:92886:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1784290391.925805:0:92886:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:3.0:1784290391.925830:0:92886:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92886:1870961901132928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290391.925883:0:92886:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290391.925910:0:92886:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fda7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784290391.926012:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901132928 00000100:00100000:1.0:1784290391.926023:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901132928 00000100:00100000:1.0:1784290391.926075:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784290391.926086:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c1a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:92886:x1870961901132928:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290391.926218:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c1a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:92886:x1870961901132928:12345-0@lo:502:llog_process_th.0 Request processed in 131us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290391.926230:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1784290391.926269:0:92886:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92886:1870961901132928:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784290391.926310:0:92886:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290391.926316:0:92886:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290391.926318:0:92886:0:(obd_config.c:1561:class_process_config()) marker 45 (0x2) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1784290391.926323:0:92886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000020:01000000:2.0:1784290391.926470:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 50-52 (rc=0) 10000000:01000000:2.0:1784290391.926531:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1784290391.926543:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3074f61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f68 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.926557:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3074f61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f68 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290391.926571:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784290391.926573:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c246ff27800 from 55 10000000:01000000:2.0:1784290391.926577:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784290391.926621:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c000/0x5953bbf6b3074f6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.926637:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c000/0x5953bbf6b3074f6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.926645:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c000/0x5953bbf6b3074f6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290391.926657:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901133056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.926691:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.926722:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9180 going to sleep for 11 seconds 00000100:00100000:1.0:1784290391.926822:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901133056 00000100:00100000:1.0:1784290391.926833:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901133056 00000100:00100000:1.0:1784290391.926888:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784290391.926899:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901133056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290391.926930:0:92149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290391.926945:0:92149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247f8caa00/0x5953bbf6b3074f76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074f6f expref: -99 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290391.926971:0:92149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247f8caa00/0x5953bbf6b3074f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074f6f expref: 20 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290391.926984:0:92149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247f8caa00/0x5953bbf6b3074f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074f6f expref: 20 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290391.926993:0:92149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8caa00, rc 0) 00000100:00100000:1.0:1784290391.927058:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901133056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290391.927067:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1784290391.927170:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901133056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290391.927194:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c000/0x5953bbf6b3074f6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f76 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.927222:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c000/0x5953bbf6b3074f6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074f76 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290391.927266:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901133184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.927296:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.927317:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9180 going to sleep for 11 seconds 00000100:00100000:0.0:1784290391.927463:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901133184 00000100:00100000:0.0:1784290391.927479:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901133184 00000100:00100000:0.0:1784290391.927555:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784290391.927575:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901133184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290391.927726:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901133184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290391.927736:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784290391.927790:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901133184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.927819:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901133312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.927865:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.927894:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9180 going to sleep for 11 seconds 00000100:00100000:0.0:1784290391.927935:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901133312 00000100:00100000:0.0:1784290391.927947:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901133312 00000100:00100000:0.0:1784290391.928007:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784290391.928022:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901133312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290391.928159:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901133312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290391.928179:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784290391.928203:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901133312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290391.928706:0:92887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343890a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92887:1870961901133440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290391.928770:0:92887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290391.928814:0:92887:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246d46a840 going to sleep for 11 seconds 00000100:00100000:1.0:1784290391.928898:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901133440 00000100:00100000:1.0:1784290391.928910:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901133440 00000100:00100000:1.0:1784290391.928964:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784290391.928974:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:92887:x1870961901133440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290391.929108:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:92887:x1870961901133440:12345-0@lo:502:llog_process_th.0 Request processed in 129us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290391.929120:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784290391.929133:0:92887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343890a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92887:1870961901133440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290391.929201:0:92887:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343890a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92887:1870961901133568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290391.929252:0:92887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290391.929281:0:92887:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246d46a840 going to sleep for 11 seconds 00000100:00100000:1.0:1784290391.929320:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901133568 00000100:00100000:1.0:1784290391.929328:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901133568 00000100:00100000:1.0:1784290391.929430:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784290391.929441:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:92887:x1870961901133568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290391.929553:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:92887:x1870961901133568:12345-0@lo:502:llog_process_th.0 Request processed in 111us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290391.929579:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784290391.929614:0:92887:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343890a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92887:1870961901133568:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784290391.929663:0:92887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1784290391.929784:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:2.0:1784290391.929809:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784290391.929815:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c000/0x5953bbf6b3074f6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f76 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.929823:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c000/0x5953bbf6b3074f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f76 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290391.929830:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1784290391.929831:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1784290391.929833:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1784290391.929852:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d000/0x5953bbf6b3074f7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.929857:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d000/0x5953bbf6b3074f7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.929863:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d000/0x5953bbf6b3074f7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290391.929875:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901133696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.929909:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.929940:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9180 going to sleep for 11 seconds 00000100:00100000:0.0:1784290391.929995:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901133696 00000100:00100000:0.0:1784290391.930015:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901133696 00000100:00100000:0.0:1784290391.930064:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1784290391.930074:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901133696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290391.930085:0:92151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290391.930098:0:92151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b3074f84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074f7d expref: -99 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290391.930121:0:92151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b3074f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074f7d expref: 21 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290391.930134:0:92151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b3074f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074f7d expref: 21 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290391.930144:0:92151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebe000, rc 0) 00000100:00100000:0.0:1784290391.930211:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901133696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290391.930220:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784290391.930275:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901133696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290391.930289:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d000/0x5953bbf6b3074f7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f84 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.930297:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d000/0x5953bbf6b3074f7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074f84 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290391.930332:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901133824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.930450:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.930493:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9180 going to sleep for 11 seconds 00000100:00100000:0.0:1784290391.930505:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901133824 00000100:00100000:0.0:1784290391.930520:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901133824 00000100:00100000:0.0:1784290391.930579:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1784290391.930594:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901133824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290391.930727:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901133824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290391.930740:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784290391.930755:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901133824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.930790:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901133952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.930835:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.930853:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9180 going to sleep for 11 seconds 00000100:00100000:1.0:1784290391.930894:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901133952 00000100:00100000:1.0:1784290391.930906:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901133952 00000100:00100000:1.0:1784290391.930969:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784290391.930985:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901133952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290391.931129:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901133952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290391.931140:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784290391.931188:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901133952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784290391.932611:0:92888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1784290391.932691:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1784290391.932724:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1784290391.932732:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d000/0x5953bbf6b3074f7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f84 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.932739:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d000/0x5953bbf6b3074f7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f84 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290391.932747:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784290391.932749:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c247d3d2000 from 55 10000000:01000000:2.0:1784290391.932750:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784290391.932765:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5ca00/0x5953bbf6b3074f8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.932771:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2458d5ca00/0x5953bbf6b3074f8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.932777:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2458d5ca00/0x5953bbf6b3074f8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290391.932786:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901134080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.932821:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.932846:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784290391.932893:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901134080 00000100:00100000:1.0:1784290391.932904:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901134080 00000100:00100000:1.0:1784290391.932960:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784290391.932972:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901134080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290391.932987:0:92149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290391.933001:0:92149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247f8ca600/0x5953bbf6b3074f92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074f8b expref: -99 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290391.933025:0:92149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247f8ca600/0x5953bbf6b3074f92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074f8b expref: 22 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290391.933038:0:92149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247f8ca600/0x5953bbf6b3074f92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074f8b expref: 22 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290391.933048:0:92149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8ca600, rc 0) 00000100:00100000:1.0:1784290391.933115:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901134080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290391.933128:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1784290391.933144:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901134080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290391.933161:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2458d5ca00/0x5953bbf6b3074f8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f92 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.933168:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2458d5ca00/0x5953bbf6b3074f8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074f92 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290391.933205:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901134208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.933230:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.933246:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784290391.933289:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901134208 00000100:00100000:0.0:1784290391.933298:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901134208 00000100:00100000:0.0:1784290391.933423:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1784290391.933438:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901134208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290391.933608:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901134208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 173us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290391.933619:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784290391.933662:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901134208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.933692:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901134336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.933727:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.933750:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784290391.933779:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901134336 00000100:00100000:0.0:1784290391.933787:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901134336 00000100:00100000:0.0:1784290391.933828:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1784290391.933836:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901134336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290391.933957:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901134336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290391.933969:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784290391.933982:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901134336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290391.934432:0:92889:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343890a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92889:1870961901134464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290391.934532:0:92889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290391.934590:0:92889:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dac6300 going to sleep for 11 seconds 00000100:00100000:1.0:1784290391.934600:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901134464 00000100:00100000:1.0:1784290391.934635:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901134464 00000100:00100000:1.0:1784290391.934691:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784290391.934706:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23439a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:92889:x1870961901134464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290391.934836:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23439a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:92889:x1870961901134464:12345-0@lo:502:llog_process_th.0 Request processed in 132us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290391.934849:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1784290391.934873:0:92889:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343890a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92889:1870961901134464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290391.934941:0:92889:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343890a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92889:1870961901134592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290391.934991:0:92889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290391.935019:0:92889:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784290391.935058:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901134592 00000100:00100000:1.0:1784290391.935066:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901134592 00000100:00100000:1.0:1784290391.935107:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784290391.935119:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:92889:x1870961901134592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290391.935232:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:92889:x1870961901134592:12345-0@lo:502:llog_process_th.0 Request processed in 113us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290391.935248:0:92889:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343890a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:92889:1870961901134592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290391.935249:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000040:00080000:0.0:1784290391.935299:0:92889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1784290391.935465:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:2.0:1784290391.935499:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784290391.935507:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5ca00/0x5953bbf6b3074f8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f92 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.935517:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2458d5ca00/0x5953bbf6b3074f8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f92 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290391.935525:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1784290391.935537:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1784290391.935541:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784290391.935566:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d800/0x5953bbf6b3074f99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.935575:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d800/0x5953bbf6b3074f99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.935584:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d800/0x5953bbf6b3074f99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290391.935601:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901134720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.935655:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.935683:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784290391.935701:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901134720 00000100:00100000:0.0:1784290391.935709:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901134720 00000100:00100000:0.0:1784290391.935756:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1784290391.935764:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901134720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290391.935775:0:92151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290391.935800:0:92151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebfc00/0x5953bbf6b3074fa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074f99 expref: -99 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290391.935826:0:92151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebfc00/0x5953bbf6b3074fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074f99 expref: 23 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290391.935839:0:92151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebfc00/0x5953bbf6b3074fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074f99 expref: 23 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290391.935849:0:92151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebfc00, rc 0) 00000100:00100000:0.0:1784290391.935909:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901134720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290391.935919:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1784290391.935935:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901134720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290391.935958:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d800/0x5953bbf6b3074f99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074fa0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.935966:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d800/0x5953bbf6b3074f99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074fa0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290391.936034:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901134848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.936075:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.936104:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784290391.936118:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901134848 00000100:00100000:0.0:1784290391.936126:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901134848 00000100:00100000:0.0:1784290391.936165:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1784290391.936173:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901134848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290391.936308:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901134848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290391.936321:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901134848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290391.936322:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784290391.936423:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901134976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.936513:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.936562:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784290391.936593:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901134976 00000100:00100000:1.0:1784290391.936616:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901134976 00000100:00100000:1.0:1784290391.936672:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1784290391.936684:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901134976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290391.936827:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901134976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290391.936839:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1784290391.936849:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901134976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784290391.938136:0:92890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1784290391.938270:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1784290391.938285:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1784290391.938290:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d800/0x5953bbf6b3074f99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074fa0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.938297:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d800/0x5953bbf6b3074f99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074fa0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290391.938305:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784290391.938306:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9c2480260000 from 1 10000000:01000000:2.0:1784290391.938308:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784290391.938326:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c600/0x5953bbf6b3074fa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.938332:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c600/0x5953bbf6b3074fa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.938386:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c600/0x5953bbf6b3074fa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290391.938409:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901135104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.938467:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.938509:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784290391.938532:0:92149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901135104 00000100:00100000:1.0:1784290391.938543:0:92149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901135104 00000100:00100000:1.0:1784290391.938591:0:92149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1784290391.938615:0:92149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901135104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290391.938629:0:92149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290391.938655:0:92149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247f8cb200/0x5953bbf6b3074fae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074fa7 expref: -99 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290391.938679:0:92149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247f8cb200/0x5953bbf6b3074fae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074fa7 expref: 24 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290391.938692:0:92149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247f8cb200/0x5953bbf6b3074fae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074fa7 expref: 24 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290391.938702:0:92149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8cb200, rc 0) 00000100:00100000:1.0:1784290391.938767:0:92149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901135104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290391.938777:0:92149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1784290391.938792:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901135104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290391.938809:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c600/0x5953bbf6b3074fa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074fae expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.938817:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c600/0x5953bbf6b3074fa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074fae expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290391.938859:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901135232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290391.938888:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290391.938904:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784290391.938934:0:92151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901135232 00000100:00100000:0.0:1784290391.938943:0:92151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901135232 00000100:00100000:0.0:1784290391.939002:0:92151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1784290391.939010:0:92151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901135232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290391.939104:0:92151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901135232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (213us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784290391.939116:0:92151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1784290391.939155:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901135232:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1784290391.939186:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784290391.939193:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c600/0x5953bbf6b3074fa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074fae expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290391.939202:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c600/0x5953bbf6b3074fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074fae expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290392.509894:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290392.509953:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896264576 00000100:00100000:3.0:1784290392.509967:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896264576 00000100:00100000:3.0:1784290392.510064:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1233 00000100:00080000:0.0:1784290392.510069:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784290392.510076:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:71753:x1870961896264576:12345-192.168.202.6@tcp:101:mkdir.0 00010000:00010000:3.0:1784290392.510114:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290392.510139:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff800/0x5953bbf6b3074fb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b24f6 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.510216:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff600/0x5953bbf6b3074fbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.510230:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff600/0x5953bbf6b3074fbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.510264:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff600/0x5953bbf6b3074fbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290392.510411:0:66008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784290392.510416:0:66008:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784290392.510458:0:66008:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff600/0x5953bbf6b3074fbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.510485:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff800/0x5953bbf6b3074fb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24f6 expref: 8 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.510503:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff600/0x5953bbf6b3074fbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24f6 expref: 7 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.510511:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:3.0:1784290392.510514:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784290392.510517:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2ff600, rc 0) 00000100:00100000:3.0:1784290392.510632:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:71753:x1870961896264576:12345-192.168.202.6@tcp:101:mkdir.0 Request processed in 553us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290392.510648:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1233 00000100:00100000:2.0:1784290392.512430:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290392.512512:0:65997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896264704 00000100:00100000:3.0:1784290392.512523:0:65997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896264704 00000100:00100000:3.0:1784290392.512614:0:65997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:3.0:1784290392.512634:0:65997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:71753:x1870961896264704:12345-192.168.202.6@tcp:700:mkdir.0 00000100:00100000:3.0:1784290392.512737:0:65997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:71753:x1870961896264704:12345-192.168.202.6@tcp:700:mkdir.0 Request processed in 110us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290392.512753:0:65997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 15 00000100:00100000:2.0:1784290392.513914:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290392.513959:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896264960 00000100:00100000:3.0:1784290392.513965:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896264960 00000100:00100000:3.0:1784290392.514000:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1234 00000100:00100000:3.0:1784290392.514006:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:71753:x1870961896264960:12345-192.168.202.6@tcp:36:mkdir.0 00010000:00010000:3.0:1784290392.514042:0:65990:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290392.514058:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff600/0x5953bbf6b3074fbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24f6 expref: 7 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.514073:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:3.0:1784290392.514076:0:65990:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290392.514151:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3074fc3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.514164:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3074fc3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.514174:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3074fc3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.514192:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3074fca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.514233:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3074fca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.514243:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3074fca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.515478:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3074fd1 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.515491:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3074fd1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.515501:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3074fd1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290392.515521:0:65990:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fad6ef13 reply state 0000000035ca63fe transno 115964116995 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3074fd1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.515535:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3074fd1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.515542:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c244c870d00) 00010000:00010000:3.0:1784290392.515546:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290392.515549:0:65990:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784290392.515554:0:65990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1784290392.515563:0:65990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3074fc3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.515572:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3074fc3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.515601:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3074fc3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.515612:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3074fc3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.515619:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fe200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290392.515622:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3074fc3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.515629:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3074fc3 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.515636:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:3.0:1784290392.515638:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290392.515640:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3074fc3 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.515645:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3074fc3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290392.515653:0:65990:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fad6ef13 reply state 0000000035ca63fe transno 115964116995 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3074fca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.515659:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3074fca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.515683:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9c244c870800) 00010000:00010000:3.0:1784290392.515688:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290392.515692:0:65990:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1784290392.515781:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:71753:x1870961896264960:12345-192.168.202.6@tcp:36:mkdir.0 Request processed in 1770us (1867us total) trans 115964116995 rc 0/0 00000100:00100000:3.0:1784290392.515791:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1234 00000100:00100000:2.0:1784290392.516921:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290392.517036:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896265088 00000100:00100000:0.0:1784290392.517049:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896265088 00000100:00100000:0.0:1784290392.517131:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1235 00000100:00100000:0.0:1784290392.517147:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:71753:x1870961896265088:12345-192.168.202.6@tcp:101:mkdir.0 00010000:00010000:0.0:1784290392.517171:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290392.517194:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3074fd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b24fd expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.517271:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf600/0x5953bbf6b3074fdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.517285:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf600/0x5953bbf6b3074fdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.517296:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf600/0x5953bbf6b3074fdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290392.517409:0:66004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784290392.517414:0:66004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784290392.517438:0:66004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf600/0x5953bbf6b3074fdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.517478:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3074fd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24fd expref: 10 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.517499:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf600/0x5953bbf6b3074fdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24fd expref: 9 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.517507:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:0.0:1784290392.517511:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784290392.517523:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebf600, rc 0) 00000100:00100000:0.0:1784290392.517590:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:71753:x1870961896265088:12345-192.168.202.6@tcp:101:mkdir.0 Request processed in 448us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290392.517611:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1235 00000100:00100000:0.0:1784290392.519080:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290392.519146:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896265344 00000100:00100000:3.0:1784290392.519155:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896265344 00000100:00100000:3.0:1784290392.519210:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1236 00000100:00100000:3.0:1784290392.519225:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:71753:x1870961896265344:12345-192.168.202.6@tcp:101:mkdir.0 00010000:00010000:3.0:1784290392.519240:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290392.519254:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe000/0x5953bbf6b3074fe6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2504 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519313:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3074fed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519327:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3074fed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519400:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3074fed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519413:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b3074ff4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519439:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b3074ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519448:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b3074ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290392.519522:0:74876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1784290392.519580:0:74876:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3074fed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519606:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3074fed lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519617:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3074fed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519622:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3074fed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519625:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2ff000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290392.519628:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3074fed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519632:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3074fed lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519640:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:3.0:1784290392.519642:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290392.519645:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3074fed lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519649:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3074fed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519672:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b3074ff4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519681:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b3074ff4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519692:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b3074ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519702:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fee00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290392.519720:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b3074ff4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519733:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b3074ff4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519749:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9c244c870800) 00010000:00010000:3.0:1784290392.519754:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290392.519760:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b3074ff4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519771:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b3074ff4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519822:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe000/0x5953bbf6b3074fe6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2504 expref: 11 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519840:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:3.0:1784290392.519843:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784290392.519848:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe000/0x5953bbf6b3074fe6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2504 expref: 11 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.519860:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2fe000, rc 0) 00000100:00100000:3.0:1784290392.519919:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:71753:x1870961896265344:12345-192.168.202.6@tcp:101:mkdir.0 Request processed in 702us (845us total) trans 115964116996 rc 301/301 00000100:00100000:3.0:1784290392.519925:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1236 00000100:00100000:0.0:1784290392.521202:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290392.521279:0:75766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896265472 00000100:00100000:1.0:1784290392.521289:0:75766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896265472 00000100:00080000:0.0:1784290392.521369:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784290392.521444:0:75766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:1.0:1784290392.521464:0:75766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:71753:x1870961896265472:12345-192.168.202.6@tcp:900:mkdir.0 00000100:00100000:1.0:1784290392.521541:0:75766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:71753:x1870961896265472:12345-192.168.202.6@tcp:900:mkdir.0 Request processed in 84us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290392.521556:0:75766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 12 00000100:00100000:1.0:1784290392.522627:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290392.522715:0:68995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896265728 00000100:00100000:3.0:1784290392.522726:0:68995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896265728 00000100:00100000:3.0:1784290392.522778:0:68995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 235 00000100:00100000:3.0:1784290392.522789:0:68995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:71753:x1870961896265728:12345-192.168.202.6@tcp:35:mkdir.0 00000100:00100000:3.0:1784290392.522956:0:68995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:71753:x1870961896265728:12345-192.168.202.6@tcp:35:mkdir.0 Request processed in 168us (332us total) trans 115964116997 rc 0/0 00000100:00100000:3.0:1784290392.522965:0:68995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 235 00000100:00100000:0.0:1784290392.524295:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290392.525013:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896265984 00000100:00100000:1.0:1784290392.525021:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896265984 00000100:00100000:1.0:1784290392.525062:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1237 00000100:00100000:1.0:1784290392.525077:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:71753:x1870961896265984:12345-192.168.202.6@tcp:36:mkdir.0 00000100:00100000:1.0:1784290392.525206:0:65989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c8aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901135360:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784290392.525275:0:65989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290392.525328:0:65989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23432cf600 going to sleep for 11 seconds 00000100:00100000:3.0:1784290392.525397:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901135360 00000100:00100000:3.0:1784290392.525410:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901135360 00000100:00100000:3.0:1784290392.525509:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3850 00000100:00100000:3.0:1784290392.525541:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:65989:x1870961901135360:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784290392.525824:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:65989:x1870961901135360:12345-0@lo:1000:mdt00_001.0 Request processed in 293us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290392.525846:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3850 00000100:00100000:0.0:1784290392.525854:0:65989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c8aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901135360:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784290392.525961:0:65989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901135488:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784290392.526007:0:65989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290392.526050:0:65989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8780 going to sleep for 11 seconds 00000100:00100000:0.0:1784290392.526129:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901135488 00000100:00100000:0.0:1784290392.526148:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901135488 00000100:00100000:0.0:1784290392.526210:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3851 00000100:00100000:0.0:1784290392.526223:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:65989:x1870961901135488:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784290392.526377:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:65989:x1870961901135488:12345-0@lo:1000:mdt00_001.0 Request processed in 111us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290392.526402:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3851 00000100:00100000:0.0:1784290392.526461:0:65989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901135488:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784290392.526522:0:65989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901135616:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784290392.526558:0:65989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290392.526587:0:65989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8780 going to sleep for 11 seconds 00000100:00100000:1.0:1784290392.526590:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901135616 00000100:00100000:1.0:1784290392.526604:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901135616 00000100:00100000:0.0:1784290392.526642:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3852 00000100:00100000:0.0:1784290392.526655:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:65989:x1870961901135616:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784290392.526762:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343892d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:65989:x1870961901135616:12345-0@lo:1000:mdt00_001.0 Request processed in 111us (205us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784290392.526783:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3852 00000100:00100000:0.0:1784290392.526843:0:65989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901135616:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1784290392.526896:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.526906:0:65989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.526916:0:65989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290392.526929:0:65989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901135744:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1784290392.526966:0:65989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290392.526998:0:65989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8900 going to sleep for 11 seconds 00000100:00100000:3.0:1784290392.527045:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901135744 00000100:00100000:3.0:1784290392.527057:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901135744 00000100:00100000:3.0:1784290392.527138:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3853 00000100:00100000:3.0:1784290392.527159:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:65989:x1870961901135744:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1784290392.527197:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290392.527225:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3075009 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3075002 expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.527283:0:8413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3074fd1 lrc: 2/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.527303:0:8413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3075009 lrc: 4/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3075002 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.527466:0:8413:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3074fd1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:3.0:1784290392.527529:0:8413:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:3.0:1784290392.527649:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3075009 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075002 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.527666:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c244c870d00) 00010000:00010000:3.0:1784290392.527670:0:8413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290392.527675:0:8413:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3075009 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075002 expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.527685:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2fe200, rc 0) 00000100:00100000:3.0:1784290392.527765:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343890e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65989:x1870961901135744:12345-0@lo:101:mdt00_001.0 Request processed in 615us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290392.527774:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3853 00000100:00100000:3.0:1784290392.527836:0:65989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901135744:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1784290392.527856:0:65989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075009 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.527868:0:65989:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075009 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784290392.529679:0:92145:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116997 is committed 00010000:00010000:3.0:1784290392.529773:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3074fca lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.529781:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3074fca lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.529788:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3074fca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.529804:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fec00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290392.529809:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3074fca lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.529817:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3074fca lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.529834:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9c244c870800) 00010000:00010000:3.0:1784290392.529836:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290392.529840:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3074fca lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.529845:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3074fca lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.529878:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3074fd1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.529883:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3074fd1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.529888:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3074fd1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.529895:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fea00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290392.529900:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3074fd1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.529906:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3074fd1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.529930:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c244c870d00) 00010000:00010000:3.0:1784290392.529932:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290392.529937:0:3603:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3075009 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075002 expref: 7 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.529944:0:3603:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3075009 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x5953bbf6b3075002 expref: 7 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.529952:0:3603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3075009 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x5953bbf6b3075002 expref: 7 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.529981:0:3603:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3075009 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075002 expref: 7 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290392.529994:0:3603:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3603:1870961901135872:0@lo:105: 00000100:00100000:3.0:1784290392.530046:0:3603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290392.530147:0:3603:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b2790c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290392.530198:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901135872 00000100:00100000:3.0:1784290392.530204:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901135872 00000100:00100000:3.0:1784290392.530284:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1784290392.530298:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3603:x1870961901135872:12345-0@lo:105: 00010000:00010000:3.0:1784290392.530312:0:6471:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075009 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.530324:0:6471:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075009 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.530468:0:6471:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075009 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.530478:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 5/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x5953bbf6b3075009 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.530486:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x5953bbf6b3075009 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.530497:0:6471:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x5953bbf6b3075009 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.530521:0:6471:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9c2345ebf200) 00000100:00100000:3.0:1784290392.530604:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:3603:x1870961901135872:12345-0@lo:105: Request processed in 310us (561us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290392.530608:0:65989:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075009 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290392.530616:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00010000:00010000:0.0:1784290392.530636:0:65989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075009 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784290392.530666:0:65989:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00000100:00100000:3.0:1784290392.530688:0:3603:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3603:1870961901135872:0@lo:105: 00010000:00010000:0.0:1784290392.530704:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf800/0x5953bbf6b3075010 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.530713:0:65989:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf800/0x5953bbf6b3075010 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.530722:0:65989:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf800/0x5953bbf6b3075010 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.530726:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3074fd1 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.530747:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3074fd1 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290392.530766:0:65989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901136000:0@lo:101:mdt00_001.0 00000100:00100000:0.0:1784290392.530815:0:65989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290392.530852:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901136000 00000100:00100000:0.0:1784290392.530858:0:65989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8780 going to sleep for 11 seconds 00000100:00100000:3.0:1784290392.530862:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901136000 00000100:00100000:3.0:1784290392.530922:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3854 00000100:00100000:3.0:1784290392.530933:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65989:x1870961901136000:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1784290392.530949:0:22091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290392.530973:0:22091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe000/0x5953bbf6b3075017 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3075010 expref: -99 pid: 22091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.530990:0:22091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe000/0x5953bbf6b3075017 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3075010 expref: 9 pid: 22091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.531000:0:22091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe000/0x5953bbf6b3075017 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075010 expref: 9 pid: 22091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.531024:0:22091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff9c244c870200) 00010000:00010000:3.0:1784290392.531028:0:22091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290392.531031:0:22091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2fe000, rc 0) 00000100:00100000:3.0:1784290392.531097:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343893b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65989:x1870961901136000:12345-0@lo:101:mdt00_001.0 Request processed in 167us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290392.531107:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3854 00000100:00100000:0.0:1784290392.531150:0:65989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901136000:0@lo:101:mdt00_001.0 00010000:00010000:0.0:1784290392.531172:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf800/0x5953bbf6b3075010 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075017 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.531184:0:65989:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf800/0x5953bbf6b3075010 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075017 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784290392.531200:0:65989:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00000100:00100000:0.0:1784290392.531228:0:65989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343891880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901136128:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784290392.531270:0:65989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290392.531303:0:65989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784290392.531409:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901136128 00000100:00100000:3.0:1784290392.531417:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901136128 00000100:00100000:3.0:1784290392.531496:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3855 00000100:00100000:3.0:1784290392.531514:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65989:x1870961901136128:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784290392.531640:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65989:x1870961901136128:12345-0@lo:1000:mdt00_001.0 Request processed in 131us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290392.531652:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3855 00000100:00100000:0.0:1784290392.531682:0:65989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343891880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901136128:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784290392.531732:0:65989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474b4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901136256:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784290392.531762:0:65989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290392.531791:0:65989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784290392.531797:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901136256 00000100:00100000:3.0:1784290392.531803:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901136256 00000100:00100000:3.0:1784290392.531838:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3856 00000100:00100000:3.0:1784290392.531845:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65989:x1870961901136256:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784290392.531924:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65989:x1870961901136256:12345-0@lo:1000:mdt00_001.0 Request processed in 80us (161us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784290392.531931:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3856 00000100:00100000:2.0:1784290392.532837:0:65989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474b4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901136256:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784290392.532926:0:65989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901136384:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784290392.532964:0:65989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290392.532988:0:65989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9540 going to sleep for 11 seconds 00000100:00100000:2.0:1784290392.533019:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901136384 00000100:00100000:2.0:1784290392.533024:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901136384 00000100:00100000:2.0:1784290392.533066:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3857 00000100:00100000:2.0:1784290392.533074:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65989:x1870961901136384:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784290392.533161:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65989:x1870961901136384:12345-0@lo:1000:mdt00_001.0 Request processed in 82us (191us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784290392.533181:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3857 00000100:00100000:3.0:1784290392.533184:0:65989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901136384:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784290392.533255:0:65989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901136512:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784290392.533289:0:65989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290392.533311:0:65989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b279e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784290392.533391:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901136512 00000100:00100000:0.0:1784290392.533400:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901136512 00000100:00100000:0.0:1784290392.533466:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3858 00000100:00100000:0.0:1784290392.533478:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65989:x1870961901136512:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784290392.533557:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65989:x1870961901136512:12345-0@lo:1000:mdt00_001.0 Request processed in 83us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290392.533564:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3858 00000100:00100000:0.0:1784290392.533621:0:65989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901136512:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784290392.533672:0:65989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474b4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901136640:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784290392.533713:0:65989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290392.533746:0:65989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8540 going to sleep for 11 seconds 00000100:00100000:3.0:1784290392.533755:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901136640 00000100:00100000:3.0:1784290392.533761:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901136640 00000100:00100000:3.0:1784290392.533797:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3859 00000100:00100000:3.0:1784290392.533803:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65989:x1870961901136640:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784290392.533883:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343891880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65989:x1870961901136640:12345-0@lo:1000:mdt00_001.0 Request processed in 78us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290392.533888:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3859 00000100:00100000:0.0:1784290392.534154:0:65989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474b4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901136640:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784290392.534204:0:65989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474b4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901136768:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784290392.534238:0:65989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290392.534261:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901136768 00000100:00100000:0.0:1784290392.534262:0:65989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8540 going to sleep for 11 seconds 00000100:00100000:2.0:1784290392.534269:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901136768 00000100:00100000:2.0:1784290392.534321:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3860 00000100:00100000:2.0:1784290392.534629:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65989:x1870961901136768:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784290392.534732:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65989:x1870961901136768:12345-0@lo:1000:mdt00_001.0 Request processed in 403us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290392.534741:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3860 00000100:00100000:0.0:1784290392.534766:0:65989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474b4d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:65989:1870961901136768:0@lo:1000:mdt00_001.0 00000040:00080000:0.0:1784290392.535263:0:65989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a4:0x1:0x0].3, 968 off35168 00000040:00080000:0.0:1784290392.535316:0:65989:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000c751:0x1:0x0].3, 1120 off35552 00000004:00080000:0.0:1784290392.535322:0:65989:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c244a1c80c0 with version 10 00000004:00080000:2.0:1784290392.535387:0:75392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9c2344dd4900 version 10 rpc_version 10 00000020:00100000:2.0:1784290392.535410:0:75392:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1784290392.535419:0:75392:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c247d29dc00 x1870961901137024/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2392/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290392.535435:0:75392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29dc00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75392:1870961901137024:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784290392.535476:0:75392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290392.535502:0:75392:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290392.535524:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901137024 00000100:00100000:3.0:1784290392.535535:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901137024 00000100:00100000:3.0:1784290392.535589:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3861 00000100:00100000:3.0:1784290392.535600:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75392:x1870961901137024:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784290392.535928:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:75392:x1870961901137024:12345-0@lo:1000:osp_up0-1.0 Request processed in 329us (453us total) trans 115964116998 rc 0/0 00000100:00100000:3.0:1784290392.535939:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3861 00000100:00100000:2.0:1784290392.536004:0:75392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29dc00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75392:1870961901137024:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1784290392.536079:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf000/0x5953bbf6b307501e lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.536094:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf000/0x5953bbf6b307501e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.536105:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf000/0x5953bbf6b307501e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290392.536121:0:65989:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005de42b51 reply state 000000004feddede transno 81604378763 ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf000/0x5953bbf6b307501e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.536131:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf000/0x5953bbf6b307501e lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.536139:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c2474f5f000) 00010000:00010000:0.0:1784290392.536150:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290392.536154:0:65989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784290392.536159:0:65989:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00080000:0.0:1784290392.536166:0:65989:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:0.0:1784290392.536173:0:65989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075009 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.536182:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3075009 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.536189:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3075009 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.536214:0:65989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1784290392.536226:0:65989:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:0.0:1784290392.536231:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf800/0x5953bbf6b3075010 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075017 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.536238:0:65989:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf800/0x5953bbf6b3075010 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075017 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.536291:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290392.536306:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3075009 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290392.536312:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:71753:x1870961896265984:12345-192.168.202.6@tcp:36:mkdir.0 Request processed in 11237us (12017us total) trans 81604378763 rc 0/0 00000100:00100000:0.0:1784290392.536388:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1237 00010000:00010000:3.0:1784290392.536412:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf200 already unused, calling callback (ffffffffc1ac6ed0) 00010000:00010000:3.0:1784290392.536439:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3075009 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290392.536458:0:6476:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3075009 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.536517:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3075009 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.536531:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784290392.536589:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 1/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3075009 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290392.536595:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784290392.536628:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901137152:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784290392.536630:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf200/0x5953bbf6b3075002 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3075009 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290392.536682:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290392.536720:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901137152 00010000:00010000:3.0:1784290392.536728:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290392.536728:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901137152 00010000:00010000:3.0:1784290392.536740:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290392.536746:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290392.536770:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:0.0:1784290392.536785:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+10:3620:x1870961901137152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290392.536796:0:19592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290392.536820:0:19592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3075009 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3075002 expref: 10 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.536834:0:19592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c244c870d00) 00010000:00010000:0.0:1784290392.536842:0:19592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784290392.536886:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:lustre-MDT0001-mdtlov_UUID+9:3620:x1870961901137152:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290392.536894:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00100000:2.0:1784290392.536923:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901137152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290392.537989:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290392.538071:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896266240 00000100:00100000:3.0:1784290392.538085:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896266240 00000100:00100000:3.0:1784290392.538164:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1238 00000100:00100000:3.0:1784290392.538188:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:71753:x1870961896266240:12345-192.168.202.6@tcp:36:mkdir.0 00010000:00010000:3.0:1784290392.538264:0:65988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290392.538290:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf600/0x5953bbf6b3074fdf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24fd expref: 7 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.538315:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:3.0:1784290392.538322:0:65988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784290392.538542:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:71753:x1870961896266240:12345-192.168.202.6@tcp:36:mkdir.0 Request processed in 360us (548us total) trans 0 rc -17/-17 00000100:00100000:3.0:1784290392.538562:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1238 00000100:00100000:2.0:1784290392.539532:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290392.539573:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896266368 00000100:00100000:0.0:1784290392.539580:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896266368 00000100:00100000:0.0:1784290392.539630:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1239 00000100:00100000:0.0:1784290392.539643:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:71753:x1870961896266368:12345-192.168.202.6@tcp:101:mkdir.0 00010000:00010000:0.0:1784290392.539655:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290392.539667:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b3075025 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b250b expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.539708:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe400/0x5953bbf6b307502c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.539718:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe400/0x5953bbf6b307502c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.539726:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe400/0x5953bbf6b307502c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290392.539749:0:66008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784290392.539752:0:66008:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784290392.539765:0:66008:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe400/0x5953bbf6b307502c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.539798:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b3075025 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b250b expref: 8 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.539813:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe400/0x5953bbf6b307502c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b250b expref: 7 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.539820:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:0.0:1784290392.539823:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784290392.539825:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebe400, rc 0) 00000100:00100000:0.0:1784290392.539868:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:71753:x1870961896266368:12345-192.168.202.6@tcp:101:mkdir.0 Request processed in 231us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290392.539876:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1239 00000100:00100000:0.0:1784290392.541157:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290392.541252:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896266496 00000100:00100000:2.0:1784290392.541260:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896266496 00000100:00100000:2.0:1784290392.541416:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1240 00000100:00100000:2.0:1784290392.541437:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:71753:x1870961896266496:12345-192.168.202.6@tcp:101:mkdir.0 00010000:00010000:2.0:1784290392.541470:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290392.541482:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ce00/0x5953bbf6b3075033 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2512 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541521:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307503a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541532:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307503a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541543:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307503a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541563:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b3075041 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541571:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b3075041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541580:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b3075041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541653:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075048 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541665:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075048 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541676:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075048 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784290392.541703:0:65990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784290392.541716:0:65990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784290392.541739:0:65990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075048 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541748:0:65990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307503a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541757:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307503a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541763:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307503a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541768:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307503a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541775:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5dc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290392.541780:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307503a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541786:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307503a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541798:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:2.0:1784290392.541801:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290392.541804:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307503a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541810:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307503a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541825:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b3075041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541841:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b3075041 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541848:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b3075041 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541853:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5d200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290392.541855:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b3075041 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541861:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b3075041 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541875:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9c2458ba5200) 00010000:00010000:2.0:1784290392.541879:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290392.541882:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b3075041 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541887:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b3075041 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541917:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ce00/0x5953bbf6b3075033 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2512 expref: 9 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541934:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075048 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2512 expref: 8 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.541941:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c2458ba5700) 00010000:00010000:2.0:1784290392.541945:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784290392.541953:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2458d5c800, rc 0) 00000100:00100000:2.0:1784290392.542017:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:71753:x1870961896266496:12345-192.168.202.6@tcp:101:mkdir.0 Request processed in 587us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290392.542030:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1240 00000100:00100000:2.0:1784290392.543496:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290392.543536:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896266752 00000100:00100000:0.0:1784290392.543544:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896266752 00000100:00100000:0.0:1784290392.543608:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1241 00000100:00100000:0.0:1784290392.543621:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:71753:x1870961896266752:12345-192.168.202.6@tcp:36:mkdir.0 00000100:00100000:0.0:1784290392.543683:0:66004:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d00380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66004:1870961901137280:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784290392.543717:0:66004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290392.543742:0:66004:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784290392.543755:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901137280 00000100:00100000:2.0:1784290392.543762:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901137280 00000100:00100000:2.0:1784290392.543816:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3862 00000100:00100000:2.0:1784290392.543836:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66004:x1870961901137280:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784290392.543941:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66004:x1870961901137280:12345-0@lo:1000:mdt00_003.0 Request processed in 112us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290392.543960:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3862 00000100:00100000:0.0:1784290392.543980:0:66004:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d00380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66004:1870961901137280:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784290392.544048:0:66004:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d00380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66004:1870961901137408:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784290392.544101:0:66004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290392.544129:0:66004:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244a1c8900 going to sleep for 11 seconds 00000100:00100000:1.0:1784290392.544163:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901137408 00000100:00100000:1.0:1784290392.544172:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901137408 00000100:00100000:1.0:1784290392.544242:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3863 00000100:00100000:1.0:1784290392.544256:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66004:x1870961901137408:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784290392.544455:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66004:x1870961901137408:12345-0@lo:1000:mdt00_003.0 Request processed in 201us (350us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784290392.544467:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3863 00000100:00100000:0.0:1784290392.544469:0:66004:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d00380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66004:1870961901137408:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1784290392.544516:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.544524:0:66004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.544532:0:66004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290392.544543:0:66004:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345d00380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66004:1870961901137536:0@lo:101:mdt00_003.0 00000100:00100000:0.0:1784290392.544570:0:66004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290392.544593:0:66004:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784290392.544628:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901137536 00000100:00100000:1.0:1784290392.544636:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901137536 00000100:00100000:1.0:1784290392.544687:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3864 00000100:00100000:1.0:1784290392.544701:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66004:x1870961901137536:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1784290392.544713:0:22091:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290392.544729:0:22091:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075056 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307504f expref: -99 pid: 22091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.544754:0:22091:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075048 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2512 expref: 7 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.544769:0:22091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075056 lrc: 4/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307504f expref: 10 pid: 22091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.544804:0:22091:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075048 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2512 expref: 7 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.544823:0:22091:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075048 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2512 expref: 7 pid: 65990 timeout: 2233 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290392.544860:0:22091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c88700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:22091:1870961901137664:192.168.202.6@tcp:104: 00000100:00100000:1.0:1784290392.544949:0:22091:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23432cf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290392.546402:0:22091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c88700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:22091:1870961901137664:192.168.202.6@tcp:104: 00000100:00100000:0.0:1784290392.546412:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:1.0:1784290392.546453:0:22091:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075056 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307504f expref: 10 pid: 22091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.546463:0:22091:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c2458ba5700) 00000100:00100000:2.0:1784290392.546464:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896266880 00010000:00010000:1.0:1784290392.546467:0:22091:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290392.546470:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896266880 00010000:00010000:1.0:1784290392.546472:0:22091:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075056 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307504f expref: 10 pid: 22091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.546482:0:22091:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8ca200, rc 0) 00010000:00010000:2.0:1784290392.546494:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075048 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2512 expref: 8 pid: 65990 timeout: 2233 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290392.546531:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66004:x1870961901137536:12345-0@lo:101:mdt00_003.0 Request processed in 1830us (1955us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290392.546539:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2611 00000100:00100000:1.0:1784290392.546546:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3864 00000100:00100000:2.0:1784290392.546556:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:2399:x1870961896266880:12345-192.168.202.6@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1784290392.546559:0:66004:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345d00380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66004:1870961901137536:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1784290392.546569:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290392.546576:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075048 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2512 expref: 8 pid: 65990 timeout: 2233 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.546578:0:66004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075056 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.546602:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075048 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2512 expref: 8 pid: 65990 timeout: 2233 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.546606:0:66004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075056 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.546627:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075048 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2512 expref: 8 pid: 65990 timeout: 2233 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.546652:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c2458ba5700) 00010000:00010000:2.0:1784290392.546659:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075056 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307504f expref: 9 pid: 22091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.546671:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075056 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x5953bbf6b307504f expref: 9 pid: 22091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.546680:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075056 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x5953bbf6b307504f expref: 9 pid: 22091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.546709:0:7430:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075056 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307504f expref: 9 pid: 22091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290392.546721:0:7430:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:7430:1870961901137792:0@lo:105: 00000100:00100000:2.0:1784290392.546748:0:7430:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290392.546777:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901137792 00000100:00100000:2.0:1784290392.546782:0:7430:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290392.546783:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901137792 00000100:00100000:0.0:1784290392.546820:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1784290392.546826:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:7430:x1870961901137792:12345-0@lo:105: 00010000:00010000:0.0:1784290392.546835:0:6517:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075056 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.546843:0:6517:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075056 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.546862:0:6517:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075056 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.546869:0:6517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 5/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x5953bbf6b3075056 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.546874:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x5953bbf6b3075056 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.546881:0:6517:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x5953bbf6b3075056 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.546900:0:6517:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9c2345ebfa00) 00010000:00010000:2.0:1784290392.546926:0:66004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075056 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.546936:0:66004:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075056 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290392.546942:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:7430:x1870961901137792:12345-0@lo:105: Request processed in 113us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290392.546954:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000004:00080000:2.0:1784290392.546958:0:66004:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00000100:00100000:1.0:1784290392.546970:0:7430:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:7430:1870961901137792:0@lo:105: 00010000:00010000:2.0:1784290392.546982:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2458d5cc00/0x5953bbf6b307505d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.546986:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290392.546993:0:66004:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2458d5cc00/0x5953bbf6b307505d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.547008:0:66004:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2458d5cc00/0x5953bbf6b307505d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290392.547022:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2399:x1870961896266880:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 473us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290392.547023:0:66004:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66004:1870961901137920:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1784290392.547039:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2611 00000100:00100000:2.0:1784290392.547064:0:66004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290392.547091:0:66004:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd9480 going to sleep for 11 seconds 00000100:00100000:3.0:1784290392.547119:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901137920 00000100:00100000:3.0:1784290392.547126:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901137920 00000100:00100000:3.0:1784290392.547270:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3865 00000100:00100000:3.0:1784290392.547289:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:66004:x1870961901137920:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1784290392.547306:0:8413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290392.547323:0:8413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3075064 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307505d expref: -99 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.547444:0:8413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3075064 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307505d expref: 11 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.547462:0:8413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3075064 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307505d expref: 11 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.547472:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff9c244c870800) 00010000:00010000:3.0:1784290392.547475:0:8413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290392.547478:0:8413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2fea00, rc 0) 00000100:00100000:3.0:1784290392.547542:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66004:x1870961901137920:12345-0@lo:101:mdt00_003.0 Request processed in 259us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290392.547551:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3865 00000100:00100000:2.0:1784290392.547574:0:66004:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66004:1870961901137920:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1784290392.547590:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2458d5cc00/0x5953bbf6b307505d lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075064 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.547599:0:66004:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2458d5cc00/0x5953bbf6b307505d lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075064 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784290392.547621:0:66004:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00000100:00100000:2.0:1784290392.547643:0:66004:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66004:1870961901138048:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784290392.547681:0:66004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290392.547741:0:66004:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290392.547748:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901138048 00000100:00100000:3.0:1784290392.547754:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901138048 00000100:00100000:3.0:1784290392.547784:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3866 00000100:00100000:3.0:1784290392.547790:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66004:x1870961901138048:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784290392.547850:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66004:x1870961901138048:12345-0@lo:1000:mdt00_003.0 Request processed in 61us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290392.547875:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3866 00000100:00100000:2.0:1784290392.547910:0:66004:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66004:1870961901138048:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784290392.547947:0:66004:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66004:1870961901138176:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784290392.547971:0:66004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290392.547990:0:66004:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290392.548011:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901138176 00000100:00100000:1.0:1784290392.548021:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901138176 00000100:00100000:1.0:1784290392.548082:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3867 00000100:00100000:1.0:1784290392.548094:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66004:x1870961901138176:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784290392.548209:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66004:x1870961901138176:12345-0@lo:1000:mdt00_003.0 Request processed in 117us (234us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784290392.548229:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3867 00000100:00100000:2.0:1784290392.548245:0:66004:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66004:1870961901138176:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784290392.548294:0:66004:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66004:1870961901138304:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784290392.548313:0:66004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290392.548391:0:66004:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290392.548723:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901138304 00000100:00100000:1.0:1784290392.548729:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901138304 00000100:00100000:1.0:1784290392.548757:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3868 00000100:00100000:1.0:1784290392.548762:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66004:x1870961901138304:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784290392.548819:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66004:x1870961901138304:12345-0@lo:1000:mdt00_003.0 Request processed in 57us (505us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784290392.548827:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3868 00000100:00100000:2.0:1784290392.548852:0:66004:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66004:1870961901138304:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784290392.548890:0:66004:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66004:1870961901138432:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784290392.548911:0:66004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290392.548932:0:66004:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290392.548972:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901138432 00000100:00100000:3.0:1784290392.548984:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901138432 00000100:00100000:3.0:1784290392.549071:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3869 00000100:00100000:3.0:1784290392.549097:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66004:x1870961901138432:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784290392.549191:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66004:x1870961901138432:12345-0@lo:1000:mdt00_003.0 Request processed in 97us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290392.549207:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3869 00000100:00100000:2.0:1784290392.549240:0:66004:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66004:1870961901138432:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784290392.549284:0:66004:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66004:1870961901138560:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784290392.549312:0:66004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290392.549567:0:66004:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290392.549726:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901138560 00000100:00100000:3.0:1784290392.549733:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901138560 00000100:00100000:3.0:1784290392.549761:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3870 00000100:00100000:3.0:1784290392.549766:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66004:x1870961901138560:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784290392.549836:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66004:x1870961901138560:12345-0@lo:1000:mdt00_003.0 Request processed in 69us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290392.549843:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3870 00000100:00100000:2.0:1784290392.549873:0:66004:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66004:1870961901138560:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784290392.549910:0:66004:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66004:1870961901138688:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784290392.549936:0:66004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290392.549955:0:66004:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345bd96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290392.549967:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901138688 00000100:00100000:1.0:1784290392.549973:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901138688 00000100:00100000:1.0:1784290392.550015:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3871 00000100:00100000:1.0:1784290392.550020:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66004:x1870961901138688:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784290392.550080:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:66004:x1870961901138688:12345-0@lo:1000:mdt00_003.0 Request processed in 60us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290392.550086:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3871 00000100:00100000:2.0:1784290392.550112:0:66004:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:66004:1870961901138688:0@lo:1000:mdt00_003.0 00000040:00080000:2.0:1784290392.550414:0:66004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a4:0x1:0x0].4, 968 off36136 00000040:00080000:2.0:1784290392.550451:0:66004:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x20000c751:0x1:0x0].4, 1120 off36672 00000004:00080000:2.0:1784290392.550455:0:66004:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c2345bd9480 with version 11 00000004:00080000:1.0:1784290392.550485:0:75392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9c2344dd4900 version 11 rpc_version 11 00000020:00100000:1.0:1784290392.550504:0:75392:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1784290392.550510:0:75392:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c2469c88700 x1870961901138944/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2136/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784290392.550523:0:75392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c88700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75392:1870961901138944:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784290392.550550:0:75392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290392.550570:0:75392:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23432cf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290392.550595:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901138944 00000100:00100000:0.0:1784290392.550602:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901138944 00000100:00100000:0.0:1784290392.550637:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3872 00000100:00100000:0.0:1784290392.550645:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:75392:x1870961901138944:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784290392.550889:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:75392:x1870961901138944:12345-0@lo:1000:osp_up0-1.0 Request processed in 243us (336us total) trans 115964116999 rc 0/0 00000100:00100000:0.0:1784290392.550899:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3872 00000100:00100000:1.0:1784290392.550934:0:75392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c88700 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75392:1870961901138944:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1784290392.550988:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5ce00/0x5953bbf6b307506b lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.550999:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5ce00/0x5953bbf6b307506b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.551007:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5ce00/0x5953bbf6b307506b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784290392.551016:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb1f0ba8 reply state 0000000048dd6608 transno 81604378764 ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5ce00/0x5953bbf6b307506b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.551053:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5ce00/0x5953bbf6b307506b lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.551061:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c2458ba5200) 00010000:00010000:2.0:1784290392.551065:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290392.551068:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784290392.551073:0:66004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00080000:2.0:1784290392.551081:0:66004:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:2.0:1784290392.551089:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075056 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.551099:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3075056 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.551108:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3075056 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.551135:0:66004:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1784290392.551139:0:66004:0:(osp_object.c:1402:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:2.0:1784290392.551145:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2458d5cc00/0x5953bbf6b307505d lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075064 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.551153:0:66004:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2458d5cc00/0x5953bbf6b307505d lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075064 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290392.551225:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:71753:x1870961896266752:12345-192.168.202.6@tcp:36:mkdir.0 Request processed in 7606us (7728us total) trans 81604378764 rc 0/0 00010000:00010000:3.0:1784290392.551234:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1784290392.551237:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1241 00010000:00010000:3.0:1784290392.551248:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3075056 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.551265:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebfa00 already unused, calling callback (ffffffffc1ac6ed0) 00010000:00010000:3.0:1784290392.551274:0:8418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3075056 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290392.551288:0:8418:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3075056 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.551328:0:8418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3075056 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.551488:0:8418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784290392.551524:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 1/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3075056 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.551534:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebfa00/0x5953bbf6b307504f lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3075056 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290392.551543:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901139072:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784290392.551565:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290392.551568:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290392.551571:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290392.551584:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290392.551634:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901139072 00000100:00100000:1.0:1784290392.551646:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901139072 00000100:00100000:1.0:1784290392.551678:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:1.0:1784290392.551684:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3620:x1870961901139072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290392.551692:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290392.551704:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075056 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b307504f expref: 12 pid: 22091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.551716:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c2458ba5700) 00010000:00010000:1.0:1784290392.551722:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784290392.551753:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3620:x1870961901139072:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290392.551760:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:2.0:1784290392.551775:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901139072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290392.558199:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290392.558296:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896267008 00000100:00100000:3.0:1784290392.558310:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896267008 00000100:00100000:3.0:1784290392.558455:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1242 00000100:00100000:3.0:1784290392.558474:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:71754:x1870961896267008:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1784290392.558494:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290392.558512:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3075072 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2519 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558580:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b3075079 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558594:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b3075079 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558620:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b3075079 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558629:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075080 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558641:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075080 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558646:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075080 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558705:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff600/0x5953bbf6b3075087 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558714:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff600/0x5953bbf6b3075087 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558721:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff600/0x5953bbf6b3075087 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290392.558746:0:74876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784290392.558751:0:74876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784290392.558775:0:74876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff600/0x5953bbf6b3075087 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558783:0:74876:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b3075079 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558788:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b3075079 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558792:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b3075079 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558796:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b3075079 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558807:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fee00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290392.558810:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b3075079 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558815:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b3075079 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558823:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:3.0:1784290392.558825:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290392.558827:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b3075079 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558832:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b3075079 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558841:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075080 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558845:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075080 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558849:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075080 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558852:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2ff000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290392.558854:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075080 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558857:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075080 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558869:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9c244c870a00) 00010000:00010000:3.0:1784290392.558871:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290392.558873:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075080 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558877:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075080 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558896:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3075072 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2519 expref: 9 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558903:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff600/0x5953bbf6b3075087 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2519 expref: 8 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.558908:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c244c870e00) 00010000:00010000:3.0:1784290392.558909:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784290392.558910:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2ff600, rc 0) 00000100:00100000:3.0:1784290392.558947:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:71754:x1870961896267008:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 481us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290392.558952:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1242 00000100:00100000:0.0:1784290392.560518:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290392.560579:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896267136 00000100:00100000:2.0:1784290392.560587:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896267136 00000100:00100000:2.0:1784290392.560637:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1243 00000100:00100000:2.0:1784290392.560647:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:71754:x1870961896267136:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1784290392.560661:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290392.560675:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b307508e lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2520 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.560720:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b3075095 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.560734:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b3075095 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.560744:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b3075095 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.560753:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307509c lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.560761:0:65989:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe000/0x5953bbf6b3075017 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075010 expref: 10 pid: 22091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.560767:0:65989:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307509c lrc: 4/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.560785:0:65989:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe000/0x5953bbf6b3075017 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3075010 expref: 10 pid: 22091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290392.560803:0:65989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:65989:1870961901139200:0@lo:104: 00000100:00100000:2.0:1784290392.560831:0:65989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290392.560858:0:65989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fda7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784290392.560926:0:6472:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784290392.560944:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901139200 00000100:00100000:0.0:1784290392.560949:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901139200 00000100:00100000:0.0:1784290392.560982:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1784290392.560988:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e44f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:65989:x1870961901139200:12345-0@lo:104: 00010000:00010000:0.0:1784290392.561001:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf800/0x5953bbf6b3075010 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3075017 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290392.561071:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784290392.561080:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e44f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:65989:x1870961901139200:12345-0@lo:104: Request processed in 91us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290392.561091:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00010000:00010000:3.0:1784290392.561092:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1784290392.561097:0:65989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:65989:1870961901139200:0@lo:104: 00010000:00010000:3.0:1784290392.561102:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf800/0x5953bbf6b3075010 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3075017 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.561114:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf800 already unused, calling callback (ffffffffc1ac6ed0) 00010000:00010000:3.0:1784290392.561120:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf800/0x5953bbf6b3075010 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3075017 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.561121:0:65989:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307509c lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290392.561172:0:7429:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf800/0x5953bbf6b3075010 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3075017 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.561196:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf800/0x5953bbf6b3075010 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075017 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.561201:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784290392.561225:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf800/0x5953bbf6b3075010 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075017 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.561231:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2345ebf800/0x5953bbf6b3075010 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075017 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.561251:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290392.561252:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290392.561254:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290392.561260:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784290392.561273:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901139328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290392.561299:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290392.561391:0:10356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901139328 00000100:00100000:1.0:1784290392.561398:0:10356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901139328 00010000:00010000:1.0:1784290392.561418:0:10356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe000/0x5953bbf6b3075017 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x5953bbf6b3075010 expref: 11 pid: 22091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290392.561446:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612 00000100:00100000:1.0:1784290392.561453:0:10356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3618:x1870961901139328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290392.561461:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1784290392.562548:0:92145:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116999 is committed 00010000:00010000:1.0:1784290392.562706:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe000/0x5953bbf6b3075017 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3075010 expref: 9 pid: 22091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.562731:0:10356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff9c244c870200) 00010000:00010000:1.0:1784290392.562739:0:10356:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307509c lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.562751:0:10356:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307509c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.562772:0:10356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307509c lrc: 4/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.562799:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290392.562851:0:65989:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307509c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290392.562855:0:10356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3618:x1870961901139328:12345-0@lo:103:ldlm_bl.0 Request processed in 1399us (1551us total) trans 0 rc 0/0 00010000:00010000:2.0:1784290392.562877:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307509c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290392.562877:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612 00000100:00100000:3.0:1784290392.562886:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901139328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290392.562992:0:65989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:65989:1870961901139456:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784290392.563030:0:65989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290392.563061:0:65989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fda73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290392.563086:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901139456 00000100:00100000:3.0:1784290392.563095:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901139456 00000100:00100000:3.0:1784290392.563141:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3873 00000100:00100000:3.0:1784290392.563152:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:65989:x1870961901139456:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784290392.563265:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:65989:x1870961901139456:12345-0@lo:1000:mdt00_001.0 Request processed in 115us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290392.563274:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3873 00000100:00100000:2.0:1784290392.563423:0:65989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:65989:1870961901139456:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1784290392.563480:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c200/0x5953bbf6b30750a3 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.563496:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c200/0x5953bbf6b30750a3 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.563509:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c200/0x5953bbf6b30750a3 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784290392.563550:0:65989:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c200/0x5953bbf6b30750a3 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.563567:0:65989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b3075095 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.563574:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b3075095 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.563580:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b3075095 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.563586:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b3075095 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.563591:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5d200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290392.563594:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b3075095 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.563601:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b3075095 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.563616:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c244c870e00) 00010000:00010000:2.0:1784290392.563619:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290392.563622:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b3075095 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.563629:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b3075095 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.563639:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307509c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.563657:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307509c lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.563683:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307509c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.563694:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5dc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290392.563702:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307509c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.563715:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307509c lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.563733:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff9c244c870200) 00010000:00010000:2.0:1784290392.563739:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290392.563745:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307509c lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.563757:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b307509c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.563800:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b307508e lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2520 expref: 10 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.563816:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c200/0x5953bbf6b30750a3 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2520 expref: 9 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.563826:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c2458ba5a00) 00010000:00010000:2.0:1784290392.563829:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784290392.563841:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2458d5c200, rc 0) 00000100:00100000:2.0:1784290392.563900:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:71754:x1870961896267136:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 3253us (3382us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290392.563911:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1243 00000100:00100000:0.0:1784290392.565206:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290392.565274:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896267264 00000100:00100000:1.0:1784290392.565285:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896267264 00000100:00100000:1.0:1784290392.565392:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1244 00000100:00100000:1.0:1784290392.565410:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:71754:x1870961896267264:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1784290392.565428:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290392.565442:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca200/0x5953bbf6b30750aa lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2527 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.565480:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8cba00/0x5953bbf6b30750b1 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.565491:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8cba00/0x5953bbf6b30750b1 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.565500:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8cba00/0x5953bbf6b30750b1 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290392.565531:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00200000:1.0:1784290392.565535:0:65988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1784290392.565557:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca200/0x5953bbf6b30750aa lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2527 expref: 11 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.565588:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8cba00/0x5953bbf6b30750b1 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2527 expref: 10 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.565595:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c2474f5f000) 00010000:00010000:1.0:1784290392.565607:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784290392.565610:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8cba00, rc 0) 00000100:00100000:1.0:1784290392.565649:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:71754:x1870961896267264:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 248us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290392.565656:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1244 00000100:00100000:0.0:1784290392.568478:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290392.568539:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896267520 00000100:00100000:3.0:1784290392.568561:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896267520 00000100:00100000:3.0:1784290392.568625:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1245 00000100:00100000:3.0:1784290392.568633:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:71754:x1870961896267520:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1784290392.568644:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290392.568668:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fec00/0x5953bbf6b30750b8 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b252e expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290392.568743:0:66008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1784290392.568814:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fec00/0x5953bbf6b30750b8 lrc: 1/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b252e expref: 12 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.568824:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c245a793200) 00010000:00010000:3.0:1784290392.568826:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784290392.568829:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fec00/0x5953bbf6b30750b8 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b252e expref: 12 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.568840:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2fec00, rc 0) 00000100:00100000:3.0:1784290392.568878:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:71754:x1870961896267520:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 248us (405us total) trans 81604378765 rc 301/301 00000100:00100000:3.0:1784290392.568884:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1245 00000100:00100000:0.0:1784290392.570466:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290392.570535:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896267776 00000100:00100000:3.0:1784290392.570546:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896267776 00000100:00100000:3.0:1784290392.570617:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1246 00000100:00100000:3.0:1784290392.570630:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:71754:x1870961896267776:12345-192.168.202.6@tcp:36:lfs.0 00010000:00010000:3.0:1784290392.570674:0:65990:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290392.570692:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8cba00/0x5953bbf6b30750b1 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2527 expref: 11 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.570724:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c2474f5f000) 00010000:00010000:3.0:1784290392.570729:0:65990:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290392.570744:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff000/0x5953bbf6b30750c6 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.570757:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff000/0x5953bbf6b30750c6 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.570766:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff000/0x5953bbf6b30750c6 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290392.570868:0:65990:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007825da9e reply state 000000003650f809 transno 81604378766 ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff000/0x5953bbf6b30750c6 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.570883:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff000/0x5953bbf6b30750c6 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.570892:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c2474f5f000) 00010000:00010000:3.0:1784290392.570895:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1784290392.570898:0:65990:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784290392.570903:0:65990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000100:00100000:3.0:1784290392.570980:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+12:71754:x1870961896267776:12345-192.168.202.6@tcp:36:lfs.0 Request processed in 350us (512us total) trans 81604378766 rc 0/0 00000100:00100000:3.0:1784290392.570993:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1246 00000100:00100000:0.0:1784290392.572410:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290392.572455:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896268032 00000100:00100000:2.0:1784290392.572465:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896268032 00000100:00100000:2.0:1784290392.572513:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 236 00000100:00100000:2.0:1784290392.572523:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c20a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+12:71754:x1870961896268032:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:2.0:1784290392.572689:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c20a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+13:71754:x1870961896268032:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 164us (354us total) trans 81604378767 rc 0/0 00000100:00100000:2.0:1784290392.572702:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 236 00000100:00100000:0.0:1784290392.580627:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290392.580751:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896268160 00000100:00100000:2.0:1784290392.580765:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896268160 00000100:00100000:2.0:1784290392.580824:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1247 00000100:00100000:2.0:1784290392.580836:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:71755:x1870961896268160:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1784290392.580850:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290392.580883:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b30750cd lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2535 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.580959:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30750d4 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.580975:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30750d4 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.580996:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30750d4 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.581008:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30750db lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.581033:0:66004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3075064 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307505d expref: 7 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.581043:0:66004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30750db lrc: 4/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.581070:0:66004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3075064 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b307505d expref: 7 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290392.581084:0:66004:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66004:1870961901139584:0@lo:104: 00000100:00100000:2.0:1784290392.581126:0:66004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290392.581177:0:66004:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fda73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290392.581200:0:7428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901139584 00000100:00100000:1.0:1784290392.581218:0:7428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901139584 00000100:00100000:1.0:1784290392.581289:0:7428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1784290392.581306:0:7428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:66004:x1870961901139584:12345-0@lo:104: 00010000:00010000:1.0:1784290392.581327:0:7428:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2458d5cc00/0x5953bbf6b307505d lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3075064 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.581504:0:7428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784290392.581516:0:7428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:66004:x1870961901139584:12345-0@lo:104: Request processed in 213us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290392.581531:0:7428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1784290392.581532:0:66004:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:66004:1870961901139584:0@lo:104: 00010000:00010000:2.0:1784290392.581573:0:66004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30750db lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.581608:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290392.581622:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2458d5cc00/0x5953bbf6b307505d lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3075064 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.581636:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5cc00 already unused, calling callback (ffffffffc1ac6ed0) 00010000:00010000:3.0:1784290392.581656:0:19681:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2458d5cc00/0x5953bbf6b307505d lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3075064 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290392.581664:0:19681:0:(mdt_handler.c:3962:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2458d5cc00/0x5953bbf6b307505d lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3075064 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.581702:0:19681:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2458d5cc00/0x5953bbf6b307505d lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075064 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.581710:0:19681:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784290392.581746:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2458d5cc00/0x5953bbf6b307505d lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075064 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.581756:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c2458d5cc00/0x5953bbf6b307505d lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075064 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290392.581794:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290392.581800:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290392.581808:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901139712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784290392.581809:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290392.581870:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290392.582013:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901139712 00000100:00100000:0.0:1784290392.582027:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901139712 00010000:00010000:0.0:1784290392.582068:0:19591:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3075064 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x5953bbf6b307505d expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290392.582132:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613 00000100:00100000:0.0:1784290392.582146:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+8:3618:x1870961901139712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290392.582160:0:19591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290392.582752:0:19591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3075064 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b307505d expref: 8 pid: 8413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.582775:0:19591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff9c244c870800) 00010000:00010000:1.0:1784290392.582781:0:19591:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30750db lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.582811:0:19591:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30750db lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.582819:0:19591:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30750db lrc: 4/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.582854:0:19591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784290392.582922:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+7:3618:x1870961901139712:12345-0@lo:103:ldlm_bl.0 Request processed in 775us (1051us total) trans 0 rc 0/0 00010000:00010000:2.0:1784290392.582926:0:66004:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30750db lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290392.582941:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613 00010000:00010000:2.0:1784290392.582955:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30750db lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290392.583027:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901139712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290392.583058:0:66004:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468aba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:66004:1870961901139840:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1784290392.583110:0:66004:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290392.583151:0:66004:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246d46a000 going to sleep for 11 seconds 00000100:00100000:3.0:1784290392.583172:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901139840 00000100:00100000:3.0:1784290392.583185:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901139840 00000100:00100000:3.0:1784290392.583259:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3874 00000100:00100000:3.0:1784290392.583289:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66004:x1870961901139840:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784290392.583533:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:66004:x1870961901139840:12345-0@lo:1000:mdt00_003.0 Request processed in 261us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290392.583549:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3874 00000100:00100000:2.0:1784290392.583621:0:66004:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468aba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:66004:1870961901139840:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1784290392.583683:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b30750e2 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.583704:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b30750e2 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.583722:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b30750e2 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784290392.583749:0:66004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b30750e2 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.583769:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30750d4 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.583777:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30750d4 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.583785:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30750d4 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.583793:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30750d4 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.583800:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5dc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290392.583804:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30750d4 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.583812:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30750d4 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.583824:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c244c870e00) 00010000:00010000:2.0:1784290392.583838:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290392.583844:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30750d4 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.583852:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30750d4 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.583867:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30750db lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.583875:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30750db lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.583882:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30750db lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.583889:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5d200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290392.583892:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30750db lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.583899:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30750db lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.583908:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff9c244c870800) 00010000:00010000:2.0:1784290392.583911:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290392.583915:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30750db lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.583922:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b30750db lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.583968:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b30750cd lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2535 expref: 11 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.584002:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b30750e2 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2535 expref: 10 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.584011:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c2458ba5b00) 00010000:00010000:2.0:1784290392.584014:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784290392.584017:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2458d5da00, rc 0) 00000100:00100000:2.0:1784290392.584076:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:71755:x1870961896268160:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 3241us (3453us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290392.584086:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1247 00000100:00100000:0.0:1784290392.585440:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290392.585517:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896268288 00000100:00100000:2.0:1784290392.585529:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896268288 00000100:00100000:2.0:1784290392.585601:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1248 00000100:00100000:2.0:1784290392.585613:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+13:71755:x1870961896268288:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1784290392.585632:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290392.585648:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5de00/0x5953bbf6b30750e9 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b253c expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.585713:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5d600/0x5953bbf6b30750f0 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.585734:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5d600/0x5953bbf6b30750f0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.585752:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5d600/0x5953bbf6b30750f0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784290392.585799:0:74876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1784290392.585815:0:74876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1784290392.585855:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5de00/0x5953bbf6b30750e9 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b253c expref: 15 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.585874:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5d600/0x5953bbf6b30750f0 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b253c expref: 14 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.585884:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c2458ba5200) 00010000:00010000:2.0:1784290392.585888:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784290392.585891:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2458d5d600, rc 0) 00000100:00100000:2.0:1784290392.585945:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+14:71755:x1870961896268288:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 334us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290392.585955:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1248 00000100:00100000:0.0:1784290392.588851:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290392.588918:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896268544 00000100:00100000:2.0:1784290392.588928:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896268544 00000100:00100000:2.0:1784290392.588989:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1249 00000100:00100000:2.0:1784290392.589001:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+14:71755:x1870961896268544:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:2.0:1784290392.589016:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290392.589038:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5cc00/0x5953bbf6b30750f7 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2543 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784290392.589112:0:65989:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1784290392.589193:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5cc00/0x5953bbf6b30750f7 lrc: 1/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2543 expref: 16 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.589209:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c2458ba5300) 00010000:00010000:2.0:1784290392.589212:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784290392.589218:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5cc00/0x5953bbf6b30750f7 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2543 expref: 16 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290392.589260:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2458d5cc00, rc 0) 00000100:00100000:2.0:1784290392.589318:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+15:71755:x1870961896268544:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 318us (478us total) trans 81604378768 rc 301/301 00000100:00100000:2.0:1784290392.589398:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1249 00000100:00100000:0.0:1784290392.590721:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290392.590803:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896268800 00000100:00100000:1.0:1784290392.590817:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896268800 00000100:00100000:1.0:1784290392.590895:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1250 00000100:00100000:1.0:1784290392.590916:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+15:71755:x1870961896268800:12345-192.168.202.6@tcp:36:lfs.0 00010000:00010000:1.0:1784290392.590972:0:65988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290392.591001:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5d600/0x5953bbf6b30750f0 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b253c expref: 15 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.591031:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c2458ba5200) 00010000:00010000:1.0:1784290392.591048:0:65988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290392.591074:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075105 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.591094:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075105 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.591111:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075105 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784290392.591312:0:65988:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007679fee8 reply state 000000008b27f23e transno 81604378769 ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075105 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.591442:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075105 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290392.591461:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c2458ba5200) 00010000:00010000:1.0:1784290392.591468:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1784290392.591474:0:65988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784290392.591485:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000100:00100000:1.0:1784290392.591643:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+16:71755:x1870961896268800:12345-192.168.202.6@tcp:36:lfs.0 Request processed in 728us (917us total) trans 81604378769 rc 0/0 00000100:00100000:1.0:1784290392.591661:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1250 00000100:00100000:0.0:1784290392.593046:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290392.593158:0:68995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896269056 00000100:00100000:3.0:1784290392.593184:0:68995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896269056 00000100:00100000:3.0:1784290392.593253:0:68995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 237 00000100:00100000:3.0:1784290392.593263:0:68995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+16:71755:x1870961896269056:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1784290392.593610:0:68995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+17:71755:x1870961896269056:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 347us (570us total) trans 81604378770 rc 0/0 00000100:00100000:3.0:1784290392.593621:0:68995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 237 00010000:00010000:0.0:1784290392.743573:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784290393.001121:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968631 is committed 00000001:00080000:3.0:1784290393.001988:0:75386:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378770 is committed 00000020:00080000:3.0:1784290393.002031:0:75386:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411373 batchid updated 00010000:00010000:1.0:1784290393.002076:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf000/0x5953bbf6b307501e lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.002096:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf000/0x5953bbf6b307501e lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.002135:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf000/0x5953bbf6b307501e lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.002143:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290393.002148:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf000/0x5953bbf6b307501e lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.002157:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf000/0x5953bbf6b307501e lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.002180:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c2474f5f000) 00000020:00080000:0.0:1784290393.002187:0:75406:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411373 00010000:00010000:1.0:1784290393.002199:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290393.002207:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf000/0x5953bbf6b307501e lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.002214:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf000/0x5953bbf6b307501e lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.002253:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5ce00/0x5953bbf6b307506b lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.002262:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5ce00/0x5953bbf6b307506b lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.002270:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5ce00/0x5953bbf6b307506b lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784290393.002275:0:75406:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c244a1c8480 with version 12 00010000:00010000:1.0:1784290393.002278:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5ce00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290393.002286:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5ce00/0x5953bbf6b307506b lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.002294:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5ce00/0x5953bbf6b307506b lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1784290393.002299:0:75406:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411373 cancel update log [0x20000c751:0x1:0x0].2: rc = 0 00010000:00010000:1.0:1784290393.002305:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c2458ba5200) 00010000:00010000:1.0:1784290393.002311:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290393.002315:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5ce00/0x5953bbf6b307506b lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.002322:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5ce00/0x5953bbf6b307506b lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.002417:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff000/0x5953bbf6b30750c6 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.002440:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff000/0x5953bbf6b30750c6 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.002451:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff000/0x5953bbf6b30750c6 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.002463:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2ff000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290393.002472:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff000/0x5953bbf6b30750c6 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1784290393.002475:0:75406:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411373 cancel update log [0x2400090a4:0x1:0x0].2: rc = 0 00010000:00010000:1.0:1784290393.002489:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff000/0x5953bbf6b30750c6 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1784290393.002498:0:75406:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411373 00010000:00010000:1.0:1784290393.002507:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c2474f5f000) 00010000:00010000:1.0:1784290393.002513:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000004:00080000:0.0:1784290393.002518:0:75392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9c2344dd4900 version 12 rpc_version 12 00010000:00010000:1.0:1784290393.002519:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff000/0x5953bbf6b30750c6 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.002532:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff000/0x5953bbf6b30750c6 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1784290393.002574:0:75392:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1784290393.002576:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075105 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.002590:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075105 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290393.002594:0:75392:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c2474cbe680 x1870961901140096/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1784290393.002607:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075105 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.002621:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8ca200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290393.002633:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075105 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.002642:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075105 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290393.002646:0:75392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbe680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75392:1870961901140096:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1784290393.002658:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c2458ba5200) 00010000:00010000:1.0:1784290393.002663:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784290393.002667:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075105 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.002674:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075105 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290393.002760:0:75392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290393.002826:0:75392:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345d95f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784290393.002904:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901140096 00000100:00100000:1.0:1784290393.002920:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901140096 00000100:00100000:1.0:1784290393.003008:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3875 00000100:00100000:1.0:1784290393.003030:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75392:x1870961901140096:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1784290393.003444:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75392:x1870961901140096:12345-0@lo:1000:osp_up0-1.0 Request processed in 417us (682us total) trans 115964117000 rc 0/0 00000100:00100000:1.0:1784290393.003464:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3875 00000100:00100000:3.0:1784290393.003506:0:75392:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116999 gen 3 00000004:00080000:3.0:1784290393.003517:0:75392:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116998 committed transno 115964116999 00000020:00080000:3.0:1784290393.003524:0:75392:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9c244a1c8540 refcount 2 committed 0 result 0 batchid 77309411374 00000020:00080000:3.0:1784290393.003530:0:75392:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9c2447b9f900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9c244a1c80c0 00000020:00080000:3.0:1784290393.003534:0:75392:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x20000c751:0x1:0x0].3 00000020:00080000:3.0:1784290393.003538:0:75392:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9c2447b9f600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c24803b5200 00000020:00080000:3.0:1784290393.003544:0:75392:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400090a4:0x1:0x0].3 00000004:00080000:3.0:1784290393.003623:0:75392:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964116999 committed transno 115964116999 00000020:00080000:3.0:1784290393.003630:0:75392:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff9c2345bd96c0 refcount 2 committed 0 result 0 batchid 77309411375 00000020:00080000:3.0:1784290393.003636:0:75392:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9c2345f15d00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff9c2345bd9480 00000020:00080000:0.0:1784290393.003638:0:75406:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411374 committed batchid 77309411373 00000020:00080000:3.0:1784290393.003644:0:75392:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x20000c751:0x1:0x0].4 00000020:00080000:3.0:1784290393.003650:0:75392:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9c2345f15900 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c2475803400 00000020:00080000:3.0:1784290393.003655:0:75392:0:(update_trans.c:71:top_multiple_thandle_dump()) cookie [0x2400090a4:0x1:0x0].4 00000100:00100000:3.0:1784290393.003691:0:75392:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9c2474cbe680 x1870961901140096/t115964117000(115964117000) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1784290409 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000020:00080000:0.0:1784290393.003696:0:75406:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411375 committed batchid 77309411373 00000020:00080000:0.0:1784290393.003728:0:75406:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411373 00000100:00100000:3.0:1784290393.003761:0:75392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbe680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75392:1870961901140096:0@lo:1000:osp_up0-1.0 00000020:00080000:3.0:1784290393.008401:0:75386:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411375 batchid updated 00000020:00080000:3.0:1784290393.008426:0:75386:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411374 batchid updated 00000001:00080000:1.0:1784290393.008504:0:92145:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117000 is committed 00000020:00080000:0.0:1784290393.008506:0:75406:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411375 00000004:00080000:0.0:1784290393.008579:0:75406:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c24582e9780 with version 13 00000020:00080000:0.0:1784290393.008605:0:75406:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411374 cancel update log [0x20000c751:0x1:0x0].3: rc = 0 00000004:00080000:3.0:1784290393.008639:0:75392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9c2344dd4900 version 13 rpc_version 13 00000020:00080000:0.0:1784290393.008665:0:75406:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411374 cancel update log [0x2400090a4:0x1:0x0].3: rc = 0 00000020:00100000:3.0:1784290393.008686:0:75392:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784290393.008708:0:75392:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c24483cd880 x1870961901140352/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000004:00080000:0.0:1784290393.008710:0:75406:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c246dac66c0 with version 14 00000020:00080000:0.0:1784290393.008722:0:75406:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411375 cancel update log [0x20000c751:0x1:0x0].4: rc = 0 00000020:00080000:0.0:1784290393.008765:0:75406:0:(update_trans.c:1311:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411375 cancel update log [0x2400090a4:0x1:0x0].4: rc = 0 00000100:00100000:3.0:1784290393.008779:0:75392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cd880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75392:1870961901140352:0@lo:1000:osp_up0-1.0 00000020:00080000:0.0:1784290393.008783:0:75406:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411375 00000100:00100000:3.0:1784290393.008893:0:75392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290393.008959:0:75392:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343398780 going to sleep for 11 seconds 00000100:00100000:0.0:1784290393.008965:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901140352 00000100:00100000:0.0:1784290393.008988:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901140352 00000100:00100000:0.0:1784290393.009067:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3876 00000100:00100000:0.0:1784290393.009094:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:75392:x1870961901140352:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1784290393.009376:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75392:x1870961901140352:12345-0@lo:1000:osp_up0-1.0 Request processed in 243us (434us total) trans 115964117001 rc 0/0 00000100:00100000:0.0:1784290393.009390:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3876 00000100:00100000:3.0:1784290393.009458:0:75392:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964117000 gen 3 00000004:00080000:3.0:1784290393.009472:0:75392:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964117000 committed transno 115964117000 00000100:00100000:3.0:1784290393.009531:0:75392:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9c24483cd880 x1870961901140352/t115964117001(115964117001) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1784290409 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290393.009578:0:75392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cd880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75392:1870961901140352:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1784290393.009636:0:75392:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff9c2344dd4900 version 14 rpc_version 14 00000020:00100000:3.0:1784290393.009674:0:75392:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1784290393.009692:0:75392:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c24483ce300 x1870961901140608/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784290393.009730:0:75392:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75392:1870961901140608:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1784290393.011683:0:75392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290393.011738:0:75392:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343398780 going to sleep for 11 seconds 00000100:00100000:2.0:1784290393.011805:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901140608 00000100:00100000:2.0:1784290393.011818:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901140608 00000100:00100000:2.0:1784290393.011882:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3877 00000100:00100000:2.0:1784290393.011898:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:75392:x1870961901140608:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1784290393.012078:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:75392:x1870961901140608:12345-0@lo:1000:osp_up0-1.0 Request processed in 184us (397us total) trans 115964117002 rc 0/0 00000100:00100000:2.0:1784290393.012090:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3877 00000100:00100000:3.0:1784290393.012161:0:75392:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce300 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:75392:1870961901140608:0@lo:1000:osp_up0-1.0 00000001:00080000:1.0:1784290393.014626:0:92145:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117002 is committed 00000100:00100000:2.0:1784290393.038628:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290393.038719:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896269184 00000100:00100000:1.0:1784290393.038736:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896269184 00000100:00100000:1.0:1784290393.038820:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1251 00000100:00100000:1.0:1784290393.038834:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:71764:x1870961896269184:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:1.0:1784290393.038875:0:66008:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444536320 avail 1298296832 00000100:00100000:1.0:1784290393.038964:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:71764:x1870961896269184:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 131us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290393.038996:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1251 00000100:00100000:2.0:1784290393.040558:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290393.040675:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896269312 00000100:00100000:1.0:1784290393.040684:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896269312 00000100:00100000:1.0:1784290393.040780:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1252 00000100:00100000:1.0:1784290393.040803:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:71764:x1870961896269312:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:1.0:1784290393.040839:0:65990:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445097472 avail 1298857984 00000100:00100000:1.0:1784290393.040909:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:71764:x1870961896269312:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 116us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290393.040920:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1252 00000100:00100000:2.0:1784290393.043142:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290393.043231:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896269440 00000100:00100000:3.0:1784290393.043245:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896269440 00000100:00100000:3.0:1784290393.043405:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1216 00000100:00100000:3.0:1784290393.043423:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:71764:x1870961896269440:12345-192.168.202.6@tcp:13:lfs.0 00000100:00080000:1.0:1784290393.043457:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1784290393.043480:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290393.043604:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:71764:x1870961896269440:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 184us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290393.043623:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1216 00000100:00100000:3.0:1784290393.045211:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290393.045321:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896269568 00000100:00100000:2.0:1784290393.045388:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896269568 00000100:00100000:2.0:1784290393.045440:0:26262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4962 00000100:00100000:2.0:1784290393.045450:0:26262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:2396:x1870961896269568:12345-192.168.202.6@tcp:8:lfs.0 00010000:00080000:2.0:1784290393.045502:0:26262:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp t0 exp 0000000000000000 cur 2134 last 0 00000020:00000080:2.0:1784290393.045544:0:26262:0:(genops.c:1406:class_connect()) connect: client 711f3c77-e791-4aa8-86ee-bc854fd0bcc5, cookie 0x5953bbf6b307510c 00002000:00100000:2.0:1784290393.045559:0:26262:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 711f3c77-e791-4aa8-86ee-bc854fd0bcc5/ffff9c246d8aa000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ad ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784290393.045591:0:26262:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784290393.045706:0:26262:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784290393.045755:0:26262:0:(import.c:65:import_set_state_nolock()) ffff9c2458115800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784290393.045830:0:26262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2396:x1870961896269568:12345-192.168.202.6@tcp:8:lfs.0 Request processed in 379us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290393.045841:0:26262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4962 00000100:00100000:0.0:1784290393.047531:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290393.047597:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896269696 00000100:00100000:2.0:1784290393.047606:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896269696 00000100:00080000:1.0:1784290393.047676:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784290393.047686:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1217 00000100:00100000:2.0:1784290393.047702:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:71764:x1870961896269696:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:2.0:1784290393.047723:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784290393.047786:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:71764:x1870961896269696:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 89us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290393.047795:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1217 00000100:00100000:3.0:1784290393.080446:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290393.080504:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896269952 00000100:00100000:2.0:1784290393.080514:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896269952 00000100:00100000:2.0:1784290393.080569:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1253 00000100:00100000:2.0:1784290393.080580:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:71771:x1870961896269952:12345-192.168.202.6@tcp:36:mcreate.0 00010000:00010000:2.0:1784290393.080630:0:66004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290393.080656:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe400/0x5953bbf6b307502c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b250b expref: 10 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290393.080674:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:2.0:1784290393.080679:0:66004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290393.080733:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075113 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290393.080746:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075113 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290393.080765:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075113 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290393.080780:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b307511a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290393.080786:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b307511a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290393.080792:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b307511a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290393.081167:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075113 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290393.081175:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075113 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290393.081180:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075113 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290393.081186:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075113 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290393.081191:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5c800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290393.081195:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075113 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290393.081201:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075113 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290393.081210:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:2.0:1784290393.081219:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290393.081223:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075113 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290393.081229:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c800/0x5953bbf6b3075113 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784290393.081239:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007f1e09c8 reply state 00000000cd7c5831 transno 115964117003 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b307511a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290393.081249:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b307511a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290393.081255:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2442ffeb00) 00010000:00010000:2.0:1784290393.081256:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290393.081258:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784290393.081384:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:71771:x1870961896269952:12345-192.168.202.6@tcp:36:mcreate.0 Request processed in 806us (948us total) trans 115964117003 rc 0/0 00000100:00100000:2.0:1784290393.081392:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1253 00000100:00100000:0.0:1784290393.093216:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290393.093312:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896270080 00000100:00100000:0.0:1784290393.093320:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896270080 00000100:00100000:0.0:1784290393.093415:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1254 00000100:00100000:0.0:1784290393.093432:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:71774:x1870961896270080:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:0.0:1784290393.093460:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290393.093480:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3075121 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b254a expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.093535:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b3075128 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.093546:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b3075128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.093555:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b3075128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290393.093588:0:74876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784290393.093591:0:74876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784290393.093608:0:74876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b3075128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.093639:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3075121 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b254a expref: 13 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.093652:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b3075128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b254a expref: 12 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.093660:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:0.0:1784290393.093664:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784290393.093670:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebf400, rc 0) 00000100:00100000:0.0:1784290393.093718:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+12:71774:x1870961896270080:12345-192.168.202.6@tcp:101:rm.0 Request processed in 296us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290393.093726:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1254 00000100:00100000:0.0:1784290393.095551:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290393.095625:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896270208 00000100:00100000:1.0:1784290393.095635:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896270208 00000100:00100000:1.0:1784290393.095729:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1255 00000100:00100000:1.0:1784290393.095755:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+12:71774:x1870961896270208:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:1.0:1784290393.095769:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290393.095784:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b307512f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2551 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.095832:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca000/0x5953bbf6b3075136 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.095842:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca000/0x5953bbf6b3075136 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.095855:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca000/0x5953bbf6b3075136 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.095883:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b307513d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.095892:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b307513d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.095901:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b307513d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.095988:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb400/0x5953bbf6b3075144 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.095996:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb400/0x5953bbf6b3075144 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.096007:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb400/0x5953bbf6b3075144 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290393.096034:0:65989:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x3:0x0]: returning size 0 00000004:00200000:1.0:1784290393.096038:0:65989:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784290393.096049:0:65989:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb400/0x5953bbf6b3075144 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.096059:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb400/0x5953bbf6b3075144 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.096066:0:65989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca000/0x5953bbf6b3075136 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.096074:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca000/0x5953bbf6b3075136 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.096089:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca000/0x5953bbf6b3075136 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.096096:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca000/0x5953bbf6b3075136 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.096101:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8ca000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290393.096107:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca000/0x5953bbf6b3075136 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.096114:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca000/0x5953bbf6b3075136 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.096129:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:1.0:1784290393.096132:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290393.096135:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca000/0x5953bbf6b3075136 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.096140:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca000/0x5953bbf6b3075136 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.096151:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b307513d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.096156:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b307513d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.096161:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b307513d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.096165:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cbc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290393.096174:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b307513d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.096180:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b307513d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.096193:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2442ffeb00) 00010000:00010000:1.0:1784290393.096196:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290393.096200:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b307513d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.096205:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b307513d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.096242:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b307512f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2551 expref: 14 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.096270:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb400/0x5953bbf6b3075144 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2551 expref: 13 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.096280:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff9c2461f23300) 00010000:00010000:1.0:1784290393.096283:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784290393.096287:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8cb400, rc 0) 00000100:00100000:1.0:1784290393.096426:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+13:71774:x1870961896270208:12345-192.168.202.6@tcp:101:rm.0 Request processed in 684us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290393.096434:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1255 00000100:00100000:0.0:1784290393.098320:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290393.098423:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896270464 00000100:00100000:0.0:1784290393.098430:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896270464 00000100:00100000:0.0:1784290393.098503:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1256 00000100:00100000:0.0:1784290393.098523:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+13:71774:x1870961896270464:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:0.0:1784290393.098556:0:65988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784290393.098576:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb400/0x5953bbf6b3075144 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2551 expref: 13 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.098604:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff9c2461f23300) 00010000:00010000:0.0:1784290393.098638:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b3075128 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b254a expref: 12 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.098673:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:0.0:1784290393.098678:0:65988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290393.098691:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b307514b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.098698:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b307514b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.098706:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b307514b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.098720:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3075152 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.098728:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3075152 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.098736:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3075152 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.098788:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b3075159 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.098794:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b3075159 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.098799:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b3075159 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.098998:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3075160 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.099027:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3075160 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.099039:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3075160 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.099052:0:65988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3075160 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.099063:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3075160 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.099069:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3075160 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.099097:0:65988:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784290393.099109:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b3075159 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.099117:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b3075159 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.099121:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290393.099123:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b3075159 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.099131:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290393.099133:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3075160 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.099136:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b3075159 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.099151:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b3075159 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.099170:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebfa00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290393.099177:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3075160 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.099198:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3075160 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.099198:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff9c2475800a00) 00010000:00010000:0.0:1784290393.099206:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784290393.099212:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b3075159 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.099219:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf800/0x5953bbf6b3075159 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.099225:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff9c2475800a00) 00010000:00010000:1.0:1784290393.099229:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784290393.099233:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3075160 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.099236:0:65988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b307514b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.099240:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b3075160 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.099251:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b307514b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.099258:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b307514b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.099264:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b307514b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.099270:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebec00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290393.099276:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b307514b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.099288:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290393.099289:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b307514b lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290393.099300:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290393.099310:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:1.0:1784290393.099312:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290393.099316:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290393.099323:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b307514b lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.099393:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b307514b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290393.099407:0:65988:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f61aaa29 reply state 00000000f23916b6 transno 115964117004 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3075152 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.099415:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3075152 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290393.099422:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2442ffeb00) 00010000:00010000:0.0:1784290393.099425:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290393.099428:0:65988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784290393.099488:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+13:71774:x1870961896270464:12345-192.168.202.6@tcp:36:rm.0 Request processed in 975us (1175us total) trans 115964117004 rc 0/0 00000100:00100000:0.0:1784290393.099494:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1256 00010000:00010000:3.0:1784290393.768542:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290394.279634:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901140736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784290394.279736:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290394.279822:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901140736 00000100:00100000:2.0:1784290394.279835:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901140736 00000100:00080000:1.0:1784290394.279906:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784290394.279934:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:2.0:1784290394.279951:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901140736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784290394.279981:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784290394.280088:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468891c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901140736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290394.280102:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00100000:0.0:1784290394.280132:0:3619:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968630 gen 2 00000100:00100000:0.0:1784290394.280169:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901140736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784290394.280616:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901140864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784290394.280639:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901140992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290394.280697:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290394.280735:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290394.280778:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1870961901141376:0@lo:400:kworker.0 00000100:00100000:1.0:1784290394.280813:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901141504:0@lo:400:kworker.0 00000100:00100000:3.0:1784290394.280817:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901140992 00000100:00100000:3.0:1784290394.280836:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901140992 00000100:00100000:2.0:1784290394.280850:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290394.280902:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901141120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784290394.280959:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901141888:0@lo:400:kworker.0 00000100:00100000:0.0:1784290394.280972:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901140864 00000100:00100000:0.0:1784290394.280987:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901140864 00000100:00100000:1.0:1784290394.280990:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290394.281042:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901141376 00000100:00100000:2.0:1784290394.281052:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901141376 00000100:00100000:1.0:1784290394.281075:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1870961901141632:0@lo:400:kworker.0 00000100:00100000:0.0:1784290394.281091:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:0.0:1784290394.281111:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901140864:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784290394.281129:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3878 00002000:00000024:0.0:1784290394.281135:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784290394.281147:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:1.0:1784290394.281147:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290394.281168:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3617:x1870961901140992:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290394.281181:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1870961901141376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290394.281208:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901142144:0@lo:400:kworker.0 00010000:00000080:2.0:1784290394.281223:0:66008:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2468abaa00 x1870961901141376/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:415/0 lens 224/224 e 0 to 0 dl 1784290405 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290394.281233:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901140864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (532us total) trans 0 rc 0/0 00000004:00000024:3.0:1784290394.281253:0:23867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444536320 avail 1298296832 00000100:00100000:0.0:1784290394.281266:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:1.0:1784290394.281297:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290394.281406:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901141120 00000100:00100000:0.0:1784290394.281415:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901141120 00000100:00100000:1.0:1784290394.281455:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1870961901142656:0@lo:400:kworker.0 00000100:00100000:2.0:1784290394.281458:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1870961901141376:12345-0@lo:400:kworker.0 Request processed in 282us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290394.281488:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:0.0:1784290394.281498:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3879 00000100:00100000:2.0:1784290394.281537:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901141632 00000100:00100000:0.0:1784290394.281541:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901141120:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784290394.281555:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290394.281556:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901141632 00000004:00000024:0.0:1784290394.281595:0:22091:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445097472 avail 1298857984 00000100:00100000:2.0:1784290394.281617:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901142656 00000100:00100000:1.0:1784290394.281625:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784290394.281626:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901142656 00010000:00000080:3.0:1784290394.281644:0:23867:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2469c8a680 x1870961901140992/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:415/0 lens 224/368 e 0 to 0 dl 1784290405 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290394.281647:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901142016:0@lo:400:kworker.0 00000100:00100000:2.0:1784290394.281688:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:0.0:1784290394.281689:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901141120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 150us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290394.281709:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3879 00000100:00100000:2.0:1784290394.281718:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1870961901141632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290394.281729:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000080:2.0:1784290394.281756:0:66008:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2469c88380 x1870961901141632/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:415/0 lens 224/224 e 0 to 0 dl 1784290405 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290394.281788:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a4f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901142528:0@lo:400:kworker.0 00000100:00100000:0.0:1784290394.281797:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:0.0:1784290394.281817:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1870961901142656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290394.281839:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3617:x1870961901140992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 681us (1104us total) trans 0 rc 0/0 00010000:00000080:0.0:1784290394.281851:0:74876:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2469c88a80 x1870961901142656/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:415/0 lens 224/224 e 0 to 0 dl 1784290405 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290394.281876:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3878 00000100:00100000:2.0:1784290394.281878:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1870961901141632:12345-0@lo:400:kworker.0 Request processed in 151us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290394.281882:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290394.281919:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:2.0:1784290394.281984:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901142144 00000100:00100000:0.0:1784290394.281987:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1870961901142656:12345-0@lo:400:kworker.0 Request processed in 171us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290394.281988:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901141120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784290394.281992:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901142144 00000100:00100000:0.0:1784290394.282018:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:1.0:1784290394.282045:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1870961901141632:0@lo:400:kworker.0 00000100:00100000:2.0:1784290394.282074:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901142016 00000100:00100000:2.0:1784290394.282090:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901142016 00000100:00100000:1.0:1784290394.282096:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1870961901142656:0@lo:400:kworker.0 00000100:00100000:0.0:1784290394.282097:0:26251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901142528 00000100:00100000:0.0:1784290394.282110:0:26251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901142528 00000100:00100000:0.0:1784290394.282179:0:26251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1599 00000100:00100000:0.0:1784290394.282193:0:26251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901142144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290394.282199:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1600 00000100:00100000:2.0:1784290394.282227:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901142528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290394.282285:0:26251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901142144:12345-0@lo:400:kworker.0 Request processed in 92us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290394.282298:0:26251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1599 00000100:00100000:1.0:1784290394.282400:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1601 00000100:00100000:1.0:1784290394.282423:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901142016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290394.282440:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901142528:12345-0@lo:400:kworker.0 Request processed in 223us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290394.282454:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1600 00000100:00100000:1.0:1784290394.282508:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901142016:12345-0@lo:400:kworker.0 Request processed in 90us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290394.282521:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1601 00000100:00100000:2.0:1784290394.282561:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784290394.282606:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784290394.282616:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784290394.282622:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290394.282648:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901141248:0@lo:400:kworker.0 00000100:00100000:2.0:1784290394.282687:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901140992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784290394.282732:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290394.282761:0:3618:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968631 gen 2 00000100:00100000:2.0:1784290394.282772:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1784290394.282773:0:3618:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c2468ad5880, transno 4294968631 00000100:00100000:1.0:1784290394.282806:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901142016:0@lo:400:kworker.0 00000100:00100000:1.0:1784290394.282837:0:3618:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968631 gen 2 00000100:00100000:0.0:1784290394.282840:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901141760:0@lo:400:kworker.0 00000100:00100000:2.0:1784290394.282867:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901142400:0@lo:400:kworker.0 00000100:00100000:1.0:1784290394.282872:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a4f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901142528:0@lo:400:kworker.0 00000100:00100000:0.0:1784290394.282900:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290394.282911:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a542d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901142144:0@lo:400:kworker.0 00000100:00100000:0.0:1784290394.282952:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961901142272:0@lo:400:kworker.0 00000100:00100000:2.0:1784290394.282969:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290394.282987:0:92154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901141248 00000100:00100000:1.0:1784290394.283007:0:92154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901141248 00000100:00100000:0.0:1784290394.283028:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290394.283083:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901140864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784290394.283089:0:92154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1784290394.283112:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901141504 00000100:00100000:1.0:1784290394.283115:0:92154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3619:x1870961901141248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290394.283124:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901141504 00000100:00100000:2.0:1784290394.283136:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1870961901141376:0@lo:400:kworker.0 00000100:00100000:0.0:1784290394.283206:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901141760 00000100:00100000:1.0:1784290394.283207:0:92154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3619:x1870961901141248:12345-0@lo:400:kworker.0 Request processed in 98us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290394.283217:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901141760 00000100:00100000:1.0:1784290394.283224:0:92154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1784290394.283265:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901142272 00000100:00100000:0.0:1784290394.283272:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901142272 00000100:00100000:0.0:1784290394.283401:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00080000:1.0:1784290394.283417:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784290394.283419:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901141504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290394.283452:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:1.0:1784290394.283470:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901141760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290394.283497:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901141888 00000100:00100000:2.0:1784290394.283509:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901141888 00000100:00100000:0.0:1784290394.283545:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901141504:12345-0@lo:400:kworker.0 Request processed in 124us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290394.283566:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00100000:1.0:1784290394.283567:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901141760:12345-0@lo:400:kworker.0 Request processed in 92us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290394.283584:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:2.0:1784290394.283591:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901142400 00000100:00100000:2.0:1784290394.283602:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901142400 00000100:00100000:0.0:1784290394.283614:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:0.0:1784290394.283633:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1870961901142272:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1784290394.283657:0:65990:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c246a4f8000 x1870961901142272/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:415/0 lens 224/224 e 0 to 0 dl 1784290405 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290394.283667:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901141248:0@lo:400:kworker.0 00000100:00100000:2.0:1784290394.283677:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3880 00000100:00100000:2.0:1784290394.283706:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3620:x1870961901141888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290394.283708:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901141760:0@lo:400:kworker.0 00000100:00100000:0.0:1784290394.283740:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1870961901142272:12345-0@lo:400:kworker.0 Request processed in 109us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290394.283753:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961901142272:0@lo:400:kworker.0 00000100:00100000:0.0:1784290394.283758:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00010000:00000080:2.0:1784290394.283760:0:23867:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2468ab9f80 x1870961901141888/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:415/0 lens 224/224 e 0 to 0 dl 1784290405 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290394.283881:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901141504:0@lo:400:kworker.0 00000100:00100000:1.0:1784290394.283894:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3881 00000100:00100000:2.0:1784290394.283899:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3620:x1870961901141888:12345-0@lo:400:kworker.0 Request processed in 194us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290394.283915:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901142400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290394.283927:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3880 00000100:00100000:1.0:1784290394.283986:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901142400:12345-0@lo:400:kworker.0 Request processed in 78us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290394.283998:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3881 00000100:00100000:0.0:1784290394.284048:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901141888:0@lo:400:kworker.0 00000100:00100000:0.0:1784290394.284065:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901142400:0@lo:400:kworker.0 00010000:00010000:1.0:1784290394.791578:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290395.653855:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290395.653923:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290395.653976:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290395.653989:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896270720 00000100:00100000:2.0:1784290395.654003:0:92152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896270592 00000100:00100000:1.0:1784290395.654011:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896270720 00000100:00100000:2.0:1784290395.654017:0:92152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896270592 00000100:00100000:0.0:1784290395.654031:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290395.654080:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290395.654134:0:92152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 169 00000100:00100000:1.0:1784290395.654142:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896270848 00000100:00100000:0.0:1784290395.654144:0:26263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896270976 00000100:00100000:1.0:1784290395.654151:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896270848 00000100:00100000:0.0:1784290395.654155:0:26263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896270976 00000100:00100000:2.0:1784290395.654183:0:92152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2399:x1870961896270592:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290395.654251:0:26263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896271104 00000100:00100000:1.0:1784290395.654252:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 736 00000100:00100000:0.0:1784290395.654266:0:26263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896271104 00000100:00100000:1.0:1784290395.654276:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+13:2400:x1870961896270720:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290395.654296:0:92152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2399:x1870961896270592:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 123us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290395.654404:0:92152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 169 00010000:00000080:1.0:1784290395.654419:0:74876:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c246a4fbb80 x1870961896270720/t0(0) o400->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:416/0 lens 224/224 e 0 to 0 dl 1784290406 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290395.654441:0:26263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1602 00000100:00100000:0.0:1784290395.654460:0:26263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2400:x1870961896270976:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290395.654483:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+13:2400:x1870961896270720:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 209us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290395.654494:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1603 00000100:00100000:1.0:1784290395.654505:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 736 00000100:00100000:0.0:1784290395.654538:0:26263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2400:x1870961896270976:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 73us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290395.654539:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2399:x1870961896271104:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290395.654551:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 737 00000100:00100000:0.0:1784290395.654572:0:26263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1602 00000100:00100000:1.0:1784290395.654581:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2399:x1870961896270848:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290395.654644:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2399:x1870961896271104:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 128us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290395.654656:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2399:x1870961896270848:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 75us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290395.654670:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1603 00000100:00100000:1.0:1784290395.654683:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 737 00000100:00080000:0.0:1784290395.654713:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784290395.654727:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784290395.654733:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784290395.654739:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784290395.815447:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784290396.077723:0:93338:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:3.0:1784290396.112023:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290396.112104:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896271232 00000100:00100000:2.0:1784290396.112120:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896271232 00000100:00100000:2.0:1784290396.112184:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1257 00000100:00100000:2.0:1784290396.112196:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+13:71841:x1870961896271232:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:2.0:1784290396.112215:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290396.112234:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d600/0x5953bbf6b3075167 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2558 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.112294:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ce00/0x5953bbf6b307516e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.112323:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ce00/0x5953bbf6b307516e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.112335:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ce00/0x5953bbf6b307516e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784290396.112416:0:66004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784290396.112436:0:66004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784290396.112474:0:66004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ce00/0x5953bbf6b307516e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.112504:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d600/0x5953bbf6b3075167 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2558 expref: 15 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.112524:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ce00/0x5953bbf6b307516e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2558 expref: 14 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.112536:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c246de62500) 00010000:00010000:2.0:1784290396.112540:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784290396.112545:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2458d5ce00, rc 0) 00010000:00000080:2.0:1784290396.112556:0:66004:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c24483cf800 x1870961896271232/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:417/0 lens 576/688 e 0 to 0 dl 1784290407 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290396.112640:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+14:71841:x1870961896271232:12345-192.168.202.6@tcp:101:touch.0 Request processed in 444us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290396.112651:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1257 00000100:00100000:2.0:1784290396.114644:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290396.114760:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896271360 00000100:00100000:3.0:1784290396.114778:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896271360 00000100:00100000:3.0:1784290396.114911:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1258 00000100:00100000:3.0:1784290396.114940:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+14:71841:x1870961896271360:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:3.0:1784290396.114984:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290396.115022:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3075175 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b255f expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115134:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b307517c lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115185:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b307517c lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115208:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b307517c lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115250:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff800/0x5953bbf6b3075183 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115267:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff800/0x5953bbf6b3075183 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115284:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff800/0x5953bbf6b3075183 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115504:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffa00/0x5953bbf6b307518a lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115526:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffa00/0x5953bbf6b307518a lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115545:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffa00/0x5953bbf6b307518a lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290396.115601:0:65990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffa00/0x5953bbf6b307518a lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115629:0:65990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b307517c lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115645:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b307517c lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115683:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b307517c lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115698:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b307517c lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115712:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fee00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290396.115722:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b307517c lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115740:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b307517c lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115767:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c244c870e00) 00010000:00010000:3.0:1784290396.115774:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290396.115782:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b307517c lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115797:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fee00/0x5953bbf6b307517c lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115825:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff800/0x5953bbf6b3075183 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115839:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff800/0x5953bbf6b3075183 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115852:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff800/0x5953bbf6b3075183 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115865:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2ff800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290396.115886:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff800/0x5953bbf6b3075183 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115902:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff800/0x5953bbf6b3075183 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115935:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff9c244c870300) 00010000:00010000:3.0:1784290396.115941:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290396.115949:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff800/0x5953bbf6b3075183 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.115961:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff800/0x5953bbf6b3075183 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.116055:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3075175 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b255f expref: 16 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.116096:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffa00/0x5953bbf6b307518a lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b255f expref: 15 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.116115:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c2458ba5a00) 00010000:00010000:3.0:1784290396.116122:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784290396.116129:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2ffa00, rc 0) 00010000:00000080:3.0:1784290396.116153:0:65990:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2474b4df80 x1870961896271360/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:417/0 lens 576/584 e 0 to 0 dl 1784290407 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290396.116283:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+15:71841:x1870961896271360:12345-192.168.202.6@tcp:101:touch.0 Request processed in 1352us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290396.116335:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1258 00000100:00100000:0.0:1784290396.118198:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290396.118270:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896271488 00000100:00100000:1.0:1784290396.118277:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896271488 00000100:00100000:1.0:1784290396.118348:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1259 00000100:00100000:1.0:1784290396.118399:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:71841:x1870961896271488:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:1.0:1784290396.118417:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290396.118440:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8cbc00/0x5953bbf6b3075191 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2566 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290396.118481:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca000/0x5953bbf6b3075198 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290396.118496:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca000/0x5953bbf6b3075198 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290396.118512:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca000/0x5953bbf6b3075198 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290396.118557:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000004:00200000:1.0:1784290396.118558:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00200000:1.0:1784290396.118562:0:65988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:0.0:1784290396.118605:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896271616 00000100:00100000:0.0:1784290396.118612:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896271616 00010000:00010000:1.0:1784290396.118616:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8cbc00/0x5953bbf6b3075191 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2566 expref: 7 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290396.118658:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247f8ca000/0x5953bbf6b3075198 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2566 expref: 6 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290396.118664:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c2475807a00) 00010000:00010000:1.0:1784290396.118666:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1784290396.118669:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8ca000, rc 0) 00000100:00100000:0.0:1784290396.118680:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 680 00000100:00100000:0.0:1784290396.118690:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+15:2400:x1870961896271616:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784290396.118700:0:19592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290396.118716:0:19592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffa00/0x5953bbf6b307518a lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b255f expref: 15 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290396.118722:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:71841:x1870961896271488:12345-192.168.202.6@tcp:101:touch.0 Request processed in 328us (522us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290396.118731:0:19592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c2458ba5a00) 00000100:00100000:1.0:1784290396.118735:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1259 00010000:00010000:0.0:1784290396.118746:0:19592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784290396.118769:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+14:2400:x1870961896271616:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 82us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290396.118776:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 680 00000100:00100000:0.0:1784290396.120627:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290396.120674:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896271872 00000100:00100000:2.0:1784290396.120680:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896271872 00000100:00100000:2.0:1784290396.120719:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1260 00000100:00100000:2.0:1784290396.120731:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:71841:x1870961896271872:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:2.0:1784290396.120743:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290396.120767:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5de00/0x5953bbf6b307519f lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b256d expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.120840:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30751a6 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.120849:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30751a6 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.120857:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30751a6 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.120914:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5c800/0x5953bbf6b30751ad lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.120921:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5c800/0x5953bbf6b30751ad lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.120926:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5c800/0x5953bbf6b30751ad lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290396.121055:0:66008:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474b4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:66008:1870961901142784:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1784290396.121099:0:66008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290396.121129:0:66008:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b2359c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290396.121156:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901142784 00000100:00100000:0.0:1784290396.121167:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901142784 00000100:00100000:0.0:1784290396.121220:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3882 00000100:00100000:0.0:1784290396.121233:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66008:x1870961901142784:12345-0@lo:1000:mdt00_004.0 00010000:00000080:0.0:1784290396.121269:0:23867:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2468ad5880 x1870961901142784/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:417/0 lens 328/4320 e 0 to 0 dl 1784290407 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_004.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290396.121337:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66008:x1870961901142784:12345-0@lo:1000:mdt00_004.0 Request processed in 107us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290396.121367:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3882 00000100:00100000:2.0:1784290396.121399:0:66008:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474b4f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:66008:1870961901142784:0@lo:1000:mdt00_004.0 00000004:00080000:2.0:1784290396.121665:0:66008:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0xd1:0x0], count =369 00000004:00080000:2.0:1784290396.121673:0:66008:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000400:0xd1:0x0]+369 in llog 00000004:00080000:2.0:1784290396.121685:0:66008:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x242:0x0], index 1: 0 00010000:00010000:2.0:1784290396.121814:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5cc00/0x5953bbf6b30751b4 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.121834:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5cc00/0x5953bbf6b30751b4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.121841:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5cc00/0x5953bbf6b30751b4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.121871:0:66008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30751a6 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.121877:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30751a6 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.121883:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30751a6 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.121888:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30751a6 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.121893:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5dc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290396.121897:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30751a6 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.121904:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30751a6 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.121911:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c2475807a00) 00010000:00010000:2.0:1784290396.121913:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290396.121917:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30751a6 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.121922:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5dc00/0x5953bbf6b30751a6 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784290396.121939:0:66008:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000be1e5d0e reply state 0000000090e65cd8 transno 81604378771 ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5c800/0x5953bbf6b30751ad lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.121950:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5c800/0x5953bbf6b30751ad lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.121955:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x9add8152 (ffff9c2442ffe100) 00010000:00010000:2.0:1784290396.121957:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290396.121960:0:66008:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784290396.121981:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5de00/0x5953bbf6b307519f lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b256d expref: 9 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.121991:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5cc00/0x5953bbf6b30751b4 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b256d expref: 8 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.121998:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9c2442ffe900) 00010000:00010000:2.0:1784290396.122000:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784290396.122002:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2458d5cc00, rc 0) 00000100:00100000:2.0:1784290396.122036:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:71841:x1870961896271872:12345-192.168.202.6@tcp:101:touch.0 Request processed in 1310us (1410us total) trans 81604378771 rc 0/0 00000100:00100000:2.0:1784290396.122042:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1260 00000100:00100000:2.0:1784290396.124468:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290396.124515:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896272128 00000100:00100000:0.0:1784290396.124522:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896272128 00000100:00100000:0.0:1784290396.124579:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1261 00000100:00100000:0.0:1784290396.124595:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:71841:x1870961896272128:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:0.0:1784290396.124628:0:65989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290396.124648:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5cc00/0x5953bbf6b30751b4 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b256d expref: 9 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.124665:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9c2442ffe900) 00010000:00010000:0.0:1784290396.124674:0:65989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290396.124707:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf800/0x5953bbf6b30751c2 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.124730:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf800/0x5953bbf6b30751c2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.124738:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf800/0x5953bbf6b30751c2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290396.124802:0:65989:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000938089df reply state 0000000051ba4c50 transno 81604378772 ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf800/0x5953bbf6b30751c2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.124812:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf800/0x5953bbf6b30751c2 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.124818:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9c2475800200) 00010000:00010000:0.0:1784290396.124820:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290396.124823:0:65989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784290396.124906:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:71841:x1870961896272128:12345-192.168.202.6@tcp:36:touch.0 Request processed in 317us (442us total) trans 81604378772 rc 0/0 00000100:00100000:0.0:1784290396.124913:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1261 00000100:00100000:2.0:1784290396.126550:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290396.126625:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896272256 00000100:00100000:2.0:1784290396.126633:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896272256 00000100:00100000:2.0:1784290396.126687:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1262 00000100:00100000:2.0:1784290396.126703:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:71841:x1870961896272256:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:2.0:1784290396.126728:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290396.126742:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5d600/0x5953bbf6b30751c9 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2574 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.126784:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5d600/0x5953bbf6b30751c9 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2574 expref: 11 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.126801:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5d600/0x5953bbf6b30751c9 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2574 expref: 11 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.126822:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9c2475800200) 00010000:00010000:2.0:1784290396.126826:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784290396.126830:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2458d5d600, rc 0) 00000100:00100000:2.0:1784290396.126878:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:71841:x1870961896272256:12345-192.168.202.6@tcp:101:touch.0 Request processed in 181us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290396.126889:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1262 00000100:00100000:0.0:1784290396.128609:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290396.128685:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896272384 00000100:00100000:3.0:1784290396.128711:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896272384 00000100:00100000:3.0:1784290396.128800:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4963 00000100:00100000:3.0:1784290396.128824:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2399:x1870961896272384:12345-192.168.202.6@tcp:2:touch.0 00000001:00080000:0.0:1784290396.130199:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968632 is committed 00000001:00100000:0.0:1784290396.130210:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 711f3c77-e791-4aa8-86ee-bc854fd0bcc5 00000100:00100000:3.0:1784290396.130439:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343893480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2399:x1870961896272384:12345-192.168.202.6@tcp:2:touch.0 Request processed in 1620us (1826us total) trans 4294968632 rc 0/0 00000100:00100000:3.0:1784290396.130452:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4963 00000100:00100000:0.0:1784290396.131957:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290396.132089:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896272640 00000100:00100000:2.0:1784290396.132098:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896272640 00000100:00100000:2.0:1784290396.132157:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 238 00000100:00100000:2.0:1784290396.132174:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:71841:x1870961896272640:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:2.0:1784290396.132518:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+12:71841:x1870961896272640:12345-192.168.202.6@tcp:35:touch.0 Request processed in 346us (559us total) trans 81604378773 rc 0/0 00000100:00100000:2.0:1784290396.132533:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 238 00000100:00100000:0.0:1784290396.139836:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290396.139865:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896272768 00000100:00100000:0.0:1784290396.139871:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896272768 00000100:00100000:0.0:1784290396.139901:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1263 00000100:00100000:0.0:1784290396.139911:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+14:71842:x1870961896272768:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290396.139924:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290396.139943:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b30751d0 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b257b expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.139985:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30751d7 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.139996:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30751d7 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140008:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30751d7 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140022:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b30751de lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140028:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b30751de lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140033:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b30751de lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140076:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b30751e5 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140084:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b30751e5 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140089:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b30751e5 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290396.140106:0:66004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b30751e5 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140118:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30751d7 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140131:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30751d7 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140137:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30751d7 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140142:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30751d7 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140147:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebee00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290396.140151:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30751d7 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140157:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30751d7 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140167:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c244c870e00) 00010000:00010000:0.0:1784290396.140172:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290396.140177:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30751d7 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140183:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b30751d7 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140197:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b30751de lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140202:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b30751de lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140207:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b30751de lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140217:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290396.140220:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b30751de lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140229:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b30751de lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140238:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff9c2475800c00) 00010000:00010000:0.0:1784290396.140241:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290396.140244:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b30751de lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140249:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf400/0x5953bbf6b30751de lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140280:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b30751d0 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b257b expref: 16 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140292:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b30751e5 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b257b expref: 15 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.140319:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c2458ba5b00) 00010000:00010000:0.0:1784290396.140322:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784290396.140324:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebec00, rc 0) 00010000:00000080:0.0:1784290396.140332:0:66004:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2343892d80 x1870961896272768/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:417/0 lens 576/584 e 0 to 0 dl 1784290407 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290396.140397:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+15:71842:x1870961896272768:12345-192.168.202.6@tcp:101:touch.0 Request processed in 490us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290396.140414:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1263 00000100:00100000:2.0:1784290396.141824:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290396.141889:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896272896 00000100:00100000:3.0:1784290396.141901:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896272896 00000100:00100000:0.0:1784290396.142141:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290396.142172:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1264 00000100:00100000:3.0:1784290396.142200:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+12:71842:x1870961896272896:12345-192.168.202.6@tcp:101:touch.0 00000100:00100000:0.0:1784290396.142209:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896273024 00000100:00100000:0.0:1784290396.142217:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896273024 00010000:00010000:3.0:1784290396.142228:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290396.142258:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fec00/0x5953bbf6b30751ec lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2582 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290396.142273:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 681 00000100:00100000:0.0:1784290396.142294:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245818e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+15:2398:x1870961896273024:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784290396.142324:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290396.143476:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebec00/0x5953bbf6b30751e5 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b257b expref: 15 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.143502:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c2458ba5b00) 00010000:00010000:0.0:1784290396.143507:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784290396.143569:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245818e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+14:2398:x1870961896273024:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 1278us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290396.143577:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 681 00010000:00010000:3.0:1784290396.143593:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff800/0x5953bbf6b30751f3 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.143616:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff800/0x5953bbf6b30751f3 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.143633:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff800/0x5953bbf6b30751f3 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290396.143687:0:65990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1784290396.143927:0:65990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1784290396.144014:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2fec00/0x5953bbf6b30751ec lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2582 expref: 14 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.144048:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c247d2ff800/0x5953bbf6b30751f3 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2582 expref: 13 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290396.144075:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c244c870300) 00010000:00010000:3.0:1784290396.144079:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1784290396.144084:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2ff800, rc 0) 00000100:00100000:3.0:1784290396.144157:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+13:71842:x1870961896272896:12345-192.168.202.6@tcp:101:touch.0 Request processed in 1971us (2333us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290396.144168:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1264 00000100:00100000:0.0:1784290396.145973:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290396.146031:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896273280 00000100:00100000:2.0:1784290396.146039:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896273280 00000100:00100000:2.0:1784290396.146094:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1265 00000100:00100000:2.0:1784290396.146120:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+13:71842:x1870961896273280:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:2.0:1784290396.146137:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290396.146156:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236c000/0x5953bbf6b30751fa lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2589 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.146235:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d400/0x5953bbf6b3075201 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.146251:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d400/0x5953bbf6b3075201 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.146262:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d400/0x5953bbf6b3075201 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.146282:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d800/0x5953bbf6b3075208 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.146291:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d800/0x5953bbf6b3075208 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.146317:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d800/0x5953bbf6b3075208 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784290396.146656:0:65988:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x243:0x0], index 1: 0 00010000:00010000:2.0:1784290396.146839:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236cc00/0x5953bbf6b307520f lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.146852:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236cc00/0x5953bbf6b307520f lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.146864:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236cc00/0x5953bbf6b307520f lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.146916:0:65988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d400/0x5953bbf6b3075201 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.146926:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d400/0x5953bbf6b3075201 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.146933:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d400/0x5953bbf6b3075201 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.146941:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d400/0x5953bbf6b3075201 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.146947:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290396.146953:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d400/0x5953bbf6b3075201 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.146960:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d400/0x5953bbf6b3075201 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.146982:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c244c870300) 00010000:00010000:2.0:1784290396.146986:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290396.146990:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d400/0x5953bbf6b3075201 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.146998:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d400/0x5953bbf6b3075201 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784290396.147011:0:65988:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fc0ca02f reply state 000000008ff3afca transno 81604378774 ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d800/0x5953bbf6b3075208 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.147024:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d800/0x5953bbf6b3075208 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.147040:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x9add8152 (ffff9c2442ffe500) 00010000:00010000:2.0:1784290396.147043:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290396.147047:0:65988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784290396.147081:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236c000/0x5953bbf6b30751fa lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2589 expref: 16 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.147099:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236cc00/0x5953bbf6b307520f lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2589 expref: 15 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.147108:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff9c2442ffea00) 00010000:00010000:2.0:1784290396.147112:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784290396.147115:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236cc00, rc 0) 00000100:00100000:2.0:1784290396.147173:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+16:71842:x1870961896273280:12345-192.168.202.6@tcp:101:touch.0 Request processed in 1056us (1200us total) trans 81604378774 rc 0/0 00000100:00100000:2.0:1784290396.147186:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1265 00000100:00100000:2.0:1784290396.149550:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290396.149603:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896273536 00000100:00100000:0.0:1784290396.149611:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896273536 00000100:00100000:0.0:1784290396.149664:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1266 00000100:00100000:0.0:1784290396.149675:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+16:71842:x1870961896273536:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:0.0:1784290396.149705:0:66008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290396.149722:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236cc00/0x5953bbf6b307520f lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2589 expref: 16 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.149740:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff9c2442ffea00) 00010000:00010000:0.0:1784290396.149750:0:66008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290396.149795:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf400/0x5953bbf6b307521d lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.149805:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf400/0x5953bbf6b307521d lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.149812:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf400/0x5953bbf6b307521d lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290396.149875:0:66008:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000041b3e7d reply state 0000000073041c55 transno 81604378775 ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf400/0x5953bbf6b307521d lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.149885:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf400/0x5953bbf6b307521d lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290396.149890:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff9c2475800c00) 00010000:00010000:0.0:1784290396.149893:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290396.149895:0:66008:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784290396.149998:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+17:71842:x1870961896273536:12345-192.168.202.6@tcp:36:touch.0 Request processed in 322us (449us total) trans 81604378775 rc 0/0 00000100:00100000:0.0:1784290396.150015:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1266 00000100:00100000:0.0:1784290396.151426:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290396.151480:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896273664 00000100:00100000:2.0:1784290396.151487:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896273664 00000100:00100000:2.0:1784290396.151545:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1267 00000100:00100000:2.0:1784290396.151566:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+17:71842:x1870961896273664:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:2.0:1784290396.151583:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290396.151598:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236c600/0x5953bbf6b3075224 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2590 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.151636:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236c600/0x5953bbf6b3075224 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2590 expref: 18 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.151661:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236c600/0x5953bbf6b3075224 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2590 expref: 18 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290396.151678:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff9c2475800c00) 00010000:00010000:2.0:1784290396.151682:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784290396.151686:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236c600, rc 0) 00000100:00100000:2.0:1784290396.151732:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+18:71842:x1870961896273664:12345-192.168.202.6@tcp:101:touch.0 Request processed in 178us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290396.151738:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1267 00000100:00100000:2.0:1784290396.153475:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290396.153518:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896273792 00000100:00100000:0.0:1784290396.153525:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896273792 00000100:00100000:0.0:1784290396.153562:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4964 00000100:00100000:0.0:1784290396.153569:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2399:x1870961896273792:12345-192.168.202.6@tcp:2:touch.0 00000100:00100000:0.0:1784290396.153695:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2399:x1870961896273792:12345-192.168.202.6@tcp:2:touch.0 Request processed in 126us (221us total) trans 4294968633 rc 0/0 00000100:00100000:0.0:1784290396.153702:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4964 00000100:00100000:0.0:1784290396.155108:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290396.155202:0:68995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896274048 00000100:00100000:2.0:1784290396.155209:0:68995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896274048 00000100:00100000:2.0:1784290396.155255:0:68995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 239 00000100:00100000:2.0:1784290396.155263:0:68995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+18:71842:x1870961896274048:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:2.0:1784290396.155530:0:68995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+19:71842:x1870961896274048:12345-192.168.202.6@tcp:35:touch.0 Request processed in 264us (422us total) trans 81604378776 rc 0/0 00000100:00100000:2.0:1784290396.155541:0:68995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 239 00000100:00100000:2.0:1784290396.327521:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901143040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290396.327531:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901142912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290396.327663:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290396.327742:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290396.327750:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901143040 00000100:00100000:3.0:1784290396.327766:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901143040 00000100:00080000:2.0:1784290396.327831:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784290396.327834:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901142912 00000100:00100000:1.0:1784290396.327847:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901142912 00000100:00100000:3.0:1784290396.327892:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:3.0:1784290396.327909:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901143040:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1784290396.327924:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290396.327953:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00002000:00000024:3.0:1784290396.327961:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784290396.327976:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901142912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784290396.328037:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290396.328098:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901143040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 193us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290396.328111:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:1.0:1784290396.328116:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901142912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 149us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290396.328127:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000100:00100000:2.0:1784290396.328153:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901143040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290396.328203:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901142912:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1784290396.839542:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784290397.115904:0:93435:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1784290397.116005:0:93435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b3074f37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f3e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.116032:0:93435:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b3074f37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074f3e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.116045:0:93435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b3074f37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3074f3e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.116055:0:93435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b3074f37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3074f3e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.116124:0:93435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784290397.116134:0:93435:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1784290397.116212:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1784290397.116219:0:93435:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784290397.116230:0:93435:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1784290397.116236:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b3074f37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3074f3e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784290397.116241:0:93435:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1784290397.116267:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fe600 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:1.0:1784290397.116279:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b3074f37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3074f3e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784290397.116327:0:93435:0:(import.c:65:import_set_state_nolock()) ffff9c246dce3000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1784290397.116333:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b3074f37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3074f3e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290397.116399:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b3074f37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3074f3e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290397.116413:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784290397.116419:0:6476:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1784290397.116427:0:6476:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:0.0:1784290397.116476:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901143168:0@lo:39:umount.0 00010000:00010000:1.0:1784290397.116492:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b3074f37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074f3e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290397.116508:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784290397.116571:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784290397.116572:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b3074f37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074f3e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290397.116594:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b3074f37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074f3e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290397.116618:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901143296:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290397.116628:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290397.116633:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290397.116646:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290397.116678:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901143168 00000100:00100000:3.0:1784290397.116694:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901143168 00000100:00100000:2.0:1784290397.116713:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290397.116809:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901143296 00000100:00100000:1.0:1784290397.116835:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901143296 00000100:00100000:3.0:1784290397.116844:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:3.0:1784290397.116868:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1870961901143168:12345-0@lo:39:umount.0 00000020:00000080:3.0:1784290397.116915:0:74876:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074b9b 00000100:00080000:3.0:1784290397.116942:0:74876:0:(import.c:65:import_set_state_nolock()) ffff9c2470369800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784290397.116952:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:1.0:1784290397.116979:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3617:x1870961901143296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290397.117007:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00000080:3.0:1784290397.117018:0:74876:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c246a4fa680 x1870961901143168/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:418/0 lens 224/224 e 0 to 0 dl 1784290408 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784290397.117037:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290397.117046:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247f8cb600/0x5953bbf6b3074f3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074f37 expref: 24 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290397.117077:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784290397.117156:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+1:3616:x1870961901143168:12345-0@lo:39:umount.0 Request processed in 294us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290397.117177:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000020:00000080:3.0:1784290397.117203:0:74876:0:(genops.c:906:class_export_put()) final put ffff9c247036e800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:1.0:1784290397.117207:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3617:x1870961901143296:12345-0@lo:103:ldlm_bl.0 Request processed in 224us (488us total) trans 0 rc 0/0 00000100:00080000:0.0:1784290397.117229:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dce3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1784290397.117230:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000020:00000080:2.0:1784290397.117243:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247036e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:0.0:1784290397.117263:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901143168:0@lo:39:umount.0 00000100:00080000:3.0:1784290397.117456:0:93435:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784290397.117463:0:93435:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1784290397.117471:0:93435:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784290397.117487:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2470369800 for lustre-MDT0000 00000100:00100000:1.0:1784290397.117526:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901143296:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784290397.119019:0:93435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074f45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074f4c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.119033:0:93435:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074f45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074f4c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.119059:0:93435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074f45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3074f4c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.119067:0:93435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074f45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3074f4c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.119094:0:93435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290397.119102:0:93435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247c263200/0x5953bbf6b3074a9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074aa6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.119110:0:93435:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247c263200/0x5953bbf6b3074a9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074aa6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.119118:0:93435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247c263200/0x5953bbf6b3074a9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3074aa6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.119126:0:93435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c247c263200/0x5953bbf6b3074a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3074aa6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.119145:0:93435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784290397.119153:0:93435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3074a6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3074a75 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.119161:0:93435:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3074a6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074a75 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.119170:0:93435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3074a6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3074a75 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290397.119187:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784290397.119192:0:93435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3074a6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3074a75 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290397.119207:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074f45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3074f4c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.119219:0:93435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784290397.119231:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784290397.119241:0:93435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3074995 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307499c expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290397.119243:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5c400 already unused, calling callback (ffffffffc14a9c20) 00010000:00010000:2.0:1784290397.119244:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247c263200/0x5953bbf6b3074a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3074aa6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290397.119262:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074f45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3074f4c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.119319:0:93435:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3074995 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307499c expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290397.119326:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247c263200 already unused, calling callback (ffffffffc14a9c20) 00010000:00010000:1.0:1784290397.119329:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074f45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3074f4c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.119402:0:93435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3074995 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b307499c expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290397.119402:0:19681:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247c263200/0x5953bbf6b3074a9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3074aa6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290397.119405:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1784290397.119406:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074f45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3074f4c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290397.119435:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3074a6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3074a75 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.119477:0:93435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3074995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b307499c expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290397.119478:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784290397.119482:0:19681:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247c263200/0x5953bbf6b3074a9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3074aa6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290397.119501:0:7429:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1784290397.119521:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab000 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:0.0:1784290397.119544:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3074a6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3074a75 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290397.119546:0:19681:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247c263200/0x5953bbf6b3074a9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3074aa6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.119552:0:93435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290397.119553:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074f45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074f4c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290397.119574:0:93435:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1784290397.119587:0:93435:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 10000000:01000000:2.0:1784290397.119609:0:19681:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290397.119615:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:2.0:1784290397.119619:0:19681:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1784290397.119621:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3074a6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3074a75 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290397.119626:0:19681:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:01000004:3.0:1784290397.119644:0:93435:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 10000000:00010000:0.0:1784290397.119649:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3074a6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3074a75 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1784290397.119653:0:93435:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00010000:00010000:1.0:1784290397.119660:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074f45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074f4c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784290397.119662:0:93435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1784290397.119671:0:19681:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247c263200/0x5953bbf6b3074a9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074aa6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000400:3.0:1784290397.119680:0:93435:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 10000000:01000000:0.0:1784290397.119705:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784290397.119708:0:19681:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784290397.119709:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c400/0x5953bbf6b3074f45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074f4c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290397.119724:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1784290397.119737:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1784290397.119745:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247c263200/0x5953bbf6b3074a9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074aa6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290397.119753:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290397.119761:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3074995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b307499c expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290397.119762:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247c263200/0x5953bbf6b3074a9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074aa6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290397.119777:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa600 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:1.0:1784290397.119783:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3074995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b307499c expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290397.119785:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290397.119789:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290397.119791:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3074a6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074a75 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290397.119804:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3074995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b307499c expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290397.119806:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290397.119828:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784290397.119835:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901143552:0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1784290397.119835:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3074995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b307499c expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290397.119852:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1784290397.119857:0:7429:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:0.0:1784290397.119859:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3074a6e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074a75 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290397.119862:0:7429:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1784290397.119896:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3074995 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b307499c expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290397.119902:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784290397.119931:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784290397.119934:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3074a6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3074a75 expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290397.119947:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3074995 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b307499c expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290397.119962:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1784290397.119966:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290397.119976:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290397.119977:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901143680:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290397.119986:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290397.119992:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3074995 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b307499c expref: -99 pid: 92144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290397.120019:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290397.120024:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290397.120026:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784290397.120028:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290397.120051:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901143424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290397.120058:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901143808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290397.120084:0:10356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901143552 00000100:00100000:2.0:1784290397.120091:0:10356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901143552 00000100:00100000:2.0:1784290397.120148:0:10356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901143680 00000100:00100000:0.0:1784290397.120151:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290397.120157:0:10356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901143680 00010000:00010000:1.0:1784290397.120166:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290397.120213:0:10356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901143424 00000100:00100000:2.0:1784290397.120222:0:10356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901143424 00000100:00100000:1.0:1784290397.120224:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:1.0:1784290397.120242:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e54cd1c-9dbd-4e31-b60e-998135d46053+25:3619:x1870961901143552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290397.120259:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1784290397.120272:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00010000:00010000:1.0:1784290397.120283:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c23450aa200/0x5953bbf6b3074aa6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074a9f expref: 25 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290397.120320:0:10356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2e54cd1c-9dbd-4e31-b60e-998135d46053+25:3619:x1870961901143680:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290397.120324:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00010000:00010000:2.0:1784290397.120338:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290397.120375:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290397.120397:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd27000/0x5953bbf6b3074a75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074a6e expref: 24 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290397.120412:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3618:x1870961901143424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290397.120423:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290397.120441:0:19592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784290397.120444:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3619:x1870961901143552:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290397.120463:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00010000:00010000:0.0:1784290397.120476:0:19592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebe200/0x5953bbf6b3074f4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074f45 expref: 23 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290397.120479:0:10356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3619:x1870961901143680:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290397.120510:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:1.0:1784290397.120524:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784290397.120524:0:19592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784290397.120555:0:10356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901143808 00000100:00100000:2.0:1784290397.120562:0:10356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901143808 00000100:00100000:2.0:1784290397.120616:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:0.0:1784290397.120625:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:3618:x1870961901143424:12345-0@lo:103:ldlm_bl.0 Request processed in 225us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290397.120639:0:10356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:3617:x1870961901143808:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290397.120645:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00010000:00010000:2.0:1784290397.120665:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290397.120690:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd26a00/0x5953bbf6b307499c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074995 expref: 20 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290397.120690:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901143424:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290397.120721:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784290397.120787:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901143680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290397.120791:0:10356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:3617:x1870961901143808:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290397.120806:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:1.0:1784290397.120811:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901143552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290397.120844:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901143808:0@lo:103:ldlm_bl.0 00000004:00000080:3.0:1784290397.122171:0:93435:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:3.0:1784290397.123035:0:92145:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117004 is committed 00010000:00010000:0.0:1784290397.123132:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b307511a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290397.123152:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b307511a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290397.123163:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b307511a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290397.123185:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5d200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290397.123192:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b307511a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290397.123201:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b307511a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784290397.123215:0:93435:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00010000:00010000:0.0:1784290397.123221:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2442ffeb00) 00010000:00010000:0.0:1784290397.123228:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290397.123233:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b307511a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290397.123243:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d200/0x5953bbf6b307511a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1784290397.123267:0:93435:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c246ff62000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1784290397.123269:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3075152 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1784290397.123313:0:93435:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c23417da000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1784290397.123322:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3075152 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1784290397.123328:0:93435:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c246ff1c000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1784290397.123413:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3075152 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1784290397.123421:0:93435:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c246dcfe000 711f3c77-e791-4aa8-86ee-bc854fd0bcc5 192.168.202.6@tcp 10 (0 0 4) 0 0 0 0: 0000000000000000 115964117004 stale:0 00010000:00010000:0.0:1784290397.123430:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebea00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290397.123444:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3075152 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1784290397.123447:0:93435:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9c246dcfb800 lustre-MDT0001-mdtlov_UUID 0@lo 6 (0 0 1) 0 0 0 0: 0000000000000000 115964117002 stale:0 00010000:00010000:0.0:1784290397.123466:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3075152 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1784290397.123475:0:93435:0:(genops.c:1574:class_disconnect_exports()) OBD device 13 (ffff9c23440d0000) has exports, disconnecting them 00000020:00080000:2.0:1784290397.123492:0:93435:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c246ff62000), last request at 1784290394 00000020:00000080:2.0:1784290397.123511:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074b94 00010000:00010000:0.0:1784290397.123512:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2442ffeb00) 00010000:00010000:0.0:1784290397.123520:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00080000:2.0:1784290397.123525:0:93435:0:(import.c:65:import_set_state_nolock()) ffff9c246ff64000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1784290397.123527:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3075152 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290397.123542:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebea00/0x5953bbf6b3075152 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1784290397.123576:0:93435:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c246ff62000): rc 0 00000020:00000080:2.0:1784290397.123583:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c246ff62000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:1.0:1784290397.123595:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1784290397.123621:0:93435:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c23417da000), last request at 1784290384 00000020:00000080:2.0:1784290397.123628:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074b8d 00000100:00080000:2.0:1784290397.123635:0:93435:0:(import.c:65:import_set_state_nolock()) ffff9c23417db000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1784290397.123661:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246ff62000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:2.0:1784290397.123665:0:93435:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c23417da000): rc 0 00000020:00000080:2.0:1784290397.123675:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c23417da000/lustre-MDT0000-lwp-MDT0001_UUID 00010000:00010000:1.0:1784290397.123691:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1784290397.123704:0:93435:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c246ff1c000), last request at 1784290394 00000020:00000080:2.0:1784290397.123712:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074b86 00000100:00080000:2.0:1784290397.123730:0:93435:0:(import.c:65:import_set_state_nolock()) ffff9c246ff1f000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1784290397.123763:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246ff64000 for lustre-MDT0000 00000020:00080000:2.0:1784290397.123773:0:93435:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c246ff1c000): rc 0 00000020:00000080:0.0:1784290397.123775:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c23417da000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1784290397.123783:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c246ff1c000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1784290397.123810:0:93435:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.6@tcp (ffff9c246dcfe000), last request at 1784290396 00000020:00000080:2.0:1784290397.123834:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30749f0 00000020:00000080:0.0:1784290397.123839:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c23417db000 for lustre-MDT0000 00000020:00000080:0.0:1784290397.123848:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246ff1c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00010000:2.0:1784290397.123858:0:93435:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c246dcfe000: total 1 00000100:00080000:2.0:1784290397.123867:0:93435:0:(import.c:65:import_set_state_nolock()) ffff9c246d8ad800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1784290397.123902:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246ff1f000 for lustre-MDT0000 00000020:00010000:0.0:1784290397.123930:0:6477:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c246dcfe000: total 0 00010000:00010000:0.0:1784290397.123941:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290397.123945:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784290397.124000:0:93435:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.6@tcp (ffff9c246dcfe000): rc 0 00000020:00080000:3.0:1784290397.124012:0:93435:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c246dcfb800), last request at 1784290378 00010000:00010000:0.0:1784290397.124019:0:6477:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c246dcfe000, canceled 0 locks, left on hash table 4. 00000020:00000080:3.0:1784290397.124023:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30749e9 00000020:00010000:3.0:1784290397.124055:0:93435:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c246dcfb800: total 0 00000100:00080000:3.0:1784290397.124062:0:93435:0:(import.c:65:import_set_state_nolock()) ffff9c247036a000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1784290397.124071:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5da00/0x5953bbf6b30750e2 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2535 expref: 5 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1784290397.124105:0:93435:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c246dcfb800): rc 0 00000004:00000080:3.0:1784290397.124118:0:93435:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffae54417d7ae0 00010000:00010000:0.0:1784290397.124120:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5c200/0x5953bbf6b30750a3 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2520 expref: 4 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:1.0:1784290397.124123:0:6476:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c246dcfb800: total 0 00000100:00080000:3.0:1784290397.124166:0:93435:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00010000:00010000:0.0:1784290397.124167:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff600/0x5953bbf6b3075087 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2519 expref: 3 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290397.124173:0:93435:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1784290397.124200:0:6476:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c246dcfb800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784290397.124220:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5ce00/0x5953bbf6b307516e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2558 expref: 2 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290397.124250:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2458d5d400/0x5953bbf6b3074bb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074bb0 expref: 2 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290397.124273:0:6477:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c246dcfe000, canceled 4 locks, left on hash table 0. 00010000:00010000:1.0:1784290397.124312:0:6476:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c246dcfb800, canceled 1 locks, left on hash table 0. 00000100:00080000:3.0:1784290397.142206:0:93435:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1784290397.142230:0:93435:0:(import.c:65:import_set_state_nolock()) ffff9c2458841000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1784290397.142381:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901143936:0@lo:39:umount.0 00000100:00100000:2.0:1784290397.142463:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784290397.142564:0:93435:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784290397.142568:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901143936 00000100:00100000:3.0:1784290397.142572:0:93435:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968630 gen 3 00000100:00100000:2.0:1784290397.142585:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901143936 00000004:00080000:3.0:1784290397.142595:0:93435:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784290397.142665:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3883 00000100:00100000:2.0:1784290397.142681:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3616:x1870961901143936:12345-0@lo:39:umount.0 00000020:00000080:2.0:1784290397.142722:0:8413:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074a2f 00000100:00080000:2.0:1784290397.142734:0:8413:0:(import.c:65:import_set_state_nolock()) ffff9c24481c6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784290397.142760:0:8413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378776 00000100:00100000:2.0:1784290397.142965:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3616:x1870961901143936:12345-0@lo:39:umount.0 Request processed in 283us (506us total) trans 81604378777 rc 0/0 00000100:00100000:2.0:1784290397.142981:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3883 00010000:00010000:2.0:1784290397.143035:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784290397.143079:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2458841000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784290397.143093:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901143936:0@lo:39:umount.0 00000100:00080000:3.0:1784290397.143926:0:93435:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1784290397.143947:0:93435:0:(import.c:65:import_set_state_nolock()) ffff9c2474f81800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1784290397.143973:0:93435:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784290397.143977:0:93435:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968631 gen 3 00000004:00080000:3.0:1784290397.143997:0:93435:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784290397.144023:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901144064:0@lo:9:umount.0 00000100:00100000:2.0:1784290397.144078:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290397.144140:0:8999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901144064 00000100:00100000:2.0:1784290397.144148:0:8999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901144064 00000100:00100000:2.0:1784290397.144212:0:8999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4965 00000100:00100000:2.0:1784290397.144224:0:8999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1870961901144064:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784290397.144265:0:8999:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074a3d 00000100:00080000:2.0:1784290397.144276:0:8999:0:(import.c:65:import_set_state_nolock()) ffff9c245fd7c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784290397.144435:0:8999:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968631 00000100:00100000:2.0:1784290397.144607:0:8999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3616:x1870961901144064:12345-0@lo:9:umount.0 Request processed in 380us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290397.144618:0:8999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4965 00000100:00080000:2.0:1784290397.144652:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784290397.144674:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784290397.144720:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2474f81800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784290397.144737:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784290397.144740:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784290397.144745:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901144064:0@lo:9:umount.0 00000100:00080000:3.0:1784290397.144952:0:93435:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1784290397.144973:0:93435:0:(import.c:65:import_set_state_nolock()) ffff9c246dce0800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1784290397.145051:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901144192:0@lo:9:umount.0 00000020:00080000:3.0:1784290397.145060:0:93435:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c23440d0000) has no exports 00000100:00100000:2.0:1784290397.145111:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290397.145164:0:26257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901144192 00000100:00100000:3.0:1784290397.145174:0:26257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901144192 00000100:00080000:2.0:1784290397.145230:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784290397.145250:0:26257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4966 00000100:00100000:3.0:1784290397.145262:0:26257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f98ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3616:x1870961901144192:12345-0@lo:9:umount.0 00000020:00000080:3.0:1784290397.145307:0:26257:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074a59 00000100:00080000:3.0:1784290397.145317:0:26257:0:(import.c:65:import_set_state_nolock()) ffff9c245fd78800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1784290397.145414:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1784290397.145425:0:26257:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968633 00000100:00100000:3.0:1784290397.145595:0:26257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f98ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+2:3616:x1870961901144192:12345-0@lo:9:umount.0 Request processed in 334us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290397.145607:0:26257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4966 00000100:00080000:2.0:1784290397.145655:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dce0800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784290397.145682:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784290397.145686:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784290397.145693:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901144192:0@lo:9:umount.0 00000020:00000080:0.0:1784290397.207311:0:6477:0:(genops.c:906:class_export_put()) final put ffff9c246dcfe000/711f3c77-e791-4aa8-86ee-bc854fd0bcc5 00000020:00000080:2.0:1784290397.207383:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dcfe000/711f3c77-e791-4aa8-86ee-bc854fd0bcc5 for lustre-MDT0000 00000020:00000080:1.0:1784290397.207393:0:6476:0:(genops.c:906:class_export_put()) final put ffff9c246dcfb800/lustre-MDT0001-mdtlov_UUID 00010000:00010000:1.0:1784290397.207419:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290397.207421:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290397.207425:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784290397.207469:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246d8ad800 for lustre-MDT0000 00000020:00000080:2.0:1784290397.207476:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dcfb800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00010000:00010000:0.0:1784290397.207495:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290397.207501:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290397.207503:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784290397.207545:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c247036a000 for lustre-MDT0000 00000020:00080000:3.0:1784290397.207838:0:93435:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9c23440d0000) has no exports 00000020:00000080:3.0:1784290397.252851:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074a05 00000020:00000080:3.0:1784290397.252872:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c2474ebb800/lustre-QMT0000_UUID 00000020:01000000:3.0:1784290397.252895:0:93435:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1784290397.252911:0:93435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784290397.252930:0:93435:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784290397.252936:0:93435:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9c23440d4d40) has no exports 00000020:00000080:2.0:1784290397.252997:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2474ebb800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1784290397.253315:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30749fe 00000020:00000080:3.0:1784290397.253337:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c2458843000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784290397.253427:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458843000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784290397.253463:0:93435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784290397.253473:0:93435:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1784290397.253477:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c23458de000/lustre-QMT0000_UUID 00000020:00000080:3.0:1784290397.253480:0:93435:0:(genops.c:865:class_export_destroy()) destroying export ffff9c23458de000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1784290397.253493:0:93435:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1784290397.253706:0:93435:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c23455821e0 - data ffff9c247091fbd0/ffff9c2474cb6000 00000020:01000000:3.0:1784290397.253875:0:93435:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c246d004f60 - data ffff9c24757c7870/ffff9c2475ddc400 00000100:00080000:1.0:1784290397.285722:0:93435:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784290397.285730:0:93435:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784290397.285746:0:93435:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c247d29d180 x1870961901143936/t81604378777(81604378777) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290407 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290397.285772:0:93435:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1784290397.286849:0:93435:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784290397.286853:0:93435:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968630 gen 4 00000004:00080000:1.0:1784290397.286865:0:93435:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784290397.286868:0:93435:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784290397.287041:0:92162:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784290397.287052:0:92162:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6c:0x0] index 1 count 1 00000040:00080000:3.0:1784290397.287072:0:92162:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 27 count 2 00000100:00080000:1.0:1784290397.288205:0:93435:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784290397.288209:0:93435:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968631 gen 4 00000004:00080000:1.0:1784290397.288231:0:93435:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784290397.288236:0:93435:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784290397.288565:0:92164:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784290397.288571:0:92164:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6e:0x0] index 1 count 1 00000040:00080000:3.0:1784290397.288585:0:92164:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 27 count 2 00000020:00000080:1.0:1784290397.289665:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30749bf 00000020:00000080:1.0:1784290397.289674:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c2344980000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784290397.289711:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2344980000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784290397.290430:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30749d4 00000020:00000080:1.0:1784290397.290435:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c246dcf9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784290397.290441:0:93435:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1784290397.290446:0:93435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784290397.290455:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dcf9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1784290397.290456:0:93435:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784290397.290462:0:93435:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9c246ff6b380) has no exports 00000004:01000000:1.0:1784290397.290681:0:93435:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1784290397.290687:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074a52 00000020:00000080:1.0:1784290397.290691:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c2458be9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784290397.290700:0:93435:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1784290397.290703:0:93435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784290397.290708:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458be9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784290397.290709:0:93435:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784290397.290715:0:93435:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9c247d268000) has no exports 00000020:00000080:1.0:1784290397.290720:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074a4b 00000020:00000080:1.0:1784290397.290723:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c246dce2800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784290397.290735:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dce2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1784290397.291074:0:93435:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1784290397.291077:0:93435:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784290397.291079:0:93435:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968631 gen 5 00000004:00080000:1.0:1784290397.291082:0:93435:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784290397.291084:0:93435:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784290397.291107:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246dce0800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784290397.291119:0:93435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290397.291126:0:93435:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784290397.291130:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c2458bef000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784290397.291132:0:93435:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458bef000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1784290397.291140:0:93435:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784290397.291203:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074a36 00000020:00000080:1.0:1784290397.291207:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c2458bec000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784290397.291215:0:93435:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1784290397.291218:0:93435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784290397.291222:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2458bec000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784290397.291223:0:93435:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1784290397.291229:0:93435:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9c2445c14d40) has no exports 00000020:00000080:1.0:1784290397.291232:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074a28 00000020:00000080:1.0:1784290397.291235:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c2474f86000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784290397.291248:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2474f86000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1784290397.291650:0:93435:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1784290397.291653:0:93435:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784290397.291655:0:93435:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968630 gen 5 00000004:00080000:1.0:1784290397.291658:0:93435:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1784290397.291665:0:93435:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784290397.291691:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2474f81800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784290397.291694:0:93435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290397.291700:0:93435:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784290397.291703:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c247e4b5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784290397.291705:0:93435:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247e4b5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1784290397.291709:0:93435:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1784290397.291743:0:93435:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1784290397.291747:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074a1a 00000020:00000080:1.0:1784290397.291751:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c247e4b6000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1784290397.291762:0:93435:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1784290397.291766:0:93435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784290397.291768:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247e4b6000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1784290397.291773:0:93435:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784290397.291778:0:93435:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9c23440d3380) has no exports 00000020:00000080:1.0:1784290397.291782:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074a13 00000020:00000080:1.0:1784290397.291787:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c23458d8800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1784290397.291801:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c23458d8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1784290397.294409:0:93435:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1784290397.294412:0:93435:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784290397.294414:0:93435:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784290397.294418:0:93435:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784290397.294445:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2458841000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1784290397.294446:0:93435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290397.294454:0:93435:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784290397.294458:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c2474f80000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784290397.294461:0:93435:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2474f80000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1784290397.294465:0:93435:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784290397.294511:0:93435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290397.294514:0:93435:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784290397.294516:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c2343900800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784290397.294518:0:93435:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343900800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1784290397.294522:0:93435:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784290397.294582:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30749db 00000020:00000080:1.0:1784290397.294586:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c246dcfb000/lustre-MDD0000_UUID 00000020:01000000:1.0:1784290397.294598:0:93435:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1784290397.294600:0:93435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784290397.294604:0:93435:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00000080:2.0:1784290397.294608:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dcfb000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00080000:1.0:1784290397.294608:0:93435:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9c23440d19c0) has no exports 00000020:00000080:1.0:1784290397.294626:0:93435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290397.294629:0:93435:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1784290397.294631:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c246dcf9800/lustre-MDD0000_UUID 00000020:00000080:1.0:1784290397.294633:0:93435:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dcf9800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1784290397.294636:0:93435:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1784290397.294656:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30749e2 00000020:00000080:1.0:1784290397.294659:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c246dcf8800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1784290397.294667:0:93435:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c246dd94000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1784290397.294670:0:93435:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c246dd94000 3 00000020:01000004:1.0:1784290397.294672:0:93435:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c246dd94000 from lustre-MDT0000 00000020:00000080:2.0:1784290397.294676:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dcf8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784290397.294693:0:93435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290397.294697:0:93435:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1784290397.294699:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c2344981000/lustre-MDT0000_UUID 00000020:00000080:1.0:1784290397.294701:0:93435:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2344981000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1784290397.294707:0:93435:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1784290397.294731:0:93435:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1784290397.294734:0:93435:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1784290397.294737:0:93435:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1784290397.294739:0:93435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784290397.294741:0:93435:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1784290397.294747:0:93435:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c246d8ab000 fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f 192.168.202.6@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784290397.294755:0:93435:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9c246d8a9800 2e54cd1c-9dbd-4e31-b60e-998135d46053 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784290397.294761:0:93435:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff9c246ff68000) has exports, disconnecting them 00000020:00080000:1.0:1784290397.294766:0:93435:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.6@tcp (ffff9c246d8ab000), last request at 1784290380 00000020:00000080:1.0:1784290397.294786:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074b63 00000020:00010000:1.0:1784290397.294793:0:93435:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c246d8ab000: total 0 00000100:00080000:1.0:1784290397.294799:0:93435:0:(import.c:65:import_set_state_nolock()) ffff9c2344b52000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784290397.294817:0:93435:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.6@tcp (ffff9c246d8ab000): rc 0 00000020:00080000:1.0:1784290397.294821:0:93435:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c246d8a9800), last request at 1784290378 00000020:00010000:2.0:1784290397.294824:0:8418:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c246d8ab000: total 0 00000020:00000080:1.0:1784290397.294868:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074980 00000020:00010000:1.0:1784290397.294874:0:93435:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c246d8a9800: total 0 00010000:00010000:2.0:1784290397.294875:0:8418:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c246d8ab000, canceled 0 locks, left on hash table 4. 00000100:00080000:1.0:1784290397.294876:0:93435:0:(import.c:65:import_set_state_nolock()) ffff9c246d8ab800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784290397.294890:0:93435:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c246d8a9800): rc 0 00000020:00080000:1.0:1784290397.294894:0:93435:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9c246ff68000) has no exports 00010000:00010000:2.0:1784290397.294907:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c23450ab600/0x5953bbf6b3074b78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2486 expref: 5 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:3.0:1784290397.294918:0:19681:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c246d8a9800: total 0 00010000:00010000:2.0:1784290397.294932:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247d2ffc00/0x5953bbf6b3074f30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24ef expref: 4 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290397.294951:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd26000/0x5953bbf6b3074b6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2478 expref: 3 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290397.294964:0:92154:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9c246dcb1600:92154] 3 exiting: rc = 0 00010000:00010000:2.0:1784290397.294986:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b3074f29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b24e8 expref: 2 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.295011:0:19681:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c246d8a9800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1784290397.295013:0:8418:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c246d8ab000, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1784290397.295073:0:8418:0:(genops.c:906:class_export_put()) final put ffff9c246d8ab000/fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f 00010000:00010000:3.0:1784290397.295075:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebfc00/0x5953bbf6b3074fa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074f99 expref: 14 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290397.295090:0:92149:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c245fdeec00:92149] 0 exiting: rc = 1 00010000:00010000:2.0:1784290397.295100:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290397.295111:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290397.295119:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290397.295155:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247f8cb200/0x5953bbf6b3074fae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074fa7 expref: 13 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290397.295187:0:92152:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c247c128800:92152] 2 exiting: rc = 0 00010000:00010000:3.0:1784290397.295194:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c24585bf600/0x5953bbf6b3074ac2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074abb expref: 12 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.295274:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd27600/0x5953bbf6b3074b40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074b39 expref: 11 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290397.295325:0:92151:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c2345cc6a00:92151] 1 exiting: rc = 0 00010000:00010000:3.0:1784290397.295337:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b3074f5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074f53 expref: 10 pid: 92154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290397.295425:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd27400/0x5953bbf6b3074b4e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074b47 expref: 9 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784290397.295436:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246d8ab000/fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f for MGS 00000100:00100000:1.0:1784290397.295455:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.295477:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.295503:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290397.295512:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd27a00/0x5953bbf6b3074aec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074ae5 expref: 8 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1784290397.295514:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2344b52000 for MGS 00000100:00100000:1.0:1784290397.295540:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290397.295584:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247f8cbe00/0x5953bbf6b3074f68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074f61 expref: 7 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290397.295586:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.295616:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290397.295644:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd27200/0x5953bbf6b3074ade lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074ad7 expref: 6 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290397.295646:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.295666:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.295688:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.295710:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290397.295719:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247f8caa00/0x5953bbf6b3074f76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074f6f expref: 5 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290397.295739:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.295766:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290397.295777:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247c263400/0x5953bbf6b3074b16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074b0f expref: 4 pid: 92152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290397.295799:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.295820:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290397.295837:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b3074f84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074f7d expref: 3 pid: 92151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290397.295852:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.295887:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290397.295904:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247f8ca600/0x5953bbf6b3074f92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3074f8b expref: 2 pid: 92149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290397.295924:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.295934:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.295956:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.295977:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290397.295979:0:19681:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c246d8a9800, canceled 13 locks, left on hash table 0. 00000100:00100000:1.0:1784290397.295991:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296012:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296037:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1784290397.296039:0:19681:0:(genops.c:906:class_export_put()) final put ffff9c246d8a9800/2e54cd1c-9dbd-4e31-b60e-998135d46053 00000100:00100000:1.0:1784290397.296054:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290397.296071:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290397.296078:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290397.296086:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1784290397.296091:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1784290397.296092:0:9947:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246d8a9800/2e54cd1c-9dbd-4e31-b60e-998135d46053 for MGS 00000100:00100000:1.0:1784290397.296103:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296118:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296129:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1784290397.296130:0:9947:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246d8ab800 for MGS 00000100:00100000:1.0:1784290397.296141:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296152:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296161:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296172:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296176:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296179:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296189:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296195:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296199:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296205:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296210:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296215:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296220:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296226:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296231:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296236:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296241:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296245:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296250:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296255:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296261:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296267:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296273:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296279:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296295:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296303:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296310:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296315:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296319:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296324:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296330:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296362:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296378:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296386:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296394:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784290397.296401:0:93435:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1784290397.297126:0:93435:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c246d0044e0 - data ffff9c247576a360/ffff9c2474cb5c00 00000020:01000000:1.0:1784290397.297268:0:93435:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c23420e5ae0 - data ffff9c23418e6288/ffff9c247c176c00 00000020:00000080:1.0:1784290397.297813:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074979 00000020:00000080:1.0:1784290397.297819:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c244a791000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1784290397.297832:0:93435:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c246dd94000 from MGS, refs=2 00000020:01000004:1.0:1784290397.297835:0:93435:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c246dd94000 2 00000020:01000004:1.0:1784290397.297837:0:93435:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c246dd94000 from MGS 00000020:00000080:2.0:1784290397.297840:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c244a791000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784290397.297859:0:93435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290397.297864:0:93435:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1784290397.297866:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c2343905800/MGS 00000020:00000080:1.0:1784290397.297868:0:93435:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2343905800/MGS for MGS 00000020:01000000:1.0:1784290397.297872:0:93435:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1784290397.297929:0:93435:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1784290397.297932:0:93435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784290397.297941:0:93435:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784290397.297944:0:93435:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c2341ea8800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784290397.297948:0:93435:0:(genops.c:1574:class_disconnect_exports()) OBD device 28 (ffff9c247d2699c0) has exports, disconnecting them 00000020:00080000:1.0:1784290397.297950:0:93435:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c2341ea8800), last request at 1784290378 00000020:00000080:1.0:1784290397.297953:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3074a91 00000020:00080000:1.0:1784290397.297962:0:93435:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2341ea8800): rc 0 00000020:00000080:1.0:1784290397.297965:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c2341ea8800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1784290397.297988:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2341ea8800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1784290397.300399:0:93435:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1784290397.300402:0:93435:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784290397.300405:0:93435:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784290397.300408:0:93435:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784290397.300425:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c246dce3000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784290397.300523:0:93435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290397.300534:0:93435:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1784290397.300537:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c246d8aa800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1784290397.300539:0:93435:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246d8aa800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1784290397.300543:0:93435:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1784290397.300578:0:93435:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c246dd94000 1 00000020:00000080:1.0:1784290397.300581:0:93435:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307496b 00000020:00000080:1.0:1784290397.300584:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c246dd92000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1784290397.300593:0:93435:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1784290397.300596:0:93435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784290397.300599:0:93435:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00000080:2.0:1784290397.300601:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dd92000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:1.0:1784290397.300603:0:93435:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9c246ff6cd40) has no exports 00000020:00000080:1.0:1784290397.313213:0:93435:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290397.313218:0:93435:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1784290397.313221:0:93435:0:(genops.c:906:class_export_put()) final put ffff9c246dd90000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784290397.313224:0:93435:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246dd90000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1784290397.313230:0:93435:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1784290397.313396:0:93435:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c246dd93800 00000020:02000400:1.0:1784290397.313444:0:93435:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1784290397.863560:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290398.887578:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290399.399683:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901144320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784290399.399697:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1870961901144576:0@lo:400:kworker.0 00000100:00100000:3.0:1784290399.399754:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901144448:0@lo:400:kworker.0 00000100:00100000:0.0:1784290399.399816:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290399.399834:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290399.399885:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901144576 00000400:00000100:3.0:1784290399.399890:0:3619:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870961901144448 offset 0 length 224: 4 00000100:00100000:1.0:1784290399.399900:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901144576 00000100:00100000:0.0:1784290399.399938:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901145088:0@lo:400:kworker.0 00000100:00100000:2.0:1784290399.399945:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1870961901144832:0@lo:400:kworker.0 00000100:00100000:1.0:1784290399.400034:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:0.0:1784290399.400034:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290399.400049:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901144960:0@lo:400:kworker.0 00000100:00100000:2.0:1784290399.400063:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290399.400077:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3620:x1870961901144576:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784290399.400100:0:66004:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784290399.400119:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901144832 00000100:00100000:0.0:1784290399.400130:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901144832 00000100:00100000:2.0:1784290399.400154:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901145344:0@lo:400:kworker.0 00000100:00100000:3.0:1784290399.400165:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290399.400202:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901144960 00000100:00100000:0.0:1784290399.400213:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901144960 00000100:00100000:1.0:1784290399.400224:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3620:x1870961901144576:12345-0@lo:400:kworker.0 Request processed in 150us (398us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784290399.400239:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:3.0:1784290399.400246:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961901145472:0@lo:400:kworker.0 00000100:00100000:2.0:1784290399.400303:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290399.400323:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:1.0:1784290399.400426:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:0.0:1784290399.400436:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901144960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290399.400448:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3618:x1870961901144832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290399.400464:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1784290399.400477:0:66004:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1784290399.400480:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784290399.400510:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901144704:0@lo:400:kworker.0 00000100:00100000:0.0:1784290399.400559:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901144960:12345-0@lo:400:kworker.0 Request processed in 217us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290399.400577:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:3.0:1784290399.400602:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901144960:0@lo:400:kworker.0 00000100:00100000:1.0:1784290399.400627:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3618:x1870961901144832:12345-0@lo:400:kworker.0 Request processed in 172us (579us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784290399.400633:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901145472 00000100:00100000:0.0:1784290399.400643:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901145472 00000100:00100000:2.0:1784290399.400646:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290399.400660:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:0.0:1784290399.400698:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901144704 00000100:00100000:0.0:1784290399.400705:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901144704 00000100:00100000:2.0:1784290399.400721:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901145216:0@lo:400:kworker.0 00000100:00100000:1.0:1784290399.400732:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:1.0:1784290399.400745:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1870961901145472:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784290399.400760:0:66004:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784290399.400793:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:2.0:1784290399.400807:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290399.400826:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f98aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901144704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290399.400844:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3619:x1870961901145472:12345-0@lo:400:kworker.0 Request processed in 94us (389us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784290399.400865:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00080000:3.0:1784290399.400915:0:3619:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1784290399.400926:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00080000:2.0:1784290399.400938:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1784290399.400941:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f98aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901144704:12345-0@lo:400:kworker.0 Request processed in 123us (302us total) trans 0 rc 0/0 00000100:02000400:3.0:1784290399.400943:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1784290399.400956:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901144320 00000100:00080000:3.0:1784290399.400970:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1784290399.400974:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901144320 00000100:00080000:2.0:1784290399.400975:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00080000:3.0:1784290399.401000:0:3619:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2125 00000100:02000400:2.0:1784290399.401008:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1784290399.401015:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00080000:3.0:1784290399.401025:0:3619:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00080000:2.0:1784290399.401026:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290399.401047:0:3618:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2125 00000100:00100000:1.0:1784290399.401054:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901145088 00000100:00100000:1.0:1784290399.401063:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901145088 00000100:00080000:2.0:1784290399.401068:0:3618:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290399.401074:0:26251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901145344 00000100:00100000:0.0:1784290399.401084:0:26251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901145344 00000100:00100000:3.0:1784290399.401089:0:3619:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c247d29d180 x1870961901145600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784290399.401110:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3884 00000100:00100000:1.0:1784290399.401130:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3618:x1870961901144320:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290399.401133:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c247f988380 x1870961901145728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784290399.401143:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961901145472:0@lo:400:kworker.0 00000020:00080000:1.0:1784290399.401149:0:23867:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784290399.401155:0:26251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901145216 00000100:00100000:0.0:1784290399.401174:0:26251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901145216 00000100:00100000:2.0:1784290399.401216:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1870961901144832:0@lo:400:kworker.0 00000100:00100000:3.0:1784290399.401233:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901145600:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1784290399.401250:0:26251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1604 00000100:00100000:1.0:1784290399.401292:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3618:x1870961901144320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (1436us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784290399.401293:0:26251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f98b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901145344:12345-0@lo:400:kworker.0 00000100:02020000:2.0:1784290399.401295:0:3618:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1784290399.401320:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1784290399.401329:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3884 00000100:00080000:2.0:1784290399.401332:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1784290399.401402:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1784290399.401416:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1784290399.401441:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784290399.401441:0:3618:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2125 00000100:00100000:1.0:1784290399.401442:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3885 00000100:00100000:0.0:1784290399.401465:0:26251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f98b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901145344:12345-0@lo:400:kworker.0 Request processed in 196us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290399.401478:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3620:x1870961901145088:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784290399.401479:0:3618:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290399.401494:0:26251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1604 00000020:00080000:1.0:1784290399.401504:0:23867:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1784290399.401509:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901145728:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1784290399.401542:0:26251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1605 00000100:00100000:2.0:1784290399.401544:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c247f989500 x1870961901145856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290399.401565:0:26251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901145216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290399.401600:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290399.401618:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3620:x1870961901145088:12345-0@lo:400:kworker.0 Request processed in 141us (1593us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784290399.401636:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3885 00000100:00100000:0.0:1784290399.401691:0:26251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901145216:12345-0@lo:400:kworker.0 Request processed in 129us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290399.401703:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901145856:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1784290399.401703:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901144704:0@lo:400:kworker.0 00000100:00100000:0.0:1784290399.401719:0:26251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1605 00000100:00080000:1.0:1784290399.401720:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784290399.401745:0:3620:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9c246dd98000 already not connected (conn 46, was 45): CONNECTING 00000100:00100000:1.0:1784290399.401757:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901145088:0@lo:400:kworker.0 00000100:00100000:2.0:1784290399.401794:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901145216:0@lo:400:kworker.0 00000100:00080000:1.0:1784290399.401813:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784290399.401820:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00080000:0.0:1784290399.401824:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:02000400:1.0:1784290399.401834:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784290399.401838:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784290399.401849:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290399.401855:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901145344:0@lo:400:kworker.0 00000100:00080000:0.0:1784290399.401855:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784290399.401858:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290399.401882:0:3620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2125 00000100:00080000:1.0:1784290399.401897:0:3620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290399.401897:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901145600 00000100:00100000:0.0:1784290399.401911:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901145600 00000100:00100000:1.0:1784290399.401957:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a542680 x1870961901145984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290399.401982:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901145728 00000100:00100000:0.0:1784290399.401989:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901145728 00000100:00100000:3.0:1784290399.402000:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:2.0:1784290399.402021:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901145856 00000100:00100000:1.0:1784290399.402024:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1870961901144576:0@lo:400:kworker.0 00000100:00100000:3.0:1784290399.402025:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901145600:12345-0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1784290399.402039:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901145856 00000100:00100000:0.0:1784290399.402046:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:0.0:1784290399.402077:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901145728:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1784290399.402098:0:74876:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:0.0:1784290399.402109:0:65989:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784290399.402121:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3886 00000100:00100000:1.0:1784290399.402131:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901145984:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1784290399.402147:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901145856:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1784290399.402184:0:8413:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784290399.402209:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901145600:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 194us (784us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290399.402226:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901145728:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 141us (631us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784290399.402250:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290399.402263:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:2.0:1784290399.402309:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901145856:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 162us (472us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290399.402317:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:3.0:1784290399.402409:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901145984 00000100:00100000:2.0:1784290399.402412:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3886 00000100:00080000:1.0:1784290399.402413:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1784290399.402423:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901145984 00000100:00080000:1.0:1784290399.402429:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784290399.402439:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901145856:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:1.0:1784290399.402479:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784290399.402495:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290399.402502:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:1.0:1784290399.402510:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901145600:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1784290399.402527:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1870961901145984:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1784290399.402550:0:65988:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1784290399.402551:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784290399.402564:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784290399.402572:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f988380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901145728:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1784290399.402626:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1870961901145984:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 106us (396us total) trans 0 rc -19/-19 00000100:00080000:1.0:1784290399.402637:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1784290399.402638:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00080000:1.0:1784290399.402654:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784290399.402673:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901145984:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:0.0:1784290399.912090:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784290399.913840:0:75386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1784290399.913860:0:75386:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378777 is committed 00000020:00000080:3.0:1784290399.913868:0:75386:0:(genops.c:906:class_export_put()) final put ffff9c24481c7000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1784290399.913936:0:75386:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378776 is committed 00000020:00000080:1.0:1784290399.914000:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c24481c7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00010000:00010000:2.0:1784290399.914037:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5c800/0x5953bbf6b30751ad lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914061:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5c800/0x5953bbf6b30751ad lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914074:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5c800/0x5953bbf6b30751ad lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914084:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5c800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290399.914094:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5c800/0x5953bbf6b30751ad lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914108:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5c800/0x5953bbf6b30751ad lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784290399.914118:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c24481c6800 for lustre-MDT0001 00010000:00010000:2.0:1784290399.914141:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x9add8152 (ffff9c2442ffe100) 00010000:00010000:2.0:1784290399.914149:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290399.914157:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5c800/0x5953bbf6b30751ad lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914167:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2458d5c800/0x5953bbf6b30751ad lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914214:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf800/0x5953bbf6b30751c2 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914248:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf800/0x5953bbf6b30751c2 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914282:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf800/0x5953bbf6b30751c2 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914296:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290399.914303:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf800/0x5953bbf6b30751c2 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914318:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf800/0x5953bbf6b30751c2 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914338:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9c2475800200) 00010000:00010000:2.0:1784290399.914430:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290399.914440:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf800/0x5953bbf6b30751c2 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914453:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf800/0x5953bbf6b30751c2 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914485:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d800/0x5953bbf6b3075208 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914502:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d800/0x5953bbf6b3075208 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914516:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d800/0x5953bbf6b3075208 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914541:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290399.914562:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d800/0x5953bbf6b3075208 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914572:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d800/0x5953bbf6b3075208 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914585:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x9add8152 (ffff9c2442ffe500) 00010000:00010000:2.0:1784290399.914588:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290399.914592:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d800/0x5953bbf6b3075208 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914600:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c234236d800/0x5953bbf6b3075208 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914624:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf400/0x5953bbf6b307521d lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914632:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf400/0x5953bbf6b307521d lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914641:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf400/0x5953bbf6b307521d lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914647:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290399.914651:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf400/0x5953bbf6b307521d lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914658:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf400/0x5953bbf6b307521d lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914666:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff9c2475800c00) 00010000:00010000:2.0:1784290399.914669:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290399.914681:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf400/0x5953bbf6b307521d lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290399.914689:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2345ebf400/0x5953bbf6b307521d lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00000400:00000100:2.0:1784290400.773670:0:3612:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.6@tcp portal 26 match 1870961896274176 offset 0 length 224: 4 00000100:00100000:2.0:1784290400.773721:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290400.773753:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290400.773781:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290400.773795:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896274304 00000100:00100000:0.0:1784290400.773810:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896274304 00000100:00100000:2.0:1784290400.773816:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290400.773861:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896274560 00000100:00100000:2.0:1784290400.773861:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896274688 00000100:00100000:2.0:1784290400.773867:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896274688 00000100:00100000:1.0:1784290400.773867:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896274432 00000100:00100000:3.0:1784290400.773869:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896274560 00000100:00100000:1.0:1784290400.773886:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896274432 00000100:00100000:0.0:1784290400.773917:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1275 00000100:00100000:0.0:1784290400.773930:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1870961896274304:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290400.773942:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1606 00000020:00080000:0.0:1784290400.773949:0:65989:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.6@tcp 00000100:00100000:3.0:1784290400.773956:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1607 00000100:00100000:2.0:1784290400.773957:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2399:x1870961896274688:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290400.773982:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2400:x1870961896274560:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290400.774004:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 740 00000100:00100000:1.0:1784290400.774025:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:2399:x1870961896274432:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290400.774059:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f989f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2399:x1870961896274688:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 107us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290400.774063:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f98b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2400:x1870961896274304:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 130us (336us total) trans 0 rc -107/-107 00000100:00100000:3.0:1784290400.774065:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2400:x1870961896274560:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 94us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290400.774081:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1606 00000100:00100000:0.0:1784290400.774086:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1275 00000100:00100000:3.0:1784290400.774092:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1607 00000100:00100000:1.0:1784290400.774151:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:2399:x1870961896274432:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 130us (391us total) trans 0 rc 0/0 00000100:00080000:2.0:1784290400.774156:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1784290400.774172:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290400.774181:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 740 00000100:00080000:2.0:1784290400.774184:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290400.775393:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290400.775447:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896274816 00000100:00100000:2.0:1784290400.775453:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896274816 00000100:00100000:2.0:1784290400.775483:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1276 00000100:00100000:2.0:1784290400.775489:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1870961896274816:12345-192.168.202.6@tcp:38:ptlrpcd_01_01.0 00010000:00020000:2.0:1784290400.775531:0:65988:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784290400.775581:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1870961896274816:12345-192.168.202.6@tcp:38:ptlrpcd_01_01.0 Request processed in 90us (188us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290400.775615:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1276 00010000:00010000:2.0:1784290400.935515:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290401.447617:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f98bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901146112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784290401.447658:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901146240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290401.447792:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290401.447889:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901146112 00000100:00100000:2.0:1784290401.447902:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901146112 00000100:00100000:1.0:1784290401.448009:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290401.448032:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901146240 00000100:00100000:2.0:1784290401.448037:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901146240 00000100:00100000:3.0:1784290401.448086:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:2.0:1784290401.448116:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:2.0:1784290401.448129:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901146240:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1784290401.448148:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784290401.448156:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1784290401.448178:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290401.448241:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901146112:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784290401.448275:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901146240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 147us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290401.448284:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:1.0:1784290401.448418:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901146240:0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1784290401.448605:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784290401.448688:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901146112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 583us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290401.448708:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:1.0:1784290401.448756:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f98bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901146112:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1784290401.959558:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784290401.960362:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784290401.960368:0:9482:0:(genops.c:906:class_export_put()) final put ffff9c245fd7e000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1784290401.960396:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968633 is committed 00000020:00000080:1.0:1784290401.960435:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c245fd7e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1784290401.960526:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c245fd78800 for lustre-OST0001 00000001:00100000:2.0:1784290402.472675:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784290402.472685:0:8397:0:(genops.c:906:class_export_put()) final put ffff9c245fd7a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784290402.472736:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c245fd7a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1784290402.472798:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c245fd7c800 for lustre-OST0000 00010000:00010000:2.0:1784290402.983610:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290404.007526:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784290404.519525:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290404.519536:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:2.0:1784290404.519540:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901146368:0@lo:400:kworker.0 00000100:00080000:1.0:1784290404.519542:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290404.519555:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2140 00000100:00080000:1.0:1784290404.519563:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784290404.519595:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000400:00000100:2.0:1784290404.519610:0:3618:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870961901146368 offset 0 length 224: 4 00000100:00100000:1.0:1784290404.519628:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a543b80 x1870961901146496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784290404.519698:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1784290404.519701:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901146496:0@lo:38:kworker.0 00000100:00080000:1.0:1784290404.519704:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290404.519709:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1784290404.519716:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1870961901146624:0@lo:400:kworker.0 00000100:00080000:1.0:1784290404.519717:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2140 00000100:00080000:1.0:1784290404.519723:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1784290404.519731:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290404.519750:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a543800 x1870961901146752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784290404.519770:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784290404.519788:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290404.519794:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290404.519797:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290404.519804:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2140 00000100:00080000:1.0:1784290404.519807:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1784290404.519811:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901146496 00000100:00100000:2.0:1784290404.519813:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290404.519817:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901146752:0@lo:38:kworker.0 00000100:00080000:1.0:1784290404.519818:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290404.519823:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901146496 00000100:00100000:1.0:1784290404.519843:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c234434d500 x1870961901147008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290404.519844:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784290404.519855:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901146880:0@lo:400:kworker.0 00000100:00100000:0.0:1784290404.519871:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901146624 00000100:00100000:3.0:1784290404.519874:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290404.519875:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901146624 00000100:00100000:2.0:1784290404.519898:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901146752 00000100:00100000:2.0:1784290404.519903:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901146752 00000100:00080000:1.0:1784290404.519903:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290404.519910:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290404.519914:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290404.519920:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2140 00000100:00100000:3.0:1784290404.519924:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901147008:0@lo:38:kworker.0 00000100:00080000:1.0:1784290404.519926:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1784290404.519930:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00080000:1.0:1784290404.519939:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290404.519948:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:2.0:1784290404.519958:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901146496:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290404.519958:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f98bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1870961901146624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290404.519967:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290404.519973:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c234434f100 x1870961901147392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00020000:2.0:1784290404.519993:0:66004:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784290404.520005:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901147392:0@lo:38:kworker.0 00000100:00100000:1.0:1784290404.520012:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901147264:0@lo:400:kworker.0 00000100:00100000:0.0:1784290404.520032:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f98bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1870961901146624:12345-0@lo:400:kworker.0 Request processed in 82us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290404.520041:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00100000:2.0:1784290404.520049:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901146496:12345-0@lo:38:kworker.0 Request processed in 93us (281us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290404.520056:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00100000:3.0:1784290404.520063:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290404.520071:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:1.0:1784290404.520076:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290404.520077:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901147392 00000100:00100000:0.0:1784290404.520083:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901146752:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784290404.520084:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901147392 00010000:00020000:0.0:1784290404.520098:0:65989:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784290404.520103:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00080000:3.0:1784290404.520106:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:2.0:1784290404.520111:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901147392:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1784290404.520122:0:66004:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784290404.520122:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:3.0:1784290404.520127:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290404.520130:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901146752:12345-0@lo:38:kworker.0 Request processed in 49us (261us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784290404.520137:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901146496:0@lo:38:kworker.0 00000100:00100000:1.0:1784290404.520138:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901147136:0@lo:400:kworker.0 00000100:00100000:0.0:1784290404.520142:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:2.0:1784290404.520159:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901147392:12345-0@lo:38:kworker.0 Request processed in 48us (99us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290404.520166:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:0.0:1784290404.520180:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901147008 00000100:00080000:3.0:1784290404.520181:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1784290404.520187:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901147008 00000100:00080000:3.0:1784290404.520191:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784290404.520192:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290404.520201:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901147392:0@lo:38:kworker.0 00000100:00100000:0.0:1784290404.520247:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3887 00000100:00080000:3.0:1784290404.520253:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1784290404.520257:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901147008:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784290404.520261:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784290404.520263:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1784290404.520270:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901146752:0@lo:38:kworker.0 00010000:00020000:0.0:1784290404.520275:0:8412:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784290404.520287:0:26260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901147264 00000100:00100000:1.0:1784290404.520294:0:26260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901147264 00000100:00100000:2.0:1784290404.520307:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1870961901146624:0@lo:400:kworker.0 00000100:00100000:0.0:1784290404.520321:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901147008:12345-0@lo:38:kworker.0 Request processed in 65us (353us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290404.520329:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3887 00000100:00080000:3.0:1784290404.520333:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784290404.520373:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784290404.520374:0:26260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901147136 00000100:00100000:1.0:1784290404.520379:0:26260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901147136 00000100:00100000:2.0:1784290404.520381:0:26254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1608 00000100:00100000:3.0:1784290404.520391:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901147008:0@lo:38:kworker.0 00000100:00100000:2.0:1784290404.520397:0:26254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901147264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290404.520431:0:26260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1609 00000100:00100000:2.0:1784290404.520441:0:26254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901147264:12345-0@lo:400:kworker.0 Request processed in 50us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290404.520445:0:26260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901147136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290404.520452:0:26254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1608 00000100:00100000:0.0:1784290404.520454:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901146880 00000100:00100000:0.0:1784290404.520460:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901146880 00000100:00080000:3.0:1784290404.520466:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784290404.520474:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784290404.520478:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784290404.520508:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:1.0:1784290404.520510:0:26260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901147136:12345-0@lo:400:kworker.0 Request processed in 66us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290404.520518:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901146880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290404.520524:0:26260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1609 00000100:00100000:0.0:1784290404.520562:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901146880:12345-0@lo:400:kworker.0 Request processed in 46us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290404.520569:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:1.0:1784290404.520581:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901147136:0@lo:400:kworker.0 00000100:00100000:2.0:1784290404.520607:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901146880:0@lo:400:kworker.0 00000100:00100000:1.0:1784290404.520607:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901147264:0@lo:400:kworker.0 00010000:00010000:0.0:1784290405.031590:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1784290405.894263:0:3610:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.6@tcp portal 26 match 1870961896274944 offset 0 length 224: 4 00000100:00100000:0.0:1784290405.894332:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290405.894418:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290405.894436:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896275200 00000100:00100000:2.0:1784290405.894453:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896275200 00000100:00100000:0.0:1784290405.894468:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290405.894541:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290405.894594:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896275456 00000100:00100000:3.0:1784290405.894608:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896275456 00000100:00100000:2.0:1784290405.894611:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896275072 00000100:00100000:2.0:1784290405.894620:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896275072 00000100:00100000:0.0:1784290405.894625:0:26259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896275328 00000100:00100000:0.0:1784290405.894636:0:26259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896275328 00000100:00100000:2.0:1784290405.894670:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 743 00000100:00100000:2.0:1784290405.894690:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:2398:x1870961896275200:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290405.894738:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1610 00000100:00100000:0.0:1784290405.894756:0:26259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1611 00000100:00100000:3.0:1784290405.894768:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2398:x1870961896275456:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290405.894773:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1280 00000100:00100000:0.0:1784290405.894784:0:26259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2397:x1870961896275328:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290405.894815:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1870961896275072:12345-192.168.202.6@tcp:38:kworker.0 00010000:00020000:1.0:1784290405.894863:0:66008:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784290405.894919:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2398:x1870961896275456:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 154us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290405.894920:0:26259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2397:x1870961896275328:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 140us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290405.894922:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:2398:x1870961896275200:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 223us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290405.894954:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1610 00000100:00100000:2.0:1784290405.894969:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 743 00000100:00100000:1.0:1784290405.894969:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2396:x1870961896275072:12345-192.168.202.6@tcp:38:kworker.0 Request processed in 161us (418us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290405.894970:0:26259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1611 00000100:00100000:1.0:1784290405.895002:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1280 00000100:00080000:3.0:1784290405.895007:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784290405.895017:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784290405.895029:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1784290406.055577:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290406.567535:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901147648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784290406.567535:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901147520:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290406.567629:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290406.567666:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901147648 00000100:00100000:0.0:1784290406.567678:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901147648 00000100:00100000:2.0:1784290406.567680:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290406.567709:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901147520 00000100:00100000:1.0:1784290406.567714:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901147520 00000100:00080000:3.0:1784290406.567740:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784290406.567748:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784290406.567755:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:1.0:1784290406.567767:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:0.0:1784290406.567778:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901147648:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290406.567780:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901147520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784290406.567821:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00002000:00000024:0.0:1784290406.567821:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290406.567881:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901147520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290406.567886:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901147648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 119us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290406.567893:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00100000:0.0:1784290406.567899:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:3.0:1784290406.567932:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a541880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901147648:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290406.567949:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f989500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901147520:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1784290407.079548:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290408.103622:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290409.127461:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784290409.639458:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290409.639467:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290409.639472:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290409.639485:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2145 00000100:00080000:1.0:1784290409.639492:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784290409.639501:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290409.639511:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901147776:0@lo:400:kworker.0 00000100:00100000:1.0:1784290409.639532:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c234434e680 x1870961901147904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784290409.639588:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290409.639597:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000400:00000100:3.0:1784290409.639599:0:3617:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870961901147776 offset 0 length 224: 4 00000100:00080000:1.0:1784290409.639602:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784290409.639604:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901147904:0@lo:38:kworker.0 00000100:00080000:1.0:1784290409.639615:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2145 00000100:00080000:1.0:1784290409.639622:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784290409.639626:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290409.639643:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c234434ce00 x1870961901148160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784290409.639690:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:3.0:1784290409.639691:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784290409.639695:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784290409.639706:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290409.639709:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290409.639718:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2145 00000100:00100000:3.0:1784290409.639719:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901148032:0@lo:400:kworker.0 00000100:00080000:1.0:1784290409.639723:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784290409.639732:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290409.639750:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901148160:0@lo:38:kworker.0 00000100:00100000:1.0:1784290409.639760:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c234434d500 x1870961901148416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784290409.639795:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784290409.639813:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290409.639817:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290409.639819:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290409.639827:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2145 00000100:00080000:1.0:1784290409.639831:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1784290409.639836:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290409.639841:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901147904 00000100:00100000:1.0:1784290409.639858:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2445d6ea00 x1870961901148800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290409.639864:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901147904 00000100:00100000:3.0:1784290409.639873:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901148672:0@lo:400:kworker.0 00000100:00100000:0.0:1784290409.639928:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901148032 00000100:00100000:1.0:1784290409.639936:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901148288:0@lo:400:kworker.0 00000100:00100000:0.0:1784290409.639937:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901148032 00000100:00100000:3.0:1784290409.639948:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290409.640011:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:3.0:1784290409.640032:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901148544:0@lo:400:kworker.0 00000100:00100000:1.0:1784290409.640038:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290409.640039:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901148032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290409.640132:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290409.640135:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901148288 00000100:00100000:1.0:1784290409.640146:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901148288 00000100:00100000:0.0:1784290409.640155:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901148032:12345-0@lo:400:kworker.0 Request processed in 127us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290409.640170:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00100000:0.0:1784290409.640236:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:0.0:1784290409.640251:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901148288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290409.640252:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:3.0:1784290409.640272:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901147904:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1784290409.640298:0:65990:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290409.640400:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901148288:12345-0@lo:400:kworker.0 Request processed in 95us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290409.640413:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1870961901147904:12345-0@lo:38:kworker.0 Request processed in 143us (721us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784290409.640415:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901148288:0@lo:400:kworker.0 00000100:00100000:0.0:1784290409.640420:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:3.0:1784290409.640444:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00080000:0.0:1784290409.640514:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784290409.640518:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901148672 00000100:00100000:3.0:1784290409.640519:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901148544 00000100:00100000:1.0:1784290409.640524:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901148672 00000100:00100000:3.0:1784290409.640530:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901148544 00000100:00100000:0.0:1784290409.640543:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290409.640595:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1612 00000100:00100000:3.0:1784290409.640614:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1613 00000100:00100000:1.0:1784290409.640622:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901148672:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784290409.640624:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1784290409.640636:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a543b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901148544:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784290409.640637:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290409.640648:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901147904:0@lo:38:kworker.0 00000100:00100000:0.0:1784290409.640695:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234434d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901148416:0@lo:38:kworker.0 00000100:00100000:1.0:1784290409.640709:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901148672:12345-0@lo:400:kworker.0 Request processed in 95us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290409.640718:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1612 00000100:00100000:3.0:1784290409.640738:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a543b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901148544:12345-0@lo:400:kworker.0 Request processed in 105us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290409.640752:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1613 00000100:00100000:0.0:1784290409.640759:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784290409.640762:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784290409.640771:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784290409.640807:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901148160 00000100:00100000:0.0:1784290409.640807:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901148800:0@lo:38:kworker.0 00000100:00100000:1.0:1784290409.640819:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901148160 00000100:00100000:3.0:1784290409.640826:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901148416 00000100:00100000:3.0:1784290409.640835:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901148416 00000100:00100000:0.0:1784290409.640855:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290409.640862:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:1.0:1784290409.640874:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901148160:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784290409.640892:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3888 00010000:00020000:1.0:1784290409.640899:0:66008:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784290409.640905:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901148416:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290409.640909:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901148800 00000100:00100000:0.0:1784290409.640916:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901148800 00010000:00020000:2.0:1784290409.640923:0:8413:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784290409.640950:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901148544:0@lo:400:kworker.0 00000100:00100000:0.0:1784290409.640956:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:0.0:1784290409.640973:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901148800:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784290409.640981:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901148160:12345-0@lo:38:kworker.0 Request processed in 106us (441us total) trans 0 rc -19/-19 00010000:00020000:0.0:1784290409.640991:0:66004:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784290409.641002:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:2.0:1784290409.641006:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901148416:12345-0@lo:38:kworker.0 Request processed in 90us (236us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784290409.641017:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901148672:0@lo:400:kworker.0 00000100:00100000:2.0:1784290409.641021:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3888 00000100:00100000:3.0:1784290409.641070:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901148032:0@lo:400:kworker.0 00000100:00100000:0.0:1784290409.641078:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901148800:12345-0@lo:38:kworker.0 Request processed in 105us (220us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784290409.641094:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00080000:1.0:1784290409.641105:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784290409.641114:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784290409.641122:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901148416:0@lo:38:kworker.0 00000100:00080000:1.0:1784290409.641143:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784290409.641152:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784290409.641155:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901148800:0@lo:38:kworker.0 00000100:00080000:1.0:1784290409.641197:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784290409.641201:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1784290409.641207:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901148160:0@lo:38:kworker.0 00010000:00010000:3.0:1784290410.151832:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1784290411.013486:0:3611:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-192.168.202.6@tcp portal 26 match 1870961896275584 offset 0 length 224: 4 00000100:00100000:2.0:1784290411.013556:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290411.013617:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290411.013649:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290411.013694:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896275840 00000100:00100000:2.0:1784290411.013707:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290411.013708:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896275840 00000100:00100000:3.0:1784290411.013720:0:15642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896275968 00000100:00100000:1.0:1784290411.013727:0:26261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896276096 00000100:00100000:3.0:1784290411.013734:0:15642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896275968 00000100:00100000:1.0:1784290411.013737:0:26261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896276096 00000100:00100000:2.0:1784290411.013796:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896275712 00000100:00100000:2.0:1784290411.013807:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896275712 00000100:00100000:0.0:1784290411.013821:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 746 00000100:00100000:0.0:1784290411.013844:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:2399:x1870961896275840:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290411.013855:0:15642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1614 00000100:00100000:1.0:1784290411.013880:0:26261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1615 00000100:00100000:3.0:1784290411.013884:0:15642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2400:x1870961896275968:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290411.013885:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1284 00000100:00100000:1.0:1784290411.013906:0:26261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2399:x1870961896276096:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290411.013917:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1870961896275712:12345-192.168.202.6@tcp:38:kworker.0 00010000:00020000:2.0:1784290411.013953:0:65990:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290411.013955:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f989500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:2399:x1870961896275840:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 115us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290411.013978:0:15642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2400:x1870961896275968:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 105us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290411.013980:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 746 00000100:00100000:1.0:1784290411.013988:0:26261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2399:x1870961896276096:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 89us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290411.014018:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1870961896275712:12345-192.168.202.6@tcp:38:kworker.0 Request processed in 96us (311us total) trans 0 rc -19/-19 00000100:00080000:0.0:1784290411.014022:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784290411.014034:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784290411.014037:0:15642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1614 00000100:00080000:0.0:1784290411.014046:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784290411.014053:0:26261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1615 00000100:00100000:2.0:1784290411.014073:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1284 00010000:00010000:2.0:1784290411.175493:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290411.687571:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901148928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784290411.687665:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290411.687743:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901148928 00000100:00100000:1.0:1784290411.687757:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901148928 00000100:00080000:0.0:1784290411.687809:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784290411.687846:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00000100:00100000:1.0:1784290411.687862:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901148928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784290411.687900:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784290411.687999:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901148928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 141us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290411.688008:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00000100:00100000:0.0:1784290411.688036:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901148928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1784290411.688424:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784290411.688437:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901149056:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784290411.688469:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290411.688515:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901149056 00000100:00100000:1.0:1784290411.688522:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901149056 00000100:00080000:0.0:1784290411.688553:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290411.688591:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:1.0:1784290411.688604:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901149056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784290411.688626:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290411.688683:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901149056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290411.688693:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00100000:0.0:1784290411.688712:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901149056:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1784290412.200455:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784290412.342300:0:94052:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784290412.342305:0:94052:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1784290412.342307:0:94052:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1784290412.342478:0:94052:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9c247e403000 00000020:01000004:3.0:1784290412.342502:0:94052:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1784290412.342524:0:94052:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1784290412.342561:0:94052:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c2474fd19c0) 00000020:00000080:3.0:1784290412.342587:0:94052:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1784290412.396103:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1784290412.396630:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1784290412.400180:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1784290412.401797:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1784290412.401988:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1784290412.402240:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1784290412.402453:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1784290412.402703:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1784290412.402914:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1784290412.403094:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1784290412.403317:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1784290412.403525:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1784290412.403711:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1784290412.403921:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1784290412.404089:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1784290412.404317:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1784290412.404545:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1784290412.404723:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1784290412.404943:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1784290412.405186:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1784290412.405390:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1784290412.405576:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1784290412.405743:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1784290412.405932:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1784290412.406088:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1784290412.406312:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1784290412.406561:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1784290412.406760:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1784290412.406933:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1784290412.407133:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1784290412.407365:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1784290412.407574:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1784290412.407752:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1784290412.407924:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1784290412.408112:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1784290412.408783:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1784290412.408948:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1784290412.409335:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1784290412.409644:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1784290412.409864:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1784290412.410076:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1784290412.410268:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1784290412.410428:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1784290412.410596:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1784290412.410763:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1784290412.410926:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1784290412.411164:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1784290412.411752:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1784290412.412069:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1784290412.412292:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1784290412.412644:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1784290412.412835:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1784290412.413026:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1784290412.413077:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00100000:10000000:1.0:1784290412.413108:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x50:0x0] (8/32) registered 00100000:10000000:1.0:1784290412.413141:0:94052:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00080000:01000000:1.0:1784290412.413663:0:94052:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1784290412.413910:0:94052:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1784290412.413919:0:94052:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784290412.413931:0:94052:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3075232 00000020:01000004:1.0:1784290412.413938:0:94052:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1784290412.413954:0:94052:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1784290412.413959:0:94052:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c247e403000 from MGS 00000020:01000004:1.0:1784290412.413963:0:94052:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1784290412.413975:0:94052:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c23440d0000) 00000020:00000080:1.0:1784290412.413986:0:94052:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:1.0:1784290412.414062:0:94052:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c247e403000 from MGS, refs=2 00080000:01000000:1.0:1784290412.414067:0:94052:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784290412.414071:0:94052:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3075240 00010000:00010000:1.0:1784290412.414220:0:94052:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1784290412.416767:0:94052:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1784290412.417363:0:94056:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1784290412.417392:0:94052:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1784290412.417481:0:94052:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784290412.418142:0:94052:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1784290412.418755:0:94052:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784290412.419029:0:94052:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1784290412.419048:0:94052:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1784290412.419725:0:94052:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1784290412.419738:0:94052:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1784290412.420060:0:94052:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1784290412.420071:0:94052:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1784290412.420620:0:94052:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1784290412.420652:0:94052:0:(obd_mount.c:392:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1784290412.420654:0:94052:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.106@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1784290412.420657:0:94052:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.106@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:1.0:1784290412.420664:0:94052:0:(import.c:65:import_set_state_nolock()) ffff9c2447cad800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1784290412.420671:0:94052:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1784290412.420676:0:94052:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.106@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1784290412.420678:0:94052:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1784290412.420688:0:94052:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c2469c8bb80 x1870961901144448/t0(0) o400->MGC192.168.202.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784290415 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290412.420725:0:94052:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c246a542300 x1870961901146368/t0(0) o400->MGC192.168.202.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784290420 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290412.420738:0:94052:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c234434c380 x1870961901147776/t0(0) o400->MGC192.168.202.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784290425 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1784290412.420760:0:94052:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1784290412.420771:0:94052:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1784290412.420774:0:94052:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1784290412.420781:0:94052:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:2.0:1784290412.420819:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901144448:0@lo:400:kworker.0 00000100:00100000:0.0:1784290412.420830:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901146368:0@lo:400:kworker.0 00000100:00100000:1.0:1784290412.420843:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234434c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901147776:0@lo:400:kworker.0 10000000:01000000:1.0:1784290412.420908:0:94052:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1784290412.420925:0:94052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c24585bf200/0x5953bbf6b3074b47 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3074b4e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290412.420937:0:94052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c24585bf200/0x5953bbf6b3074b47 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3074b4e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290412.420942:0:94052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1784290412.420958:0:94052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290412.420970:0:94052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c24585bf200/0x5953bbf6b3074b47 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3074b4e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.421005:0:94052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff400/0x5953bbf6b3074f53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3074f5a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290412.421013:0:94052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff400/0x5953bbf6b3074f53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3074f5a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290412.421018:0:94052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290412.421030:0:94052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290412.421034:0:94052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff400/0x5953bbf6b3074f53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3074f5a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.421060:0:94052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3074f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3074f68 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290412.421070:0:94052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3074f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3074f68 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290412.421082:0:94052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290412.421099:0:94052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290412.421103:0:94052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3074f61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3074f68 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.421115:0:94052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c000/0x5953bbf6b3074f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3074f76 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290412.421121:0:94052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c000/0x5953bbf6b3074f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3074f76 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290412.421126:0:94052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290412.421135:0:94052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290412.421139:0:94052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c000/0x5953bbf6b3074f6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3074f76 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.421161:0:94052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d000/0x5953bbf6b3074f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3074f84 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290412.421168:0:94052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d000/0x5953bbf6b3074f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3074f84 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290412.421173:0:94052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290412.421183:0:94052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290412.421186:0:94052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d000/0x5953bbf6b3074f7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3074f84 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.421213:0:94052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2458d5ca00/0x5953bbf6b3074f8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3074f92 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290412.421230:0:94052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2458d5ca00/0x5953bbf6b3074f8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3074f92 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290412.421235:0:94052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290412.421249:0:94052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290412.421252:0:94052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2458d5ca00/0x5953bbf6b3074f8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3074f92 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.421261:0:94052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d800/0x5953bbf6b3074f99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3074fa0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290412.421268:0:94052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d800/0x5953bbf6b3074f99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3074fa0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290412.421273:0:94052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290412.421283:0:94052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290412.421291:0:94052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2458d5d800/0x5953bbf6b3074f99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3074fa0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.421307:0:94052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c600/0x5953bbf6b3074fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3074fae expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290412.421312:0:94052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c600/0x5953bbf6b3074fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3074fae expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290412.421316:0:94052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290412.421324:0:94052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290412.421327:0:94052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c2458d5c600/0x5953bbf6b3074fa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3074fae expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.421479:0:94052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247c262800/0x5953bbf6b3074abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3074ac2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290412.421486:0:94052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247c262800/0x5953bbf6b3074abb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3074ac2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290412.421492:0:94052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290412.421507:0:94052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290412.421513:0:94052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247c262800/0x5953bbf6b3074abb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3074ac2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.421551:0:94052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c24585be800/0x5953bbf6b3074ad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3074ade expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290412.421558:0:94052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c24585be800/0x5953bbf6b3074ad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3074ade expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290412.421563:0:94052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290412.421574:0:94052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290412.421578:0:94052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c24585be800/0x5953bbf6b3074ad7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3074ade expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.421620:0:94052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c24585bfc00/0x5953bbf6b3074ae5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3074aec expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290412.421627:0:94052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c24585bfc00/0x5953bbf6b3074ae5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3074aec expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290412.421633:0:94052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784290412.421654:0:94052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290412.421666:0:94052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c24585bfc00/0x5953bbf6b3074ae5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3074aec expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.421685:0:94052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c24585be600/0x5953bbf6b3074b0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3074b16 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290412.421690:0:94052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c24585be600/0x5953bbf6b3074b0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3074b16 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290412.421694:0:94052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784290412.421705:0:94052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290412.421714:0:94052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c24585be600/0x5953bbf6b3074b0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3074b16 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.421730:0:94052:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c246dd26c00/0x5953bbf6b3074b39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x5953bbf6b3074b40 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290412.421736:0:94052:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c246dd26c00/0x5953bbf6b3074b39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x5953bbf6b3074b40 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290412.421741:0:94052:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784290412.421754:0:94052:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1784290412.421759:0:94052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c246dd26c00/0x5953bbf6b3074b39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x5953bbf6b3074b40 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784290412.421800:0:94052:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c2447cad800 already not connected (conn 51, was 0): DISCONN 00000100:00080000:1.0:1784290412.421806:0:94052:0:(import.c:65:import_set_state_nolock()) ffff9c2447cad800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290412.421812:0:94052:0:(import.c:510:import_select_connection()) MGC192.168.202.106@tcp: connect to NID 0@lo last attempt 2120 00000100:00080000:1.0:1784290412.421820:0:94052:0:(import.c:624:import_select_connection()) MGC192.168.202.106@tcp: import ffff9c2447cad800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290412.421859:0:94052:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2445d6ea00 x1870961901149184/t0(0) o250->MGC192.168.202.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784290412.421884:0:94052:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1784290412.421941:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e54cd1c-9dbd-4e31-b60e-998135d46053:3616:1870961901149184:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1784290412.422023:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290412.422087:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901149184 00000100:00100000:1.0:1784290412.422099:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901149184 00000100:00100000:1.0:1784290412.422141:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784290412.422159:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3616:x1870961901149184:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1784290412.422189:0:94058:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo t0 exp 0000000000000000 cur 2153 last 0 00000020:00000080:1.0:1784290412.422213:0:94058:0:(genops.c:1406:class_connect()) connect: client 2e54cd1c-9dbd-4e31-b60e-998135d46053, cookie 0x5953bbf6b3075247 00000100:00080000:1.0:1784290412.422328:0:94058:0:(import.c:65:import_set_state_nolock()) ffff9c2474ebb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784290412.422462:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:3616:x1870961901149184:12345-0@lo:250:mount.lustre.0 Request processed in 298us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290412.422471:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784290412.422501:0:3616:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.202.106@tcp: committing for last_committed 0 gen 28 00000100:00080000:0.0:1784290412.422516:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.106@tcp: connect to target with instance 0 00000100:00080000:0.0:1784290412.422527:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1784290412.422534:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1784290412.422540:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2447cad800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1784290412.422543:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1784290412.422570:0:3616:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1784290412.422588:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2e54cd1c-9dbd-4e31-b60e-998135d46053:3616:1870961901149184:0@lo:250:mount.lustre.0 00000020:01000000:1.0:1784290412.422607:0:83795:0:(tgt_mount.c:1626:tgt_import_update()) NID #0: 192.168.202.106@tcp 10000000:01000000:1.0:1784290412.422623:0:83795:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:1.0:1784290412.422626:0:83795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784290412.422628:0:83795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784290412.422630:0:83795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290412.422632:0:83795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290412.422633:0:83795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290412.422635:0:83795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290412.422637:0:83795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784290412.422638:0:83795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290412.422640:0:83795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1784290412.422676:0:83795:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1784290412.422682:0:83795:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:1.0:1784290412.422686:0:83795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:1.0:1784290412.422690:0:83795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784290412.422693:0:83795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290412.422696:0:83795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:0.0:1784290412.422698:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901149312:0@lo:253:kworker.0 00000020:01000004:1.0:1784290412.422700:0:83795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290412.422705:0:83795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290412.422714:0:83795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784290412.422716:0:83795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290412.422717:0:83795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1784290412.422763:0:83795:0:(tgt_mount.c:1637:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:1.0:1784290412.422773:0:83795:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:1.0:1784290412.422778:0:83795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: req 00000100:00100000:0.0:1784290412.422779:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1784290412.422790:0:83795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000100:00100000:2.0:1784290412.422792:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901149440:0@lo:253:kworker.0 00000020:01000004:1.0:1784290412.422794:0:83795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290412.422802:0:83795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290412.422811:0:83795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290412.422815:0:83795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290412.422820:0:83795:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784290412.422822:0:83795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290412.422824:0:83795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:1.0:1784290412.422860:0:83795:0:(tgt_mount.c:1637:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00080000:1.0:1784290412.422922:0:94052:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000100:00100000:2.0:1784290412.422937:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1784290412.422940:0:94052:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000100:00100000:0.0:1784290412.422952:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901149568:0@lo:253:kworker.0 00000020:01000004:1.0:1784290412.422978:0:94052:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1784290412.422984:0:94052:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000100:00100000:0.0:1784290412.423043:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1784290412.423066:0:94052:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 00000100:00100000:2.0:1784290412.423104:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901149312 00000100:00100000:1.0:1784290412.423106:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901149440 00000100:00100000:1.0:1784290412.423118:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901149440 00000100:00100000:2.0:1784290412.423123:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901149312 00000100:00100000:0.0:1784290412.423181:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901149568 00000100:00100000:0.0:1784290412.423192:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901149568 00000100:00100000:1.0:1784290412.423200:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784290412.423215:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:3617:x1870961901149440:12345-0@lo:253:kworker.0 00000100:00100000:2.0:1784290412.423229:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 20000000:01000000:1.0:1784290412.423242:0:94058:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1784290412.423263:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:3620:x1870961901149312:12345-0@lo:253:kworker.0 00000020:01000004:1.0:1784290412.423301:0:94052:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.106@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1784290412.423306:0:94052:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784290412.423307:0:94052:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784290412.423309:0:94052:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290412.423310:0:94052:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290412.423312:0:94052:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290412.423314:0:94052:0:(tgt_mount.c:1180:server_mti_print()) flags: 20000000:01000000:2.0:1784290412.423315:0:94059:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000020:01000004:1.0:1784290412.423317:0:94052:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784290412.423321:0:94052:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784290412.423324:0:94052:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290412.423326:0:94052:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784290412.423337:0:94052:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1784290412.423375:0:94052:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784290412.423377:0:94052:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784290412.423379:0:94052:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290412.423381:0:94052:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290412.423383:0:94052:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290412.423385:0:94052:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290412.423387:0:94052:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784290412.423388:0:94052:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784290412.423390:0:94052:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290412.423390:0:94052:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784290412.423407:0:94052:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1784290412.423422:0:94052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901149696:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784290412.423495:0:94052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290412.423577:0:94060:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1784290412.423588:0:94052:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458b93d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784290412.423590:0:94060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 10000000:01000000:0.0:1784290412.423627:0:94061:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1784290412.423757:0:94058:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 120 00000100:00100000:2.0:1784290412.423835:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901149696 00000100:00100000:2.0:1784290412.423843:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901149696 00000100:00100000:1.0:1784290412.423955:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784290412.423969:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:3618:x1870961901149568:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1784290412.423998:0:94062:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1784290412.424555:0:94063:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1784290412.424559:0:94063:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1784290412.424561:0:94063:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1784290412.424563:0:94063:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1784290412.424577:0:94063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 20000000:01000000:2.0:1784290412.424690:0:94058:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784290412.424718:0:94058:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784290412.425961:0:94058:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784290412.425978:0:94058:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1784290412.426006:0:94059:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1784290412.426017:0:94061:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784290412.426025:0:94061:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1784290412.426059:0:94061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b307524e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.426079:0:94061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b307524e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784290412.426092:0:94061:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000068227s 00010000:00010000:1.0:1784290412.426099:0:94061:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b307524e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.426123:0:94061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b307524e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.426133:0:94061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b307524e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.426144:0:94061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b307524e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.426169:0:94061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cba00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290412.426176:0:94061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b307524e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.426186:0:94061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b307524e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.426207:0:94061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b307524e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.426221:0:94061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b307524e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.426231:0:94061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247f8cba00/0x5953bbf6b307524e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290412.426281:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:3617:x1870961901149440:12345-0@lo:253:kworker.0 Request processed in 3064us (3359us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290412.426299:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:3.0:1784290412.426304:0:3617:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1784290412.426308:0:3617:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784290412.426309:0:3617:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784290412.426311:0:3617:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784290412.426314:0:3617:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784290412.426316:0:3617:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784290412.426318:0:3617:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784290412.426321:0:3617:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784290412.426322:0:3617:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1784290412.426327:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901149440:0@lo:253:kworker.0 00000100:00100000:2.0:1784290412.426410:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784290412.426427:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:94052:x1870961901149696:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784290412.426465:0:94058:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784290412.426468:0:94058:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1784290412.426471:0:94058:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:2.0:1784290412.426478:0:94058:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1784290412.427963:0:94059:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784290412.427987:0:94059:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1784290412.428002:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:94052:x1870961901149696:12345-0@lo:253:mount.lustre.0 Request processed in 1573us (4498us total) trans 0 rc 0/0 20000000:01000000:1.0:1784290412.428008:0:94062:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1784290412.428030:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784290412.428044:0:94052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901149696:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784290412.428066:0:94052:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784290412.428069:0:94052:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784290412.428072:0:94052:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784290412.428074:0:94052:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784290412.428077:0:94052:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784290412.428080:0:94052:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784290412.428082:0:94052:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784290412.428085:0:94052:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784290412.428086:0:94052:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784290412.428087:0:94052:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784290412.428088:0:94052:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784290412.428110:0:94052:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c247e403000 from lustre-MDT0000 10000000:01000000:3.0:1784290412.428140:0:94052:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1784290412.428166:0:94052:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784290412.428174:0:94052:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c247e403000 10000000:01000000:3.0:1784290412.428177:0:94052:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784290412.428182:0:94052:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c247e403000 10000000:01000000:3.0:1784290412.428186:0:94052:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 20000000:01000000:0.0:1784290412.428187:0:94061:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784290412.428193:0:94052:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9c247e403000 from 1 10000000:01000000:0.0:1784290412.428198:0:94061:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1784290412.428199:0:94052:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784290412.428233:0:94052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3075255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.428235:0:94061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b307525c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290412.428275:0:94052:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3075255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290412.428304:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:3620:x1870961901149312:12345-0@lo:253:kworker.0 Request processed in 5049us (5521us total) trans 0 rc 0/0 00010000:00010000:3.0:1784290412.428308:0:94052:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3075255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.428319:0:94061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b307525c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784290412.428334:0:3620:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000100:00100000:2.0:1784290412.428379:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784290412.428395:0:94052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901149824:0@lo:101:mount.lustre.0 20000000:01000000:0.0:1784290412.428397:0:94061:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000200548s 00000020:01000004:1.0:1784290412.428398:0:3620:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784290412.428411:0:3620:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00010000:00010000:0.0:1784290412.428414:0:94061:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b307525c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784290412.428417:0:3620:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290412.428426:0:3620:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:0.0:1784290412.428429:0:94061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b307525c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.428437:0:94061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b307525c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784290412.428444:0:3620:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290412.428451:0:3620:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00010000:00010000:0.0:1784290412.428452:0:94061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b307525c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784290412.428460:0:3620:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:3.0:1784290412.428464:0:94052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1784290412.428469:0:3620:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1784290412.428484:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901149312:0@lo:253:kworker.0 00010000:00010000:0.0:1784290412.428485:0:94061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebe800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290412.428498:0:94061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b307525c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.428512:0:94061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b307525c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290412.428517:0:94052:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345844240 going to sleep for 11 seconds 00010000:00010000:0.0:1784290412.428532:0:94061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b307525c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290412.428547:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901149824 00010000:00010000:0.0:1784290412.428549:0:94061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b307525c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290412.428559:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901149824 00010000:00010000:0.0:1784290412.428563:0:94061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebe800/0x5953bbf6b307525c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290412.428612:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784290412.428622:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:94052:x1870961901149824:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784290412.428643:0:94060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290412.428661:0:94060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236da00/0x5953bbf6b3075263 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3075255 expref: -99 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290412.428681:0:94060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236da00/0x5953bbf6b3075263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3075255 expref: 7 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290412.428691:0:94060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236da00/0x5953bbf6b3075263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075255 expref: 7 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290412.428698:0:94060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236da00, rc 0) 00000100:00100000:2.0:1784290412.428744:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:94052:x1870961901149824:12345-0@lo:101:mount.lustre.0 Request processed in 123us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290412.428757:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784290412.428800:0:94052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901149824:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784290412.428822:0:94052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3075255 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075263 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290412.428833:0:94052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3075255 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075263 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290412.428849:0:94052:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784290412.428870:0:94052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3075255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075263 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290412.428901:0:94052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2fee00/0x5953bbf6b3075255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075263 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290412.428912:0:94052:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784290412.428919:0:94052:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784290412.428925:0:94052:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c247e403000 10000000:01000000:3.0:1784290412.428927:0:94052:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1784290412.428930:0:94052:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1784290412.428933:0:94052:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784290412.428968:0:94052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fec00/0x5953bbf6b307526a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290412.428975:0:94052:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2fec00/0x5953bbf6b307526a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290412.428981:0:94052:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2fec00/0x5953bbf6b307526a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290412.428992:0:94052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901149952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784290412.429021:0:94052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290412.429038:0:94052:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345844240 going to sleep for 11 seconds 00000100:00100000:2.0:1784290412.429087:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901149952 00000100:00100000:2.0:1784290412.429094:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901149952 00000100:00100000:2.0:1784290412.429130:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784290412.429142:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:94052:x1870961901149952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784290412.429170:0:94059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290412.429191:0:94059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236c800/0x5953bbf6b3075271 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307526a expref: -99 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290412.429208:0:94059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236c800/0x5953bbf6b3075271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307526a expref: 8 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290412.429216:0:94059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236c800/0x5953bbf6b3075271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307526a expref: 8 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290412.429223:0:94059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236c800, rc 0) 00000100:00100000:2.0:1784290412.429267:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:94052:x1870961901149952:12345-0@lo:101:mount.lustre.0 Request processed in 129us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290412.429274:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784290412.429311:0:94052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901149952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784290412.429329:0:94052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2fec00/0x5953bbf6b307526a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075271 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290412.429393:0:94052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2fec00/0x5953bbf6b307526a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075271 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290412.429476:0:94052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901150080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784290412.429506:0:94052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290412.429573:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901150080 00000100:00100000:3.0:1784290412.429574:0:94052:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345844240 going to sleep for 11 seconds 00000100:00100000:2.0:1784290412.429587:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901150080 00000100:00100000:2.0:1784290412.429631:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784290412.429644:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:94052:x1870961901150080:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784290412.429814:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:94052:x1870961901150080:12345-0@lo:501:mount.lustre.0 Request processed in 169us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290412.429825:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784290412.429831:0:94052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901150080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784290412.429870:0:94052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901150208:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784290412.429916:0:94052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290412.429935:0:94052:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345844240 going to sleep for 11 seconds 00000100:00100000:2.0:1784290412.429961:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901150208 00000100:00100000:2.0:1784290412.429969:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901150208 00000100:00100000:2.0:1784290412.430008:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784290412.430018:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:94052:x1870961901150208:12345-0@lo:503:mount.lustre.0 20000000:01000000:1.0:1784290412.430071:0:94062:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784290412.430090:0:94062:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1784290412.430110:0:94061:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784290412.430120:0:94061:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784290412.430141:0:94061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b3075278 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290412.430169:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:94052:x1870961901150208:12345-0@lo:503:mount.lustre.0 Request processed in 130us (226us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290412.430178:0:94061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b3075278 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290412.430183:0:94052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901150208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784290412.430199:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 20000000:01000000:0.0:1784290412.430217:0:94061:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000200548s 00010000:00010000:0.0:1784290412.430223:0:94061:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b3075278 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.430233:0:94061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b3075278 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.430239:0:94061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b3075278 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.430246:0:94061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b3075278 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.430251:0:94061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290412.430257:0:94061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b3075278 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.430264:0:94061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b3075278 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.430276:0:94061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b3075278 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.430298:0:94061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b3075278 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.430305:0:94061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b3075278 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290412.430443:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:3618:x1870961901149568:12345-0@lo:253:kworker.0 Request processed in 6473us (7405us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290412.430490:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:0.0:1784290412.430502:0:3618:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1784290412.430507:0:3618:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1784290412.430510:0:3618:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784290412.430513:0:3618:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784290412.430515:0:3618:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784290412.430517:0:3618:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784290412.430521:0:3618:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784290412.430524:0:3618:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784290412.430526:0:3618:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1784290412.430533:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901149568:0@lo:253:kworker.0 00000100:00100000:3.0:1784290412.430590:0:94064:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a542300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94064:1870961901150336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290412.430633:0:94064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290412.430662:0:94064:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345844cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290412.430679:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901150336 00000100:00100000:2.0:1784290412.430689:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901150336 00000100:00100000:2.0:1784290412.430737:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784290412.430746:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c248207f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:94064:x1870961901150336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290412.431123:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c248207f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:94064:x1870961901150336:12345-0@lo:502:llog_process_th.0 Request processed in 377us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290412.431132:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784290412.431215:0:94064:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a542300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94064:1870961901150336:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784290412.431252:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784290412.431267:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290412.431271:0:94064:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784290412.431278:0:94064:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1784290412.431282:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784290412.431297:0:94064:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c2474fd0000) 00000020:00000080:3.0:1784290412.431320:0:94064:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lod with refcount 2 00000020:00000080:3.0:1784290412.431326:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1784290412.431496:0:94064:0:(osd_handler.c:8932:osd_obd_connect()) connect #2 00000020:00000080:3.0:1784290412.431511:0:94064:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3075286 00000020:00000080:3.0:1784290412.431698:0:94064:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784290412.431703:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290412.431708:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290412.431718:0:94064:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1784290412.431722:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784290412.431727:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290412.431729:0:94064:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1784290412.431733:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784290412.431742:0:94064:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c2474fd3380) 00000020:00000080:3.0:1784290412.431754:0:94064:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type mdt with refcount 2 00000020:00000080:3.0:1784290412.431757:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1784290412.431759:0:94064:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1784290412.431762:0:94064:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1784290412.431767:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784290412.431815:0:94064:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c247e403000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1784290412.431827:0:94064:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c2474fd4d40) 00000020:00000080:3.0:1784290412.431833:0:94064:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdd with refcount 2 00000004:01000000:3.0:1784290412.431909:0:94064:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1784290412.431915:0:94064:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b307529b 00000020:00000080:3.0:1784290412.432066:0:94064:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1784290412.432080:0:94064:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1784290412.432089:0:94064:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5953bbf6b30752a2 00080000:01000000:3.0:1784290412.432098:0:94064:0:(osd_handler.c:8932:osd_obd_connect()) connect #3 00000020:00000080:3.0:1784290412.432104:0:94064:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b30752a9 00010000:00010000:2.0:1784290412.482886:0:94064:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1784290412.483018:0:94064:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 111669149701 srv lr: 115964116992 lx: 0 gen 21 00000001:00080000:2.0:1784290412.483070:0:94064:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 711f3c77-e791-4aa8-86ee-bc854fd0bcc5 idx: 2 lr: 0 srv lr: 115964116992 lx: 0 gen 23 00000001:00000004:2.0:1784290412.483105:0:94064:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 115964116992 00000001:00080000:2.0:1784290412.483229:0:94064:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1784290412.483285:0:94064:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2458be2000: xid 1870961896265728, transno 115964116997, client gen 23, slot idx 0 00000001:00080000:2.0:1784290412.483293:0:94064:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2458be2780: xid 1870961901140352, transno 115964117001, client gen 21, slot idx 1 00000001:00080000:2.0:1784290412.483299:0:94064:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2458be2540: xid 1870961901140608, transno 115964117002, client gen 21, slot idx 2 00000001:00080000:2.0:1784290412.483305:0:94064:0:(tgt_lastrcvd.c:2283:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9c2458be29c0: xid 1870961901137024, transno 115964116998, client gen 21, slot idx 3 00000020:00000080:2.0:1784290412.483728:0:94064:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c2445c13380) 00000020:00000080:2.0:1784290412.483746:0:94064:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type qmt with refcount 2 00080000:01000000:2.0:1784290412.483812:0:94064:0:(osd_handler.c:8932:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784290412.483818:0:94064:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b30752c5 00000020:00000080:1.0:1784290412.484487:0:94064:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1784290412.487470:0:94064:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5953bbf6b30752cc 00000020:00000080:3.0:1784290412.487750:0:94064:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1784290412.487769:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290412.487776:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290412.487779:0:94064:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1784290412.487784:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784290412.487787:0:94064:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1784290412.487789:0:94064:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784290412.487790:0:94064:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784290412.487791:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784290412.487794:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290412.487796:0:94064:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784290412.487799:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784290412.487814:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290412.487824:0:94064:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1784290412.487830:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784290412.487886:0:94064:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1784290412.487918:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290412.487922:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290412.487923:0:94064:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1784290412.487928:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784290412.487931:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290412.487934:0:94064:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1784290412.487939:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784290412.487945:0:94064:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:00000080:3.0:1784290412.487981:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784290412.487998:0:94064:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c23446b4d40) 00000020:00000080:3.0:1784290412.488015:0:94064:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1784290412.488021:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1784290412.488078:0:94064:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1784290412.488084:0:94064:0:(osd_handler.c:8932:osd_obd_connect()) connect #5 00000020:00000080:3.0:1784290412.488089:0:94064:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b30752da 00010000:00080000:3.0:1784290412.488131:0:94064:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c23458df800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:3.0:1784290412.490507:0:94064:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1784290412.491141:0:94064:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784290412.491187:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1784290412.491214:0:94064:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1784290412.491249:0:94064:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b30752e1 00000100:00080000:3.0:1784290412.491260:0:94064:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784290412.491266:0:94064:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c23458df800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290412.491316:0:94064:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a542300 x1870961901150464/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784290412.491394:0:94064:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1784290412.491464:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290412.491475:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290412.491480:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290412.491494:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 2150 00000100:00080000:1.0:1784290412.491502:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784290412.491514:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000020:01000000:3.0:1784290412.491518:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290412.491531:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290412.491533:0:94064:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1784290412.491538:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784290412.491540:0:94064:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1784290412.491544:0:94064:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784290412.491546:0:94064:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784290412.491549:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784290412.491560:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1784290412.491562:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2445d6f100 x1870961901150592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290412.491562:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901150464:0@lo:38:llog_process_th.0 00000020:00000080:3.0:1784290412.491564:0:94064:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784290412.491579:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784290412.491592:0:94064:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1784290412.491599:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290412.491602:0:94064:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1784290412.491610:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784290412.491614:0:94064:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000020:01000000:3.0:1784290412.491638:0:94064:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784290412.491645:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784290412.491659:0:94064:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c23446b0000) 00000100:00080000:1.0:1784290412.491660:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290412.491670:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1784290412.491680:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784290412.491681:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000020:00000080:3.0:1784290412.491686:0:94064:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000100:00080000:1.0:1784290412.491693:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 2150 00000020:00000080:3.0:1784290412.491700:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00080000:1.0:1784290412.491700:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00100000:2.0:1784290412.491708:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1870961901150720:0@lo:400:kworker.0 00000100:00080000:1.0:1784290412.491717:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290412.491756:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2445d6c700 x1870961901150848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290412.491766:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901150592:0@lo:38:kworker.0 00000004:00080000:3.0:1784290412.491799:0:94064:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00000100:00100000:2.0:1784290412.491812:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:01000000:3.0:1784290412.491816:0:94064:0:(osd_handler.c:8932:osd_obd_connect()) connect #6 00000100:00080000:1.0:1784290412.491816:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290412.491824:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000020:00000080:3.0:1784290412.491829:0:94064:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b30752ef 00000100:00080000:1.0:1784290412.491839:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784290412.491856:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784290412.491858:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 2150 00000100:00080000:1.0:1784290412.491868:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00100000:2.0:1784290412.491878:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1784290412.491880:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00010000:00080000:3.0:1784290412.491894:0:94064:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2458110000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.106@tcp at head 00000100:00100000:2.0:1784290412.491908:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901150976:0@lo:400:kworker.0 00000100:00100000:1.0:1784290412.491916:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2445d6ed80 x1870961901151104/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290412.491923:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901150848:0@lo:38:kworker.0 00000100:00100000:2.0:1784290412.491960:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290412.492023:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784290412.492028:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784290412.492036:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784290412.492040:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290412.492049:0:83795:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 2150 00000100:00080000:1.0:1784290412.492056:0:83795:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784290412.492066:0:83795:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290412.492088:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901150720 00000100:00100000:1.0:1784290412.492097:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2445d6f480 x1870961901151488/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290412.492105:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901150720 00000100:00100000:0.0:1784290412.492106:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901151104:0@lo:38:kworker.0 00000100:00100000:0.0:1784290412.492210:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784290412.492213:0:94064:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:1.0:1784290412.492230:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901150592 00000100:00100000:1.0:1784290412.492242:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901150592 00000100:00100000:2.0:1784290412.492263:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901150976 00000100:00100000:0.0:1784290412.492266:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901151488:0@lo:38:kworker.0 00000100:00100000:2.0:1784290412.492274:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901150976 00000100:00100000:1.0:1784290412.492303:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901150848 00000100:00100000:1.0:1784290412.492313:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901150848 00000100:00100000:0.0:1784290412.492313:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290412.492400:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901151488 00000100:00100000:2.0:1784290412.492414:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901151488 00000100:00100000:1.0:1784290412.492429:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:0.0:1784290412.492445:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901150464 00000100:00100000:1.0:1784290412.492455:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1870961901150720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290412.492455:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901150464 00000100:00100000:2.0:1784290412.492464:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:2.0:1784290412.492485:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901150976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290412.492526:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901151104 00000100:00100000:0.0:1784290412.492536:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901151104 00000100:00100000:3.0:1784290412.492551:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3889 00000100:00100000:3.0:1784290412.492562:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901150464:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784290412.492607:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3890 00010000:00080000:3.0:1784290412.492638:0:23867:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2153 last 0 00000100:00100000:0.0:1784290412.492639:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244405b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901151104:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784290412.492643:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901150976:12345-0@lo:400:kworker.0 Request processed in 143us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290412.492643:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1870961901150720:12345-0@lo:400:kworker.0 Request processed in 177us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290412.492686:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000020:00000080:3.0:1784290412.492688:0:23867:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b30752f6 00000100:00100000:2.0:1784290412.492702:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000004:00100000:3.0:1784290412.492715:0:23867:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1784290412.492738:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:0.0:1784290412.492747:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244405b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901151104:12345-0@lo:38:kworker.0 Request processed in 124us (540us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784290412.492766:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:1.0:1784290412.492767:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244405a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901150592:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290412.492767:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3890 00000100:00100000:2.0:1784290412.492793:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244405a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901150848:12345-0@lo:38:kworker.0 00000100:00080000:3.0:1784290412.492837:0:23867:0:(import.c:65:import_set_state_nolock()) ffff9c245fd7a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290412.492840:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:0.0:1784290412.492859:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244405b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901151488:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1784290412.492878:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244405a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901150592:12345-0@lo:38:kworker.0 Request processed in 121us (1028us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784290412.492884:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244405a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901150848:12345-0@lo:38:kworker.0 Request processed in 93us (867us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784290412.492901:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00000100:00100000:1.0:1784290412.492924:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:3.0:1784290412.492932:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3616:x1870961901150464:12345-0@lo:38:llog_process_th.0 Request processed in 363us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290412.492944:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3889 00000100:00100000:0.0:1784290412.492962:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244405b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901151488:12345-0@lo:38:kworker.0 Request processed in 103us (642us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784290412.492972:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:1.0:1784290412.492989:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901151232:0@lo:400:kworker.0 00000100:00080000:0.0:1784290412.493009:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784290412.493053:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901151360:0@lo:400:kworker.0 00000100:00100000:1.0:1784290412.493068:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290412.493108:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290412.493140:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901151232 00000100:00100000:3.0:1784290412.493159:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901151232 00000100:00100000:2.0:1784290412.493198:0:26263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901151360 00000100:00100000:1.0:1784290412.493207:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901150976:0@lo:400:kworker.0 00000100:00100000:2.0:1784290412.493210:0:26263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901151360 00000100:00100000:1.0:1784290412.493259:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1870961901150720:0@lo:400:kworker.0 00000100:00100000:3.0:1784290412.493261:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1616 00000100:00080000:0.0:1784290412.493276:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1784290412.493290:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901151232:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784290412.493290:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784290412.493293:0:26263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1617 00000100:00100000:0.0:1784290412.493312:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901151488:0@lo:38:kworker.0 00000100:00100000:2.0:1784290412.493327:0:26263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444059880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901151360:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1784290412.493389:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290412.493402:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784290412.493414:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901151104:0@lo:38:kworker.0 00000100:00080000:0.0:1784290412.493463:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1784290412.493466:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901151232:12345-0@lo:400:kworker.0 Request processed in 188us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290412.493481:0:26263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444059880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901151360:12345-0@lo:400:kworker.0 Request processed in 154us (367us total) trans 0 rc 0/0 00000100:00080000:0.0:1784290412.493484:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784290412.493494:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901151232:0@lo:400:kworker.0 00000100:00100000:3.0:1784290412.493505:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1616 00000100:00100000:0.0:1784290412.493507:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901150848:0@lo:38:kworker.0 00000100:00100000:2.0:1784290412.493533:0:26263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1617 00000100:00080000:0.0:1784290412.493574:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290412.493583:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000040:01000000:3.0:1784290412.493602:0:94064:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1784290412.493603:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901150592:0@lo:38:kworker.0 00000100:00100000:0.0:1784290412.493636:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000040:01000000:3.0:1784290412.493639:0:94064:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:0.0:1784290412.493645:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:0.0:1784290412.493654:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1784290412.493663:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1784290412.493667:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c23458df800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784290412.493686:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901150464:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784290412.493807:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784290412.493858:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901151360:0@lo:400:kworker.0 00000100:00100000:3.0:1784290412.493878:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901151616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784290412.493935:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1784290412.493981:0:94064:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 26, last_idx 27 00000100:00100000:0.0:1784290412.493991:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901151616 00000100:00100000:0.0:1784290412.493998:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901151616 00000100:00100000:0.0:1784290412.494048:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3891 00000100:00100000:0.0:1784290412.494061:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901151616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1784290412.494090:0:8412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445097472 avail 1298857984 00000100:00100000:0.0:1784290412.494172:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a542300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901151616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290412.494182:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3891 00000100:00100000:3.0:1784290412.494230:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901151616:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1784290412.494935:0:94064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784290412.494963:0:94064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].28, 64 off9984 00000040:00080000:2.0:1784290412.498347:0:94064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].1, 64 off8256 00000040:00080000:1.0:1784290412.498855:0:94070:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 28 synced_idx: 0 lgh_last_idx: 28 00000040:00080000:1.0:1784290412.498865:0:94070:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000040:00080000:1.0:1784290412.499134:0:94070:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 27, last_idx 28 00000040:00080000:1.0:1784290412.499226:0:94070:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1784290412.499592:0:94064:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784290412.499605:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000040:00080000:1.0:1784290412.499606:0:94070:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:1.0:1784290412.499614:0:94070:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000004:01000000:3.0:1784290412.499667:0:94064:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1784290412.499694:0:94064:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b30752fd 00000100:00080000:3.0:1784290412.499704:0:94064:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784290412.499711:0:94064:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c2458110000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290412.499744:0:94064:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2447b95c00 x1870961901151744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784290412.499795:0:94064:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1784290412.499856:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901151744:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1784290412.499888:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290412.499896:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290412.499907:0:94064:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1784290412.499914:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1784290412.499928:0:94064:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000100:00100000:0.0:1784290412.499929:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1784290412.499944:0:94064:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784290412.499948:0:94064:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1784290412.499950:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1784290412.499955:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290412.499956:0:94064:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1784290412.499960:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784290412.499964:0:94064:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1784290412.499968:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290412.499971:0:94064:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1784290412.499975:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1784290412.499983:0:94064:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.106@tcp to nid 0x20000c0a8ca6a (192.168.202.106@tcp) 00000100:00100000:2.0:1784290412.500013:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901151744 00000020:01000000:3.0:1784290412.500017:0:94064:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1784290412.500024:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000100:00100000:2.0:1784290412.500026:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901151744 00000020:00000080:3.0:1784290412.500047:0:94064:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c23446b19c0) 00000020:00000080:3.0:1784290412.500068:0:94064:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1784290412.500073:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1784290412.500078:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4967 00000100:00100000:2.0:1784290412.500089:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444058e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3616:x1870961901151744:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1784290412.500117:0:26258:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2153 last 0 00000020:00000080:2.0:1784290412.500185:0:26258:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b307530b 00000004:00080000:3.0:1784290412.500197:0:94064:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00002000:00100000:2.0:1784290412.500203:0:26258:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c246ff9a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ad ocd_grant: 0 ocd_index: 0 ocd_group 0 00080000:01000000:3.0:1784290412.500205:0:94064:0:(osd_handler.c:8932:osd_obd_connect()) connect #7 00002000:00080000:2.0:1784290412.500217:0:26258:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000020:00000080:3.0:1784290412.500222:0:94064:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5953bbf6b3075312 00002000:00100000:2.0:1784290412.500222:0:26258:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:3.0:1784290412.500260:0:94064:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c23454bb800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.106@tcp at head 00002000:00080000:2.0:1784290412.500297:0:26258:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784290412.500325:0:26258:0:(import.c:65:import_set_state_nolock()) ffff9c2474f80000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784290412.500445:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444058e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3616:x1870961901151744:12345-0@lo:8:llog_process_th.0 Request processed in 352us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290412.500456:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4967 00000100:00100000:0.0:1784290412.500482:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784290412.500513:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784290412.500528:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784290412.500536:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784290412.500541:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2458110000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784290412.500573:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784290412.500589:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901151744:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1784290412.500619:0:94070:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:3.0:1784290412.500650:0:94064:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000100:00100000:2.0:1784290412.500668:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901151872:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1784290412.500737:0:94070:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2153740393947ns, next at 0ns, rc = 0 00080000:00080000:0.0:1784290412.500749:0:94070:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000040:01000000:3.0:1784290412.500756:0:94064:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1784290412.500767:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1784290412.500806:0:94064:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1784290412.500866:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901151872 00000100:00100000:0.0:1784290412.500874:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901151872 00000100:00080000:2.0:1784290412.500921:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784290412.500955:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:0.0:1784290412.500965:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901151872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784290412.500983:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290412.501050:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901151872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290412.501060:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000040:00080000:3.0:1784290412.501122:0:94064:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 26, last_idx 27 00000100:00100000:2.0:1784290412.501136:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901151872:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1784290412.502427:0:94064:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1784290412.502447:0:94053:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:3.0:1784290412.502462:0:94064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].28, 64 off9984 00000040:00080000:3.0:1784290412.502609:0:94064:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x72:0x0].1, 64 off8256 00000040:00080000:3.0:1784290412.502919:0:94072:0:(llog.c:805:llog_process_thread()) index: 27, lh_last_idx: 28 synced_idx: 0 lgh_last_idx: 28 00000040:00080000:3.0:1784290412.502924:0:94072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1784290412.503051:0:94072:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 27, last_idx 28 00000040:00080000:3.0:1784290412.503067:0:94072:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1784290412.503199:0:94072:0:(llog.c:805:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:3.0:1784290412.503203:0:94072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1784290412.503577:0:94064:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784290412.503590:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784290412.503626:0:94064:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784290412.503646:0:94064:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3075319 00000100:00080000:2.0:1784290412.503654:0:94064:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784290412.503661:0:94064:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c23454bb800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290412.503687:0:94064:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c24581a8700 x1870961901152000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784290412.503733:0:94064:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1784290412.503767:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901152000:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1784290412.503830:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1784290412.503874:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784290412.503885:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290412.503889:0:94064:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000100:00100000:3.0:1784290412.503892:0:26260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901152000 00000020:01000000:2.0:1784290412.503897:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:3.0:1784290412.503900:0:26260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901152000 00000020:00000080:2.0:1784290412.503913:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290412.503918:0:94064:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784290412.503924:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784290412.503927:0:94064:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784290412.503929:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784290412.503931:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290412.503933:0:94064:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784290412.503935:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784290412.503937:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290412.503938:0:94064:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784290412.503941:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1784290412.503950:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784290412.503954:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290412.503957:0:94064:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000020:01000000:2.0:1784290412.503963:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:3.0:1784290412.503967:0:26260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4968 00000020:00000080:2.0:1784290412.503974:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00100000:3.0:1784290412.503984:0:26260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444059f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3616:x1870961901152000:12345-0@lo:8:llog_process_th.0 00000020:00000080:2.0:1784290412.503984:0:94064:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:2.0:1784290412.504000:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00010000:00080000:3.0:1784290412.504019:0:26260:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 2153 last 0 00000020:00000080:3.0:1784290412.504058:0:26260:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5953bbf6b3075320 00020000:01000000:2.0:1784290412.504072:0:94064:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00002000:00100000:3.0:1784290412.504074:0:26260:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c2343902000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ad ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1784290412.504083:0:26260:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1784290412.504086:0:26260:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784290412.504177:0:26260:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784290412.504199:0:26260:0:(import.c:65:import_set_state_nolock()) ffff9c2343907800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784290412.504278:0:26260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444059f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3616:x1870961901152000:12345-0@lo:8:llog_process_th.0 Request processed in 296us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290412.504290:0:26260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4968 00000100:00100000:0.0:1784290412.504316:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784290412.504326:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784290412.504332:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784290412.504336:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784290412.504339:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c23454bb800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784290412.504415:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784290412.504428:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901152000:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1784290412.504448:0:94072:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1784290412.504493:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901152128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784290412.504572:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290412.504639:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901152128 00000100:00100000:0.0:1784290412.504647:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901152128 00000100:00100000:2.0:1784290412.504649:0:94064:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94064:1870961901152256:0@lo:502:llog_process_th.0 00000100:00080000:3.0:1784290412.504710:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1784290412.504711:0:94072:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2153744366846ns, next at 0ns, rc = 0 00000100:00100000:0.0:1784290412.504721:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00080000:00080000:1.0:1784290412.504732:0:94072:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1784290412.504735:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901152128:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290412.504745:0:94064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1784290412.504759:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784290412.504800:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901152256 00000100:00100000:3.0:1784290412.504808:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901152256 00000100:00100000:2.0:1784290412.504816:0:94064:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246d46a900 going to sleep for 11 seconds 00000100:00100000:0.0:1784290412.504837:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901152128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290412.504867:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:3.0:1784290412.504876:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784290412.504894:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c248207f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:94064:x1870961901152256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290412.504931:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901152128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784290412.505036:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c248207f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:94064:x1870961901152256:12345-0@lo:502:llog_process_th.0 Request processed in 150us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290412.505045:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784290412.505104:0:94064:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94064:1870961901152256:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784290412.505162:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784290412.505171:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290412.505182:0:94064:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre-MDT0000-m new lustre.pool_134 00000020:01000000:2.0:1784290412.505187:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784290412.505198:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290412.505200:0:94064:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:2.0:1784290412.505206:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1784290412.505218:0:94064:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:2.0:1784290412.505870:0:94064:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94064:1870961901152384:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1784290412.505905:0:94074:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c247e403000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784290412.505913:0:94074:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c247e403000 4 00000100:00100000:2.0:1784290412.505929:0:94064:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290412.505982:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901152384 00000100:00100000:2.0:1784290412.505987:0:94064:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246d46a900 going to sleep for 11 seconds 00000100:00100000:3.0:1784290412.505998:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901152384 00000100:00100000:3.0:1784290412.506041:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784290412.506051:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:94064:x1870961901152384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290412.506160:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:94064:x1870961901152384:12345-0@lo:502:llog_process_th.0 Request processed in 97us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290412.506168:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784290412.506229:0:94064:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581ab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94064:1870961901152384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784290412.506268:0:94064:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784290412.506277:0:94064:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290412.506280:0:94064:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1784290412.506288:0:94064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000004:00080000:3.0:1784290412.506373:0:94053:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000020:01000000:1.0:1784290412.506473:0:94052:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-52 (rc=0) 10000000:01000000:1.0:1784290412.506536:0:94052:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784290412.506563:0:94052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fec00/0x5953bbf6b307526a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075271 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.506594:0:94052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2fec00/0x5953bbf6b307526a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075271 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290412.506607:0:94052:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9c247e403000 from 1 10000000:01000000:1.0:1784290412.506612:0:94052:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784290412.506651:0:94052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247f8cae00/0x5953bbf6b3075327 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.506665:0:94052:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247f8cae00/0x5953bbf6b3075327 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.506681:0:94052:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247f8cae00/0x5953bbf6b3075327 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290412.506705:0:94052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901152512:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784290412.506754:0:94052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290412.506802:0:94052:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246deb3900 going to sleep for 11 seconds 00000100:00100000:2.0:1784290412.506819:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901152512 00000100:00100000:2.0:1784290412.506831:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901152512 00000100:00100000:2.0:1784290412.506872:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784290412.506879:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+8:94052:x1870961901152512:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784290412.506891:0:94062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290412.506908:0:94062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236d800/0x5953bbf6b307532e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3075327 expref: -99 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290412.506932:0:94062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236d800/0x5953bbf6b307532e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3075327 expref: 9 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290412.506943:0:94062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236d800/0x5953bbf6b307532e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075327 expref: 9 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290412.506953:0:94062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236d800, rc 0) 00000100:00100000:2.0:1784290412.507011:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:94052:x1870961901152512:12345-0@lo:101:mount.lustre.0 Request processed in 131us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290412.507018:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784290412.507075:0:94052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901152512:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784290412.507103:0:94052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247f8cae00/0x5953bbf6b3075327 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307532e expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.507119:0:94052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247f8cae00/0x5953bbf6b3075327 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307532e expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290412.508043:0:94052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901152640:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784290412.508103:0:94052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290412.508140:0:94052:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246deb3900 going to sleep for 11 seconds 00000100:00100000:2.0:1784290412.508188:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901152640 00000100:00100000:2.0:1784290412.508198:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901152640 00000100:00100000:2.0:1784290412.508248:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784290412.508260:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:94052:x1870961901152640:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1784290412.508283:0:94060:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784290412.508308:0:94060:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1784290412.508315:0:94060:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1784290412.508320:0:94060:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1784290412.508323:0:94060:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 123 00000100:00100000:2.0:1784290412.508547:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:94052:x1870961901152640:12345-0@lo:256:mount.lustre.0 Request processed in 288us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290412.508561:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784290412.508575:0:94052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901152640:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1784290412.509271:0:94052:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784290412.509289:0:94052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247f8cae00/0x5953bbf6b3075327 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307532e expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290412.509299:0:94052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247f8cae00/0x5953bbf6b3075327 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307532e expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290412.509307:0:94052:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c247e403000 from 1 10000000:01000000:3.0:1784290412.509310:0:94052:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784290412.509333:0:94052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3075335 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290412.509380:0:94052:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3075335 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290412.509389:0:94052:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3075335 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290412.509406:0:94052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901152768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784290412.509442:0:94052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290412.509482:0:94052:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343350540 going to sleep for 11 seconds 00000100:00100000:2.0:1784290412.509513:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901152768 00000100:00100000:2.0:1784290412.509523:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901152768 00000100:00100000:2.0:1784290412.509579:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784290412.509594:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+9:94052:x1870961901152768:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784290412.509607:0:94059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290412.509624:0:94059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236de00/0x5953bbf6b307533c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3075335 expref: -99 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290412.509649:0:94059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236de00/0x5953bbf6b307533c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3075335 expref: 10 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290412.509664:0:94059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236de00/0x5953bbf6b307533c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075335 expref: 10 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290412.509696:0:94059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236de00, rc 0) 00000100:00100000:2.0:1784290412.509767:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:94052:x1870961901152768:12345-0@lo:101:mount.lustre.0 Request processed in 175us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290412.509779:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784290412.509802:0:94052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901152768:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784290412.509826:0:94052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3075335 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307533c expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290412.509835:0:94052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3075335 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307533c expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290412.509885:0:94052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901152896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784290412.509917:0:94052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290412.509938:0:94052:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343350540 going to sleep for 11 seconds 00000100:00100000:2.0:1784290412.509964:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901152896 00000100:00100000:2.0:1784290412.509971:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901152896 00000100:00100000:2.0:1784290412.510006:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784290412.510013:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:94052:x1870961901152896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784290412.510122:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:94052:x1870961901152896:12345-0@lo:501:mount.lustre.0 Request processed in 109us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290412.510132:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784290412.510171:0:94052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901152896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784290412.510207:0:94052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901153024:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784290412.510256:0:94052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290412.510276:0:94052:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343350540 going to sleep for 11 seconds 00000100:00100000:0.0:1784290412.510323:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901153024 00000100:00100000:0.0:1784290412.510334:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901153024 00000100:00100000:0.0:1784290412.510465:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784290412.510475:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:94052:x1870961901153024:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784290412.510621:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:94052:x1870961901153024:12345-0@lo:503:mount.lustre.0 Request processed in 144us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290412.510637:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784290412.510647:0:94052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901153024:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784290412.511072:0:94075:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94075:1870961901153152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290412.511137:0:94075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290412.511220:0:94075:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246deb3600 going to sleep for 11 seconds 00000100:00100000:0.0:1784290412.511248:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901153152 00000100:00100000:0.0:1784290412.511256:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901153152 00000100:00100000:0.0:1784290412.511291:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784290412.511298:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:94075:x1870961901153152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290412.511704:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:94075:x1870961901153152:12345-0@lo:502:llog_process_th.0 Request processed in 405us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290412.511715:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784290412.511761:0:94075:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94075:1870961901153152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784290412.511812:0:94075:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784290412.511822:0:94075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290412.511825:0:94075:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784290412.511834:0:94075:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c247e403000 00000020:00000080:1.0:1784290412.511838:0:94075:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784290412.511851:0:94075:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784290412.511855:0:94075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290412.511857:0:94075:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1784290412.511861:0:94075:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784290412.511864:0:94075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290412.511867:0:94075:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784290412.511872:0:94075:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c247e403000 00000020:00000080:1.0:1784290412.511874:0:94075:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784290412.511973:0:94075:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94075:1870961901153280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290412.512027:0:94075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290412.512068:0:94075:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246deb3600 going to sleep for 11 seconds 00000100:00100000:2.0:1784290412.512120:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901153280 00000100:00100000:2.0:1784290412.512130:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901153280 00000100:00100000:2.0:1784290412.512200:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784290412.512210:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:94075:x1870961901153280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290412.512332:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:94075:x1870961901153280:12345-0@lo:502:llog_process_th.0 Request processed in 122us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290412.512383:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784290412.512433:0:94075:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94075:1870961901153280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784290412.512482:0:94075:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784290412.512491:0:94075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290412.512494:0:94075:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784290412.512502:0:94075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784290412.512596:0:94052:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1784290412.512641:0:94052:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784290412.512669:0:94052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3075335 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307533c expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290412.512686:0:94052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3075335 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307533c expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290412.512767:0:94052:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784290412.512770:0:94052:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c247e403000 10000000:01000000:2.0:1784290412.512774:0:94052:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c247e403000 10000000:01000000:2.0:1784290412.512779:0:94052:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784290412.512785:0:94052:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c247e403000 from 1 10000000:01000000:2.0:1784290412.512788:0:94052:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784290412.512819:0:94052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b3075343 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290412.512828:0:94052:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b3075343 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290412.512837:0:94052:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b3075343 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290412.512855:0:94052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901153408:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784290412.512918:0:94052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290412.512984:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901153408 00000100:00100000:2.0:1784290412.512990:0:94052:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23458440c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290412.512995:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901153408 00000100:00100000:3.0:1784290412.513057:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784290412.513069:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:94052:x1870961901153408:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784290412.513081:0:94058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290412.513097:0:94058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247d2ff200/0x5953bbf6b307534a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3075343 expref: -99 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290412.513120:0:94058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247d2ff200/0x5953bbf6b307534a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3075343 expref: 11 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290412.513171:0:94058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247d2ff200/0x5953bbf6b307534a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075343 expref: 11 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290412.513181:0:94058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2ff200, rc 0) 00000100:00100000:3.0:1784290412.513232:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:94052:x1870961901153408:12345-0@lo:101:mount.lustre.0 Request processed in 167us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290412.513239:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784290412.513298:0:94052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901153408:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784290412.513323:0:94052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b3075343 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307534a expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290412.513372:0:94052:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b3075343 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307534a expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290412.513462:0:94052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901153536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784290412.513511:0:94052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290412.513563:0:94052:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23458440c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290412.513586:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901153536 00000100:00100000:1.0:1784290412.513597:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901153536 00000100:00100000:1.0:1784290412.513658:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784290412.513674:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:94052:x1870961901153536:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784290412.513805:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:94052:x1870961901153536:12345-0@lo:501:mount.lustre.0 Request processed in 137us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290412.513814:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784290412.513859:0:94052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901153536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784290412.513897:0:94052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901153664:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784290412.513952:0:94052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290412.513980:0:94052:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23458440c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290412.514052:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901153664 00000100:00100000:3.0:1784290412.514061:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901153664 00000100:00100000:3.0:1784290412.514129:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784290412.514175:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:94052:x1870961901153664:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784290412.514303:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:94052:x1870961901153664:12345-0@lo:503:mount.lustre.0 Request processed in 163us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290412.514311:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784290412.514411:0:94052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901153664:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784290412.514807:0:94077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94077:1870961901153792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290412.514866:0:94077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290412.514929:0:94077:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23448fc240 going to sleep for 11 seconds 00000100:00100000:3.0:1784290412.514937:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901153792 00000100:00100000:3.0:1784290412.514946:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901153792 00000100:00100000:3.0:1784290412.514987:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784290412.514996:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:94077:x1870961901153792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290412.515099:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:94077:x1870961901153792:12345-0@lo:502:llog_process_th.0 Request processed in 103us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290412.515107:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784290412.515173:0:94077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94077:1870961901153792:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1784290412.515252:0:94077:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1784290412.515266:0:94077:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c247d26b380) 00000020:00000080:0.0:1784290412.515291:0:94077:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1784290412.515508:0:94077:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c247e403000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784290412.515513:0:94077:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c247e403000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784290412.515525:0:94077:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c247e403000 4 00010000:00080000:0.0:1784290412.515560:0:94077:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c246ff64000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.106@tcp at head 00010000:00010000:0.0:1784290412.518735:0:94077:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1784290412.518867:0:94077:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1784290412.518972:0:94077:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784290412.518985:0:94077:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5953bbf6b3075358 00000100:00080000:0.0:1784290412.518994:0:94077:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784290412.518999:0:94077:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c246ff64000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290412.519032:0:94077:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2474e8c700 x1870961901153920/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290412.519065:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901153920:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784290412.519138:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290412.519265:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901153920 00000100:00080000:0.0:1784290412.519265:0:94077:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784290412.519278:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901153920 00000100:00100000:3.0:1784290412.519462:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:3.0:1784290412.519475:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901153920:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1784290412.519572:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3616:x1870961901153920:12345-0@lo:38:llog_process_th.0 Request processed in 97us (433us total) trans 0 rc -11/-11 00000100:00100000:3.0:1784290412.519594:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:0.0:1784290412.519648:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784290412.519662:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246ff64000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290412.519673:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1784290412.519682:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901153920:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784290412.519885:0:94077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94077:1870961901154048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290412.519955:0:94077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290412.520010:0:94077:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345844240 going to sleep for 11 seconds 00000100:00100000:3.0:1784290412.520023:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901154048 00000100:00100000:3.0:1784290412.520032:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901154048 00000100:00100000:3.0:1784290412.520072:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784290412.520082:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:94077:x1870961901154048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290412.520242:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:94077:x1870961901154048:12345-0@lo:502:llog_process_th.0 Request processed in 162us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290412.520250:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784290412.520291:0:94077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94077:1870961901154048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290412.520423:0:94077:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94077:1870961901154176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290412.520495:0:94077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290412.520529:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901154176 00000100:00100000:0.0:1784290412.520534:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901154176 00000100:00100000:0.0:1784290412.520586:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784290412.520596:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:94077:x1870961901154176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290412.520705:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:94077:x1870961901154176:12345-0@lo:502:llog_process_th.0 Request processed in 109us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290412.520715:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784290412.520790:0:94077:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23448fc240 going to sleep for 11 seconds 00000100:00100000:0.0:1784290412.520810:0:94077:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94077:1870961901154176:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784290412.520841:0:94077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1784290412.520923:0:94052:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-57 (rc=0) 10000000:01000000:1.0:1784290412.520971:0:94052:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784290412.520988:0:94052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b3075343 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307534a expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290412.521000:0:94052:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b3075343 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307534a expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784290412.521057:0:94052:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784290412.521059:0:94052:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784290412.521061:0:94052:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290412.521063:0:94052:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290412.521064:0:94052:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290412.521066:0:94052:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290412.521068:0:94052:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784290412.521070:0:94052:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784290412.521072:0:94052:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290412.521074:0:94052:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784290412.521079:0:94052:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1784290412.521082:0:94052:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784290412.521083:0:94052:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784290412.521084:0:94052:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290412.521085:0:94052:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290412.521088:0:94052:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290412.521089:0:94052:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290412.521090:0:94052:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784290412.521091:0:94052:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784290412.521092:0:94052:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290412.521093:0:94052:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784290412.521108:0:94052:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1784290412.521120:0:94052:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901154304:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784290412.521193:0:94052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290412.521217:0:94052:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246deb3480 going to sleep for 11 seconds 00000100:00100000:3.0:1784290412.521243:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901154304 00000100:00100000:3.0:1784290412.521252:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901154304 00000100:00100000:3.0:1784290412.521301:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784290412.521316:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:94052:x1870961901154304:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784290412.521376:0:94058:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784290412.521393:0:94058:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1784290412.523582:0:94058:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784290412.523596:0:94058:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1784290412.523621:0:94061:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784290412.523629:0:94061:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784290412.523652:0:94061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b307535f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.523674:0:94061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c234236d800/0x5953bbf6b307532e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075327 expref: 11 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.523687:0:94061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b307535f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.523731:0:94061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c234236d800/0x5953bbf6b307532e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3075327 expref: 11 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.523757:0:94061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c234236d800/0x5953bbf6b307532e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3075327 expref: 11 pid: 94062 timeout: 2253 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290412.523777:0:94061:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94061:1870961901154432:0@lo:104: 00000100:00100000:1.0:1784290412.523837:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:94052:x1870961901154304:12345-0@lo:253:mount.lustre.0 Request processed in 2522us (2638us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290412.523856:0:94061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290412.523864:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784290412.523935:0:94061:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23448fc240 going to sleep for 11 seconds 00000100:00100000:1.0:1784290412.523961:0:94052:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:94052:1870961901154304:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784290412.523969:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901154432 10000000:01000000:1.0:1784290412.523977:0:94052:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000100:00100000:3.0:1784290412.523978:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901154432 00000020:01000004:1.0:1784290412.523985:0:94052:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784290412.523989:0:94052:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784290412.523991:0:94052:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784290412.523993:0:94052:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784290412.523994:0:94052:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784290412.523997:0:94052:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784290412.523999:0:94052:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784290412.524001:0:94052:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784290412.524004:0:94052:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784290412.524006:0:94052:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784290412.524020:0:94052:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1784290412.524034:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1784290412.524045:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:94061:x1870961901154432:12345-0@lo:104: 00010000:00010000:3.0:1784290412.524060:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c247f8cae00/0x5953bbf6b3075327 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b307532e expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290412.524140:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784290412.524164:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:94061:x1870961901154432:12345-0@lo:104: Request processed in 121us (321us total) trans 0 rc 0/0 00010000:00010000:2.0:1784290412.524169:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1784290412.524179:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1784290412.524181:0:94061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94061:1870961901154432:0@lo:104: 00010000:00010000:2.0:1784290412.524185:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247f8cae00/0x5953bbf6b3075327 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b307532e expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290412.524208:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cae00 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:2.0:1784290412.524214:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247f8cae00/0x5953bbf6b3075327 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b307532e expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290412.524225:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247f8cae00/0x5953bbf6b3075327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b307532e expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.524229:0:94061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b307535f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290412.524235:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247f8cae00/0x5953bbf6b3075327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b307532e expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290412.524247:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784290412.524291:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247f8cae00/0x5953bbf6b3075327 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307532e expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290412.524298:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784290412.524331:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247f8cae00/0x5953bbf6b3075327 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307532e expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290412.524406:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901154560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290412.524458:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784290412.524510:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247f8cae00/0x5953bbf6b3075327 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307532e expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290412.524542:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901154560 00000100:00100000:0.0:1784290412.524549:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901154560 00010000:00010000:2.0:1784290412.524571:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290412.524578:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c234236d800/0x5953bbf6b307532e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075327 expref: 11 pid: 94062 timeout: 2253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290412.524580:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290412.524588:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290412.524610:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614 00000100:00100000:0.0:1784290412.524626:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:3618:x1870961901154560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290412.524639:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290412.524645:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c234236d800/0x5953bbf6b307532e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075327 expref: 11 pid: 94062 timeout: 2253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.524658:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c234236d800/0x5953bbf6b307532e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3075327 expref: 11 pid: 94062 timeout: 2253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.524674:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236d800/0x5953bbf6b307532e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3075327 expref: 11 pid: 94062 timeout: 2253 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.524689:0:9491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b307535f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.524696:0:9491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b307535f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784290412.524709:0:9491:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001081100s 00010000:00010000:0.0:1784290412.524713:0:9491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b307535f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.524729:0:9491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b307535f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.524737:0:9491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b307535f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.524745:0:9491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b307535f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.524750:0:9491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290412.524756:0:9491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b307535f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.524764:0:9491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b307535f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.524777:0:9491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b307535f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.524788:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784290412.524838:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:3618:x1870961901154560:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290412.524846:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614 00000100:00100000:0.0:1784290412.524891:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901154560:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290412.524919:0:94061:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b307535f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.524926:0:94061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b307535f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290412.524946:0:94061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebf000/0x5953bbf6b307535f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1784290412.529898:0:94052:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444064 00000040:01000000:0.0:1784290412.530237:0:94052:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1784290412.530254:0:94083:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444064 00000020:00080000:1.0:1784290412.530263:0:94083:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444064 00000040:01000000:0.0:1784290412.530603:0:94084:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784290412.530640:0:94052:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1784290412.530962:0:94084:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1784290412.531481:0:94052:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1784290412.531515:0:94052:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784290412.535500:0:94085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581aad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94085:1870961901154688:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784290412.535556:0:94085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290412.535605:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901154688 00000100:00100000:2.0:1784290412.535612:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901154688 00000100:00100000:2.0:1784290412.535657:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3892 00000100:00100000:2.0:1784290412.535671:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94085:x1870961901154688:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784290412.535768:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94085:x1870961901154688:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 98us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290412.535780:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3892 00000100:00100000:3.0:1784290412.535837:0:94085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2447eedf00 going to sleep for 11 seconds 00000100:00100000:3.0:1784290412.535863:0:94085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581aad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94085:1870961901154688:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1784290412.535898:0:94085:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1784290412.535935:0:94085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94085:1870961901154816:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784290412.535975:0:94085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290412.535998:0:94085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343350f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784290412.536025:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901154816 00000100:00100000:2.0:1784290412.536032:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901154816 00000100:00100000:2.0:1784290412.536068:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3893 00000100:00100000:2.0:1784290412.536077:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94085:x1870961901154816:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784290412.536230:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94085:x1870961901154816:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 154us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290412.536238:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3893 00000100:00100000:3.0:1784290412.536261:0:94085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94085:1870961901154816:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784290412.536314:0:94085:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94085:1870961901154944:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1784290412.536509:0:94085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290412.536536:0:94085:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343350180 going to sleep for 11 seconds 00000100:00100000:2.0:1784290412.536552:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901154944 00000100:00100000:2.0:1784290412.536559:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901154944 00000100:00100000:2.0:1784290412.536594:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3894 00000100:00100000:2.0:1784290412.536602:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94085:x1870961901154944:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784290412.536680:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:94085:x1870961901154944:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 77us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290412.536705:0:94085:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:94085:1870961901154944:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1784290412.536716:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3894 00000040:00080000:3.0:1784290412.536785:0:94085:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1784290412.538506:0:94052:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1784290412.538517:0:94052:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1784290412.538562:0:94052:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784290412.558510:0:94052:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1784290412.571282:0:94052:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1784290412.571325:0:94052:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1784290412.571445:0:94052:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1784290412.571872:0:94052:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00010000:00080000:0.0:1784290412.572998:0:94052:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 115964117002 00010000:00080000:2.0:1784290412.573527:0:94086:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 94086 00010000:02000000:2.0:1784290412.573537:0:94086:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1784290412.573541:0:94086:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1784290412.573544:0:94086:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1784290412.573579:0:94052:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784290412.573593:0:94052:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784290412.573610:0:94052:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1784290412.573618:0:94052:0:(super25.c:181:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000040:00080000:3.0:1784290412.578259:0:94085:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x2400090a3:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784290412.578403:0:94085:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1784290412.578428:0:94084:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1784290412.578530:0:94084:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1784290412.578535:0:94084:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:3.0:1784290412.578575:0:94086:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:00000004:1.0:1784290412.580954:0:94052:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784290412.581853:0:94052:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1784290413.223556:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784290414.056409:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784290414.056417:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9c247e403000 from 124 10000000:01000000:3.0:1784290414.056422:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784290414.056482:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe400/0x5953bbf6b3075366 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.056495:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe400/0x5953bbf6b3075366 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.056507:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe400/0x5953bbf6b3075366 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290414.056538:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901155072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.056629:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290414.056743:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fda7480 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.056751:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901155072 00000100:00100000:0.0:1784290414.056770:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901155072 00000100:00100000:0.0:1784290414.056850:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784290414.056867:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+10:6485:x1870961901155072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290414.056889:0:94059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290414.056912:0:94059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b307536d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3075366 expref: -99 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.056946:0:94059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b307536d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3075366 expref: 11 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.056982:0:94059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b307536d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075366 expref: 11 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.056993:0:94059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebe000, rc 0) 00000100:00100000:0.0:1784290414.057122:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901155072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 239us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290414.057159:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784290414.057197:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901155072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290414.057222:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe400/0x5953bbf6b3075366 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307536d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.057233:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe400/0x5953bbf6b3075366 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307536d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290414.057290:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901155200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.057331:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290414.057400:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fda7480 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.057435:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901155200 00000100:00100000:0.0:1784290414.057444:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901155200 00000100:00100000:0.0:1784290414.057494:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784290414.057506:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901155200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784290414.057528:0:94060:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784290414.057553:0:94060:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784290414.057558:0:94060:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 124 00000100:00100000:0.0:1784290414.057743:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901155200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 238us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290414.057756:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784290414.057774:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901155200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784290414.057827:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784290414.057833:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe400/0x5953bbf6b3075366 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307536d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.057842:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe400/0x5953bbf6b3075366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307536d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290414.057850:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784290414.057851:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c23452c5000 from 58 10000000:01000000:3.0:1784290414.057853:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784290414.057870:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3075374 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.057876:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3075374 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.057882:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3075374 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290414.057899:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901155328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.057933:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290414.057951:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fda7480 going to sleep for 11 seconds 00000100:00100000:1.0:1784290414.058005:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901155328 00000100:00100000:1.0:1784290414.058013:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901155328 00000100:00100000:1.0:1784290414.058065:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784290414.058074:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+11:6485:x1870961901155328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290414.058086:0:94062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290414.058100:0:94062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247f8ca200/0x5953bbf6b307537b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3075374 expref: -99 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.058120:0:94062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247f8ca200/0x5953bbf6b307537b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3075374 expref: 12 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.058128:0:94062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247f8ca200/0x5953bbf6b307537b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075374 expref: 12 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.058151:0:94062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8ca200, rc 0) 00000100:00100000:1.0:1784290414.058192:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901155328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290414.058199:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784290414.058218:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901155328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290414.058232:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3075374 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307537b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.058239:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3075374 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307537b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290414.058295:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901155456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.058317:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290414.058333:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fda7480 going to sleep for 11 seconds 00000100:00100000:1.0:1784290414.058374:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901155456 00000100:00100000:1.0:1784290414.058379:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901155456 00000100:00100000:1.0:1784290414.058423:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784290414.058436:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901155456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290414.058586:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901155456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290414.058592:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784290414.058614:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901155456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.058659:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901155584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.058721:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290414.058752:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c245fda7480 going to sleep for 11 seconds 00000100:00100000:1.0:1784290414.058770:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901155584 00000100:00100000:1.0:1784290414.058775:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901155584 00000100:00100000:1.0:1784290414.058805:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784290414.058810:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901155584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290414.058914:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901155584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290414.058921:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784290414.058941:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901155584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784290414.059612:0:94291:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:2.0:1784290414.059695:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:2.0:1784290414.059727:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784290414.059733:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3075374 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307537b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290414.059742:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3075374 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307537b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290414.059749:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784290414.059750:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9c23452c5000 from 121 10000000:01000000:2.0:1784290414.059752:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784290414.059772:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236d800/0x5953bbf6b3075382 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290414.059782:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c234236d800/0x5953bbf6b3075382 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290414.059791:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c234236d800/0x5953bbf6b3075382 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290414.059810:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901155712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290414.059849:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290414.059892:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901155712 00000100:00100000:2.0:1784290414.059895:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458ac2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784290414.059897:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901155712 00000100:00100000:3.0:1784290414.059935:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784290414.059943:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+12:6485:x1870961901155712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290414.059950:0:94060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290414.059972:0:94060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247d2ff400/0x5953bbf6b3075389 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3075382 expref: -99 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.059989:0:94060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247d2ff400/0x5953bbf6b3075389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3075382 expref: 13 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.060001:0:94060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247d2ff400/0x5953bbf6b3075389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075382 expref: 13 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.060007:0:94060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2ff400, rc 0) 00000100:00100000:3.0:1784290414.060043:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901155712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290414.060050:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784290414.060081:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901155712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290414.060100:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c234236d800/0x5953bbf6b3075382 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075389 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290414.060106:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c234236d800/0x5953bbf6b3075382 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075389 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290414.060158:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901155840:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784290414.060184:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290414.060201:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458ac2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784290414.060215:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901155840 00000100:00100000:3.0:1784290414.060219:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901155840 00000100:00100000:3.0:1784290414.060247:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784290414.060253:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901155840:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784290414.060265:0:94062:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784290414.060280:0:94062:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784290414.060283:0:94062:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1784290414.060286:0:94062:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1784290414.060288:0:94062:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1784290414.060291:0:94062:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 124 00000100:00100000:3.0:1784290414.060426:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901155840:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 171us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290414.060433:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784290414.060442:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901155840:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1784290414.060524:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784290414.060529:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236d800/0x5953bbf6b3075382 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075389 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290414.060535:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c234236d800/0x5953bbf6b3075382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075389 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290414.060540:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1784290414.060541:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:2.0:1784290414.060543:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1784290414.060561:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236d400/0x5953bbf6b3075390 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290414.060566:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c234236d400/0x5953bbf6b3075390 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290414.060571:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c234236d400/0x5953bbf6b3075390 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290414.060592:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901155968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784290414.060636:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290414.060667:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458ac2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784290414.060672:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901155968 00000100:00100000:3.0:1784290414.060679:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901155968 00000100:00100000:3.0:1784290414.060732:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784290414.060740:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+13:6485:x1870961901155968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290414.060753:0:94058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290414.060762:0:94058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247d2ffc00/0x5953bbf6b3075397 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3075390 expref: -99 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.060776:0:94058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247d2ffc00/0x5953bbf6b3075397 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3075390 expref: 14 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.060782:0:94058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247d2ffc00/0x5953bbf6b3075397 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075390 expref: 14 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.060789:0:94058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2ffc00, rc 0) 00000100:00100000:3.0:1784290414.060823:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901155968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290414.060828:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784290414.060861:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581a8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901155968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290414.060872:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c234236d400/0x5953bbf6b3075390 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075397 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.060880:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c234236d400/0x5953bbf6b3075390 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075397 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290414.060913:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901156096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.060934:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290414.060958:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20780 going to sleep for 11 seconds 00000100:00100000:2.0:1784290414.060961:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901156096 00000100:00100000:2.0:1784290414.060967:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901156096 00000100:00100000:2.0:1784290414.060999:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784290414.061008:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901156096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290414.061120:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901156096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290414.061127:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1784290414.061147:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901156096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.061192:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901156224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.061233:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290414.061254:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20780 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.061294:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901156224 00000100:00100000:0.0:1784290414.061304:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901156224 00000100:00100000:3.0:1784290414.061413:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784290414.061430:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901156224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.061544:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901156224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290414.061551:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784290414.061631:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901156224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784290414.063032:0:94294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 52 00000020:01000000:3.0:1784290414.063192:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-52 (rc=0) 10000000:01000000:3.0:1784290414.063236:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1784290414.063247:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c234236d400/0x5953bbf6b3075390 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075397 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.063256:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c234236d400/0x5953bbf6b3075390 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075397 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290414.063263:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1784290414.063265:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9c23452c5000 from 1 10000000:01000000:3.0:1784290414.063268:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784290414.063289:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff600/0x5953bbf6b307539e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.063294:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff600/0x5953bbf6b307539e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.063300:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff600/0x5953bbf6b307539e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290414.063321:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901156352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.063386:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290414.063451:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901156352 00000100:00100000:3.0:1784290414.063453:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20780 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.063464:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901156352 00000100:00100000:0.0:1784290414.063534:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784290414.063557:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+14:6485:x1870961901156352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290414.063571:0:94062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290414.063592:0:94062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b30753a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307539e expref: -99 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.063637:0:94062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b30753a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307539e expref: 15 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.063651:0:94062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebf800/0x5953bbf6b30753a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307539e expref: 15 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.063662:0:94062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebf800, rc 0) 00000100:00100000:0.0:1784290414.063763:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:6485:x1870961901156352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 216us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290414.063775:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784290414.063783:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901156352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290414.063809:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff600/0x5953bbf6b307539e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30753a5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.063822:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff600/0x5953bbf6b307539e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30753a5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290414.063832:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784290414.063836:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff600/0x5953bbf6b307539e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30753a5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.063842:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff600/0x5953bbf6b307539e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30753a5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290414.063847:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784290414.063848:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c23452c5000 from 7 10000000:01000000:3.0:1784290414.063849:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784290414.063864:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b30753ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.063868:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b30753ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.063875:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b30753ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290414.063895:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901156480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.063928:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290414.063945:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20780 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.063979:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901156480 00000100:00100000:0.0:1784290414.063986:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901156480 00000100:00100000:0.0:1784290414.064027:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784290414.064039:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:6485:x1870961901156480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290414.064049:0:94060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290414.064060:0:94060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebf400/0x5953bbf6b30753b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30753ac expref: -99 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.064078:0:94060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebf400/0x5953bbf6b30753b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30753ac expref: 16 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.064105:0:94060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebf400/0x5953bbf6b30753b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30753ac expref: 16 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.064115:0:94060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebf400, rc 0) 00000100:00100000:0.0:1784290414.064217:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901156480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290414.064226:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784290414.064239:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901156480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290414.064264:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b30753ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30753b3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.064272:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b30753ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30753b3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290414.064312:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901156608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.064495:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290414.064521:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20780 going to sleep for 11 seconds 00000100:00100000:1.0:1784290414.064529:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901156608 00000100:00100000:1.0:1784290414.064536:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901156608 00000100:00100000:1.0:1784290414.064570:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784290414.064579:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901156608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290414.064653:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901156608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290414.064659:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784290414.064698:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901156608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.064722:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901156736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.064756:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290414.064774:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20780 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.064805:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901156736 00000100:00100000:0.0:1784290414.064813:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901156736 00000100:00100000:0.0:1784290414.064861:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1784290414.064875:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901156736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290414.065026:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901156736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290414.065035:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784290414.065056:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901156736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784290414.066187:0:94295:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784290414.066282:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784290414.066326:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784290414.066334:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b30753ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30753b3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.066372:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b30753ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30753b3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290414.066383:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784290414.066386:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c246ff27800 from 58 10000000:01000000:1.0:1784290414.066389:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784290414.066426:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb600/0x5953bbf6b30753ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.066433:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb600/0x5953bbf6b30753ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.066440:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb600/0x5953bbf6b30753ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290414.066462:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901156864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290414.066500:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290414.066547:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901156864 00000100:00100000:1.0:1784290414.066551:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23448fc840 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.066556:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901156864 00000100:00100000:0.0:1784290414.066609:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784290414.066624:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901156864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290414.066634:0:94062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290414.066646:0:94062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b30753c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30753ba expref: -99 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.066686:0:94062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b30753c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30753ba expref: 17 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.066697:0:94062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b30753c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30753ba expref: 17 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.066706:0:94062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebfe00, rc 0) 00000100:00100000:0.0:1784290414.066768:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901156864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290414.066776:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784290414.066795:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901156864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290414.066813:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb600/0x5953bbf6b30753ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30753c1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.066820:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb600/0x5953bbf6b30753ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30753c1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290414.066864:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901156992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290414.066892:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290414.066909:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23448fc840 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.066927:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901156992 00000100:00100000:0.0:1784290414.066933:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901156992 00000100:00100000:0.0:1784290414.066973:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1784290414.066994:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901156992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290414.067159:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901156992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290414.067168:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784290414.067175:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901156992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290414.067212:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901157120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290414.067252:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290414.067268:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23448fc840 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.067287:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901157120 00000100:00100000:0.0:1784290414.067294:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901157120 00000100:00100000:0.0:1784290414.067334:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784290414.067394:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901157120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290414.067521:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901157120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290414.067531:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901157120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290414.067532:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000040:00080000:0.0:1784290414.068680:0:94297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:1.0:1784290414.068755:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:1.0:1784290414.068793:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784290414.068800:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb600/0x5953bbf6b30753ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30753c1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.068806:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb600/0x5953bbf6b30753ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30753c1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290414.068818:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1784290414.068820:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1784290414.068822:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784290414.068836:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247f8ca600/0x5953bbf6b30753c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.068842:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247f8ca600/0x5953bbf6b30753c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.068848:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247f8ca600/0x5953bbf6b30753c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290414.068859:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901157248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290414.068886:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290414.068916:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23448fc840 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.068933:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901157248 00000100:00100000:0.0:1784290414.068941:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901157248 00000100:00100000:0.0:1784290414.068989:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784290414.069007:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901157248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290414.069018:0:94058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290414.069029:0:94058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebfc00/0x5953bbf6b30753cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30753c8 expref: -99 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.069048:0:94058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebfc00/0x5953bbf6b30753cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30753c8 expref: 18 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.069057:0:94058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebfc00/0x5953bbf6b30753cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30753c8 expref: 18 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.069065:0:94058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebfc00, rc 0) 00000100:00100000:0.0:1784290414.069189:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901157248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290414.069192:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901157248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290414.069205:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247f8ca600/0x5953bbf6b30753c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30753cf expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.069234:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247f8ca600/0x5953bbf6b30753c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30753cf expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290414.069235:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784290414.069303:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901157376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290414.069332:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290414.069402:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23448fc840 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.069440:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901157376 00000100:00100000:0.0:1784290414.069449:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901157376 00000100:00100000:0.0:1784290414.069515:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784290414.069537:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901157376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290414.069725:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901157376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 193us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290414.069737:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784290414.069753:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901157376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290414.069792:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901157504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290414.069842:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290414.069859:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23448fc840 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.069878:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901157504 00000100:00100000:0.0:1784290414.069885:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901157504 00000100:00100000:0.0:1784290414.069935:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784290414.069945:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901157504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290414.070725:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901157504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 776us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290414.070737:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784290414.070758:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901157504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784290414.071384:0:94299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1784290414.071514:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1784290414.071581:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1784290414.071592:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247f8ca600/0x5953bbf6b30753c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30753cf expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.071602:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247f8ca600/0x5953bbf6b30753c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30753cf expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290414.071620:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784290414.071623:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c246ff27800 from 7 10000000:01000000:3.0:1784290414.071627:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784290414.071653:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b30753d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.071665:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b30753d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.071675:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b30753d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290414.071698:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901157632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.071735:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290414.071771:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901157632 00000100:00100000:1.0:1784290414.071777:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901157632 00000100:00100000:3.0:1784290414.071782:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20600 going to sleep for 11 seconds 00000100:00100000:1.0:1784290414.071816:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784290414.071827:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dde1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901157632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290414.071835:0:94059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290414.071845:0:94059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247f8caa00/0x5953bbf6b30753dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30753d6 expref: -99 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.071866:0:94059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247f8caa00/0x5953bbf6b30753dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30753d6 expref: 19 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.071874:0:94059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247f8caa00/0x5953bbf6b30753dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30753d6 expref: 19 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.071880:0:94059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8caa00, rc 0) 00000100:00100000:1.0:1784290414.071915:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dde1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901157632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290414.071921:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784290414.071930:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901157632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290414.071941:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b30753d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30753dd expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.071948:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b30753d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30753dd expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290414.071988:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901157760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.072011:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290414.072026:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20600 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.072060:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901157760 00000100:00100000:0.0:1784290414.072069:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901157760 00000100:00100000:0.0:1784290414.072147:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784290414.072166:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dde2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901157760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290414.072308:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dde2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901157760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290414.072321:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784290414.072337:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901157760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.072412:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901157888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.072462:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290414.072508:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901157888 00000100:00100000:3.0:1784290414.072509:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20600 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.072518:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901157888 00000100:00100000:0.0:1784290414.072566:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784290414.072582:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dde0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901157888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290414.072704:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dde0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901157888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290414.072718:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784290414.072738:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901157888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784290414.073838:0:94300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784290414.073906:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784290414.073926:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784290414.073938:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b30753d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30753dd expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.073946:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b30753d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30753dd expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290414.073953:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784290414.073957:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c247d3d2000 from 58 10000000:01000000:3.0:1784290414.073960:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784290414.073979:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b30753e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.073987:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b30753e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.073993:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b30753e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290414.074008:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901158016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.074053:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290414.074086:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290414.074086:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901158016 00000100:00100000:1.0:1784290414.074092:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901158016 00000100:00100000:1.0:1784290414.074123:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784290414.074140:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dde1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901158016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290414.074147:0:94060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290414.074162:0:94060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b30753eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30753e4 expref: -99 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.074175:0:94060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b30753eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30753e4 expref: 20 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.074183:0:94060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b30753eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30753e4 expref: 20 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.074187:0:94060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8ca400, rc 0) 00000100:00100000:1.0:1784290414.074220:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dde1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901158016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290414.074226:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784290414.074240:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901158016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290414.074253:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b30753e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30753eb expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.074267:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b30753e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30753eb expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290414.074306:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901158144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.074384:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290414.074441:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901158144 00000100:00100000:3.0:1784290414.074447:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.074450:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901158144 00000100:00100000:0.0:1784290414.074508:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784290414.074518:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dde3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901158144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290414.074640:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dde3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901158144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290414.074649:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784290414.074656:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901158144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.074701:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901158272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.074741:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290414.074764:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c244ab20cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.074786:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901158272 00000100:00100000:0.0:1784290414.074793:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901158272 00000100:00100000:0.0:1784290414.074860:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784290414.074875:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901158272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290414.075000:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901158272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290414.075012:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784290414.075017:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901158272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784290414.076030:0:94302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:3.0:1784290414.076125:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:3.0:1784290414.076186:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290414.076197:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b30753e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30753eb expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.076204:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b30753e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30753eb expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290414.076211:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1784290414.076213:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1784290414.076215:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784290414.076229:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fea00/0x5953bbf6b30753f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.076235:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2fea00/0x5953bbf6b30753f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.076249:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2fea00/0x5953bbf6b30753f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290414.076260:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901158400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.076289:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290414.076393:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2447ccc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.076435:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901158400 00000100:00100000:0.0:1784290414.076444:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901158400 00000100:00100000:0.0:1784290414.076503:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784290414.076518:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901158400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290414.076529:0:94062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290414.076541:0:94062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b30753f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30753f2 expref: -99 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.076582:0:94062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b30753f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30753f2 expref: 21 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.076593:0:94062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b30753f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30753f2 expref: 21 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.076604:0:94062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebea00, rc 0) 00000100:00100000:0.0:1784290414.076670:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901158400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290414.076683:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784290414.076710:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901158400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290414.076730:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2fea00/0x5953bbf6b30753f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30753f9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.076738:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2fea00/0x5953bbf6b30753f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30753f9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290414.076776:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901158528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.076810:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290414.076833:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2447ccc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.076856:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901158528 00000100:00100000:0.0:1784290414.076863:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901158528 00000100:00100000:0.0:1784290414.076927:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784290414.076940:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901158528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290414.077080:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901158528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290414.077095:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784290414.077103:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901158528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.077161:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901158656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.077206:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290414.077222:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2447ccc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.077238:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901158656 00000100:00100000:0.0:1784290414.077245:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901158656 00000100:00100000:0.0:1784290414.077291:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784290414.077307:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901158656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290414.077866:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901158656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 558us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290414.077876:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784290414.077883:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901158656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784290414.078978:0:94304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1784290414.079059:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1784290414.079084:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784290414.079089:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fea00/0x5953bbf6b30753f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30753f9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.079103:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2fea00/0x5953bbf6b30753f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30753f9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290414.079112:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784290414.079114:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c247d3d2000 from 7 10000000:01000000:3.0:1784290414.079118:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784290414.079154:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3075400 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.079162:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3075400 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290414.079169:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3075400 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290414.079182:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901158784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.079239:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290414.079308:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901158784 00000100:00100000:3.0:1784290414.079310:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2447ccc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.079325:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901158784 00000100:00100000:0.0:1784290414.079453:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784290414.079472:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901158784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290414.079482:0:94058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290414.079496:0:94058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebf600/0x5953bbf6b3075407 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3075400 expref: -99 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.079517:0:94058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebf600/0x5953bbf6b3075407 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3075400 expref: 22 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.079529:0:94058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebf600/0x5953bbf6b3075407 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075400 expref: 22 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.079538:0:94058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebf600, rc 0) 00000100:00100000:0.0:1784290414.079608:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901158784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290414.079618:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784290414.079637:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901158784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290414.079654:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3075400 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075407 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.079664:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3075400 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075407 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290414.079708:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901158912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290414.079739:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290414.079787:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901158912 00000100:00100000:1.0:1784290414.079791:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23448fc840 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.079794:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901158912 00000100:00100000:0.0:1784290414.079840:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784290414.079849:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901158912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290414.079951:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901158912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290414.079962:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784290414.079983:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901158912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290414.080018:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901159040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290414.080058:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290414.080076:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23448fc840 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.080099:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901159040 00000100:00100000:0.0:1784290414.080106:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901159040 00000100:00100000:0.0:1784290414.080172:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1784290414.080186:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901159040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290414.080309:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901159040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290414.080318:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901159040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290414.080320:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000040:00080000:0.0:1784290414.081244:0:94306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784290414.081309:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784290414.081485:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784290414.081492:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3075400 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075407 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.081500:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3075400 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075407 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290414.081507:0:6485:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1784290414.081509:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9c2480260000 from 1 10000000:01000000:1.0:1784290414.081512:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784290414.081534:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247f8cbe00/0x5953bbf6b307540e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.081539:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247f8cbe00/0x5953bbf6b307540e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.081545:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247f8cbe00/0x5953bbf6b307540e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290414.081559:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901159168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290414.081603:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290414.081653:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901159168 00000100:00100000:1.0:1784290414.081657:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23448fc840 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.081664:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901159168 00000100:00100000:0.0:1784290414.081722:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784290414.081731:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901159168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290414.081746:0:94059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290414.081762:0:94059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebe600/0x5953bbf6b3075415 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307540e expref: -99 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.081781:0:94059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebe600/0x5953bbf6b3075415 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307540e expref: 23 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.081794:0:94059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebe600/0x5953bbf6b3075415 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307540e expref: 23 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.081803:0:94059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebe600, rc 0) 00000100:00100000:0.0:1784290414.081876:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901159168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290414.081886:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784290414.081892:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901159168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290414.081920:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247f8cbe00/0x5953bbf6b307540e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075415 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.081927:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247f8cbe00/0x5953bbf6b307540e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075415 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290414.081953:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784290414.081956:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247f8cbe00/0x5953bbf6b307540e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075415 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.081961:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247f8cbe00/0x5953bbf6b307540e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075415 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290414.081967:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784290414.081969:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9c2480260000 from 1 10000000:01000000:1.0:1784290414.081970:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784290414.081988:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb200/0x5953bbf6b307541c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.081993:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb200/0x5953bbf6b307541c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.081999:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb200/0x5953bbf6b307541c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290414.082009:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901159296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290414.082044:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290414.082063:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23448fc840 going to sleep for 11 seconds 00000100:00100000:0.0:1784290414.082081:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901159296 00000100:00100000:0.0:1784290414.082088:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901159296 00000100:00100000:0.0:1784290414.082149:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784290414.082162:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901159296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290414.082171:0:94058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290414.082192:0:94058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2345ebec00/0x5953bbf6b3075423 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307541c expref: -99 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.082212:0:94058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2345ebec00/0x5953bbf6b3075423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307541c expref: 24 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.082221:0:94058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2345ebec00/0x5953bbf6b3075423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307541c expref: 24 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290414.082229:0:94058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebec00, rc 0) 00000100:00100000:0.0:1784290414.082288:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901159296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290414.082299:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901159296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784290414.082309:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00010000:1.0:1784290414.082324:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb200/0x5953bbf6b307541c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075423 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.082334:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb200/0x5953bbf6b307541c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075423 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290414.082421:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901159424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290414.082451:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290414.082473:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901159424 00000100:00100000:1.0:1784290414.082477:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23448fc840 going to sleep for 11 seconds 00000100:00100000:3.0:1784290414.082480:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901159424 00000100:00100000:3.0:1784290414.082515:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784290414.082523:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901159424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290414.082584:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901159424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 62us (132us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784290414.082592:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784290414.082598:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901159424:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1784290414.082620:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784290414.082624:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb200/0x5953bbf6b307541c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075423 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290414.082629:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb200/0x5953bbf6b307541c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075423 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:3.0:1784290414.182158:0:94336:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784290414.247474:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1784290414.506184:0:94388:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1784290414.506432:0:94388:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1784290414.933441:0:94438:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784290414.933742:0:94438:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1784290415.271602:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290416.133769:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290416.133874:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290416.133909:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896276224 00000100:00100000:1.0:1784290416.133929:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896276224 00000100:00100000:3.0:1784290416.133941:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290416.133991:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896276480 00000100:00100000:3.0:1784290416.134003:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290416.134005:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896276480 00000100:00100000:1.0:1784290416.134027:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:1.0:1784290416.134043:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2400:x1870961896276224:12345-192.168.202.6@tcp:400:kworker.0 00000020:00080000:1.0:1784290416.134059:0:94060:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.6@tcp 00000100:00100000:0.0:1784290416.134144:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896276352 00000100:00100000:0.0:1784290416.134157:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896276352 00000100:00100000:2.0:1784290416.134158:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 749 00000100:00100000:3.0:1784290416.134172:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290416.134188:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:2400:x1870961896276480:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290416.134203:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2400:x1870961896276224:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 157us (446us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784290416.134217:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 61 00000100:00100000:0.0:1784290416.134234:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1289 00000100:00100000:0.0:1784290416.134247:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1870961896276352:12345-192.168.202.6@tcp:38:kworker.0 00010000:00080000:0.0:1784290416.134296:0:66004:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '711f3c77-e791-4aa8-86ee-bc854fd0bcc5' at ffff9c247e4b1000, cookie 0x5953bbf6b30752b7 00000100:00100000:2.0:1784290416.134299:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:2400:x1870961896276480:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 115us (419us total) trans 0 rc 0/0 00010000:00080000:0.0:1784290416.134314:0:66004:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp recovering/t115964117003 exp ffff9c247e4b1000 cur 2157 last 1784290412 00000100:00100000:1.0:1784290416.134325:0:26259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896276608 00010000:02000400:0.0:1784290416.134333:0:66004:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00000100:00100000:1.0:1784290416.134335:0:26259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896276608 00000100:00100000:2.0:1784290416.134412:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 749 00010000:00080000:0.0:1784290416.134417:0:66004:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1784290416.134473:0:66004:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1784290416.134474:0:26259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896276736 00000100:00100000:1.0:1784290416.134483:0:26259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896276736 00000100:00100000:2.0:1784290416.134521:0:8999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4969 00000100:00080000:3.0:1784290416.134538:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784290416.134543:0:8999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2396:x1870961896276608:12345-192.168.202.6@tcp:9:kworker.0 00000100:00080000:3.0:1784290416.134551:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290416.134573:0:26259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4970 00000020:00000080:2.0:1784290416.134584:0:8999:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b30748d8 00000100:00100000:1.0:1784290416.134595:0:26259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2396:x1870961896276736:12345-192.168.202.6@tcp:9:kworker.0 00000100:00080000:2.0:1784290416.134610:0:8999:0:(import.c:65:import_set_state_nolock()) ffff9c234687f000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1784290416.134628:0:26259:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307510c 00000100:00080000:3.0:1784290416.134634:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784290416.134648:0:26259:0:(import.c:65:import_set_state_nolock()) ffff9c2458115800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1784290416.134680:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1784290416.134715:0:8999:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294968631 00010000:00010000:3.0:1784290416.134721:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1784290416.134778:0:26259:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968633 00000100:00080000:0.0:1784290416.134836:0:66004:0:(import.c:65:import_set_state_nolock()) ffff9c2474cc1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290416.134926:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2396:x1870961896276352:12345-192.168.202.6@tcp:38:kworker.0 Request processed in 680us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290416.134937:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1289 00000100:00100000:2.0:1784290416.135001:0:8999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+2:2396:x1870961896276608:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 466us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290416.135010:0:26259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+2:2396:x1870961896276736:12345-192.168.202.6@tcp:9:kworker.0 Request processed in 424us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290416.135033:0:26259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4970 00000100:00100000:2.0:1784290416.135051:0:8999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4969 00000100:00100000:2.0:1784290416.135737:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290416.135826:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896276864 00000100:00100000:0.0:1784290416.135833:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896276864 00000100:00100000:0.0:1784290416.135879:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:0.0:1784290416.135886:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2396:x1870961896276864:12345-192.168.202.6@tcp:250:ptlrpcd_01_01.0 00010000:00080000:0.0:1784290416.135909:0:94059:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f@192.168.202.6@tcp t0 exp 0000000000000000 cur 2157 last 0 00000020:00000080:0.0:1784290416.135953:0:94059:0:(genops.c:1406:class_connect()) connect: client fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f, cookie 0x5953bbf6b307542a 00000100:00080000:0.0:1784290416.136141:0:94059:0:(import.c:65:import_set_state_nolock()) ffff9c2474cc0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290416.136203:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+5:2396:x1870961896276864:12345-192.168.202.6@tcp:250:ptlrpcd_01_01.0 Request processed in 314us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290416.136215:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 62 00000100:00100000:3.0:1784290416.136254:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290416.136381:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896269952 00000100:00100000:2.0:1784290416.136391:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896269952 00000100:00100000:2.0:1784290416.136435:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1290 00000100:00100000:2.0:1784290416.136445:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2396:x1870961896269952:12345-192.168.202.6@tcp:36:mcreate.0 00010000:00080000:2.0:1784290416.136462:0:65990:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 115964117003, current: 115964117003, replaying 00000100:00100000:2.0:1784290416.136481:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2396:x1870961896269952:12345-192.168.202.6@tcp:36:mcreate.0 Request processed in 38us (234us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784290416.136490:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1290 00010000:00080000:3.0:1784290416.136501:0:94086:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:1.0:1784290416.295608:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290416.807688:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247580b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901159552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290416.807695:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901159680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290416.807845:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290416.807931:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901159680 00000100:00100000:0.0:1784290416.807942:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290416.807949:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901159680 00000100:00100000:2.0:1784290416.808038:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901159552 00000100:00100000:2.0:1784290416.808049:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901159552 00000100:00080000:1.0:1784290416.808049:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784290416.808071:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:3.0:1784290416.808091:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901159680:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1784290416.808141:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784290416.808150:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00002000:00000024:3.0:1784290416.808170:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784290416.808172:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901159552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784290416.808208:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784290416.808262:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901159680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 176us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290416.808276:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00100000:2.0:1784290416.808295:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901159552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290416.808308:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:1.0:1784290416.808407:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901159680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1784290416.808407:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247580b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901159552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784290417.221875:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290417.221969:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896277120 00000100:00100000:1.0:1784290417.221988:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896277120 00000100:00100000:1.0:1784290417.222084:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:1.0:1784290417.222099:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+5:70750:x1870961896277120:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290417.222156:0:94060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290417.222187:0:94060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247f8cae00/0x5953bbf6b3075431 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2597 expref: -99 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.222237:0:94060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247f8cae00/0x5953bbf6b3075431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2597 expref: 6 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.222252:0:94060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247f8cae00/0x5953bbf6b3075431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2597 expref: 6 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.222293:0:94060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8cae00, rc 0) 00000100:00100000:1.0:1784290417.222420:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+6:70750:x1870961896277120:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 323us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290417.222431:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 63 00000100:00100000:3.0:1784290417.223973:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290417.224053:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896277248 00000100:00100000:0.0:1784290417.224062:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896277248 00000100:00100000:0.0:1784290417.224139:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:0.0:1784290417.224151:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+6:70750:x1870961896277248:12345-192.168.202.6@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784290417.224177:0:94062:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1784290417.224206:0:94062:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784290417.224211:0:94062:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1784290417.224215:0:94062:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1784290417.224219:0:94062:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1784290417.224223:0:94062:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 124 00000100:00100000:0.0:1784290417.225561:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+6:70750:x1870961896277248:12345-192.168.202.6@tcp:256:ll_cfg_requeue.0 Request processed in 1406us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290417.225576:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 64 00000100:00100000:2.0:1784290417.227337:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290417.227530:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896277376 00000100:00100000:3.0:1784290417.227541:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896277376 00000100:00100000:3.0:1784290417.227603:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:3.0:1784290417.227615:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+6:70750:x1870961896277376:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290417.227629:0:94058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290417.227645:0:94058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247d2fe200/0x5953bbf6b3075438 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b259e expref: -99 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.227672:0:94058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247d2fe200/0x5953bbf6b3075438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b259e expref: 7 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.227700:0:94058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247d2fe200/0x5953bbf6b3075438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b259e expref: 7 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.227711:0:94058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2fe200, rc 0) 00000100:00100000:3.0:1784290417.227767:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+7:70750:x1870961896277376:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 154us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290417.227778:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 65 00000100:00100000:3.0:1784290417.229319:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290417.229411:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896277504 00000100:00100000:2.0:1784290417.229419:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896277504 00000100:00100000:2.0:1784290417.229469:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:2.0:1784290417.229479:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+7:70750:x1870961896277504:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290417.229667:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70750:x1870961896277504:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 188us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290417.229706:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 66 00000100:00100000:1.0:1784290417.231054:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290417.231196:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896277632 00000100:00100000:0.0:1784290417.231209:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896277632 00000100:00100000:0.0:1784290417.231270:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:0.0:1784290417.231286:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70750:x1870961896277632:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290417.231503:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70750:x1870961896277632:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 218us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290417.231520:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 67 00000100:00100000:0.0:1784290417.234325:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290417.234456:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896277760 00000100:00100000:3.0:1784290417.234465:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896277760 00000100:00100000:3.0:1784290417.234519:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:3.0:1784290417.234530:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70750:x1870961896277760:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290417.234542:0:94062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290417.234557:0:94062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2482045800/0x5953bbf6b307543f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b25a5 expref: -99 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.234581:0:94062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2482045800/0x5953bbf6b307543f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25a5 expref: 9 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.234600:0:94062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2482045800/0x5953bbf6b307543f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25a5 expref: 9 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.234615:0:94062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2482045800, rc 0) 00000100:00100000:3.0:1784290417.234678:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896277760:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 145us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290417.234693:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 68 00000100:00100000:3.0:1784290417.235959:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290417.236035:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896277888 00000100:00100000:0.0:1784290417.236044:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896277888 00000100:00100000:0.0:1784290417.236091:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:0.0:1784290417.236100:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896277888:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290417.236234:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896277888:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 133us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290417.236244:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 69 00000100:00100000:1.0:1784290417.237561:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290417.237636:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896278016 00000100:00100000:2.0:1784290417.237644:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896278016 00000100:00100000:2.0:1784290417.237700:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:2.0:1784290417.237711:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896278016:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290417.237814:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896278016:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 103us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290417.237824:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 70 00000100:00100000:2.0:1784290417.240473:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290417.240538:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896278144 00000100:00100000:1.0:1784290417.240547:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896278144 00000100:00100000:1.0:1784290417.240592:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:1.0:1784290417.240603:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896278144:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290417.240614:0:94060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290417.240627:0:94060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247f8cb000/0x5953bbf6b3075446 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b25ac expref: -99 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.240652:0:94060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247f8cb000/0x5953bbf6b3075446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25ac expref: 10 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.240665:0:94060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247f8cb000/0x5953bbf6b3075446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25ac expref: 10 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.240674:0:94060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8cb000, rc 0) 00000100:00100000:1.0:1784290417.240718:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70750:x1870961896278144:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 116us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290417.240725:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 71 00000100:00100000:3.0:1784290417.241748:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290417.241830:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896278272 00000100:00100000:0.0:1784290417.241840:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896278272 00000100:00100000:0.0:1784290417.241897:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 72 00000100:00100000:0.0:1784290417.241911:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70750:x1870961896278272:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290417.242010:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70750:x1870961896278272:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 100us (264us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784290417.242026:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 72 00010000:00010000:0.0:1784290417.319639:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784290417.831658:0:60390:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1784290417.831661:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901159808:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1784290417.831675:0:60390:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1784290417.831695:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901159936:0@lo:400:kworker.0 00000100:00080000:0.0:1784290417.831712:0:60390:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784290417.831736:0:60390:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2341ea9800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:0.0:1784290417.831789:0:60390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2474e8c380 x1870961901160064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290417.831821:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290417.831831:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784290417.831897:0:60390:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784290417.831908:0:60390:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1784290417.831914:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901160064:0@lo:38:kworker.0 00000100:00080000:0.0:1784290417.831915:0:60390:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784290417.831938:0:60390:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c2342ef2800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290417.831955:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901159808 00000100:00100000:2.0:1784290417.831967:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901159808 00000100:00100000:1.0:1784290417.831980:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1870961901160192:0@lo:400:kworker.0 00000100:00100000:0.0:1784290417.831987:0:60390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2474e8ea00 x1870961901160320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784290417.831998:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784290417.832049:0:60390:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1784290417.832055:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3895 00000100:00100000:3.0:1784290417.832063:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901160320:0@lo:38:kworker.0 00000100:00100000:1.0:1784290417.832067:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784290417.832069:0:60390:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784290417.832078:0:60390:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1784290417.832080:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901159808:12345-0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1784290417.832091:0:60390:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c246dd98000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290417.832153:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784290417.832153:0:60390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2345c26a00 x1870961901160576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784290417.832155:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:2.0:1784290417.832165:0:8412:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445097472 avail 1298857984 00000100:00100000:1.0:1784290417.832174:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901160448:0@lo:400:kworker.0 00000100:00100000:3.0:1784290417.832212:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901160576:0@lo:38:kworker.0 00000100:00080000:0.0:1784290417.832247:0:60390:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784290417.832254:0:60390:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784290417.832258:0:60390:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1784290417.832268:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784290417.832273:0:60390:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c234563e800 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290417.832275:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901159808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 195us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290417.832294:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290417.832302:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3895 00000100:00100000:0.0:1784290417.832306:0:60390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2345c24380 x1870961901160960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290417.832390:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901160576 00000100:00100000:2.0:1784290417.832397:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901160576 00000100:00100000:3.0:1784290417.832402:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901160960:0@lo:38:kworker.0 00000100:00080000:0.0:1784290417.832407:0:60390:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784290417.832414:0:60390:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1784290417.832415:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901159936 00000100:00100000:1.0:1784290417.832426:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901159936 00000100:00080000:0.0:1784290417.832427:0:60390:0:(import.c:65:import_set_state_nolock()) ffff9c246ff64000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:2.0:1784290417.832428:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3896 00000100:00100000:2.0:1784290417.832441:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247580b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3616:x1870961901160576:12345-0@lo:38:kworker.0 00000100:00080000:0.0:1784290417.832445:0:60390:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c246ff64000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:3.0:1784290417.832465:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290417.832478:0:60390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2345c25c00 x1870961901161344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:2.0:1784290417.832489:0:8412:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9c247e4b0800, cookie 0x5953bbf6b30752b0 00010000:00080000:2.0:1784290417.832499:0:8412:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t115964117001 exp ffff9c247e4b0800 cur 2159 last 1784290412 00000100:00100000:0.0:1784290417.832515:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901161216:0@lo:400:kworker.0 00000100:00100000:1.0:1784290417.832517:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784290417.832528:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901161344:0@lo:38:kworker.0 00000004:00100000:2.0:1784290417.832540:0:8412:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1784290417.832543:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c248207f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3618:x1870961901159936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290417.832583:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290417.832606:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290417.832629:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784290417.832641:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901161088:0@lo:400:kworker.0 00000100:00100000:1.0:1784290417.832651:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c248207f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3618:x1870961901159936:12345-0@lo:400:kworker.0 Request processed in 113us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290417.832667:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784290417.832686:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290417.832726:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901161216 00000100:00100000:3.0:1784290417.832735:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901161216 00000100:00100000:0.0:1784290417.832771:0:26257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901161088 00000100:00100000:0.0:1784290417.832781:0:26257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901161088 00000100:00080000:1.0:1784290417.832787:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784290417.832820:0:8412:0:(import.c:65:import_set_state_nolock()) ffff9c2345895800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784290417.832821:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1618 00000100:00080000:1.0:1784290417.832825:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784290417.832842:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901161216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290417.832866:0:26257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1619 00000100:00100000:1.0:1784290417.832874:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901160704:0@lo:400:kworker.0 00000100:00100000:0.0:1784290417.832883:0:26257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901161088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290417.832920:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901161216:12345-0@lo:400:kworker.0 Request processed in 82us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290417.832926:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247580b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1870961901160576:12345-0@lo:38:kworker.0 Request processed in 480us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290417.832937:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1618 00000100:00100000:2.0:1784290417.832943:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3896 00000100:00100000:1.0:1784290417.832950:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290417.832963:0:26257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901161088:12345-0@lo:400:kworker.0 Request processed in 85us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290417.832974:0:26257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1619 00000100:00100000:3.0:1784290417.832984:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901160704 00000100:00100000:3.0:1784290417.833004:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901160704 00010000:00080000:2.0:1784290417.833004:0:94086:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1784290417.833014:0:94086:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 115964117003 00000020:00080000:2.0:1784290417.833021:0:94086:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1784290417.833026:0:94086:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 115964117003, next_transno: 115964117003 00010000:00080000:2.0:1784290417.833032:0:94086:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (115964117003) 00000100:00100000:0.0:1784290417.833036:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901161088:0@lo:400:kworker.0 00000020:00080000:2.0:1784290417.833038:0:94086:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00000100:00100000:1.0:1784290417.833042:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901159808:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1784290417.833060:0:94086:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896269952 t115964117003 from 192.168.202.6@tcp req@ffff9c246d95ed80 x1870961896269952/t0(115964117003) o36->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:437/0 lens 528/0 e 0 to 0 dl 1784290427 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290417.833067:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1620 00000100:00100000:0.0:1784290417.833068:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901161216:0@lo:400:kworker.0 00000100:00100000:1.0:1784290417.833071:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784290417.833087:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901160832:0@lo:400:kworker.0 00000100:00100000:3.0:1784290417.833115:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901160704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290417.833137:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901160064 00000100:00100000:0.0:1784290417.833143:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901160064 00000100:00100000:1.0:1784290417.833156:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290417.833175:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901160192 00000100:00100000:0.0:1784290417.833180:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901160192 00000100:00100000:3.0:1784290417.833200:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901160704:12345-0@lo:400:kworker.0 Request processed in 109us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290417.833206:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901160320 00000100:00100000:1.0:1784290417.833212:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901160704:0@lo:400:kworker.0 00000100:00100000:2.0:1784290417.833215:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901160320 00000100:00100000:3.0:1784290417.833218:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1620 00000100:00100000:0.0:1784290417.833220:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901160448 00000100:00100000:0.0:1784290417.833227:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901160448 00000100:00100000:2.0:1784290417.833252:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901160960 00000100:00100000:2.0:1784290417.833258:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901160960 00000100:00100000:1.0:1784290417.833263:0:26261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901160832 00000100:00100000:0.0:1784290417.833266:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901161344 00000100:00100000:1.0:1784290417.833270:0:26261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901160832 00000100:00100000:0.0:1784290417.833273:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901161344 00000100:00100000:2.0:1784290417.833284:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:2.0:1784290417.833300:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1870961901160192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290417.833308:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:1.0:1784290417.833324:0:26261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1621 00000100:00100000:3.0:1784290417.833331:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:0.0:1784290417.833333:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901160448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290417.833368:0:26261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901160832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290417.833389:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247580b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1870961901160064:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1784290417.833398:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1870961901160192:12345-0@lo:400:kworker.0 Request processed in 101us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290417.833406:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00010000:00080000:3.0:1784290417.833427:0:65988:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2159 last 0 00000100:00100000:2.0:1784290417.833434:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:2.0:1784290417.833442:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901160320:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290417.833450:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901160448:12345-0@lo:400:kworker.0 Request processed in 119us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290417.833457:0:26261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901160832:12345-0@lo:400:kworker.0 Request processed in 119us (297us total) trans 0 rc 0/0 00010000:00080000:2.0:1784290417.833467:0:74876:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2159 last 0 00000100:00100000:0.0:1784290417.833468:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:1.0:1784290417.833474:0:26261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1621 00000020:00000080:3.0:1784290417.833494:0:65988:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5953bbf6b307544d 00000100:00100000:0.0:1784290417.833505:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000004:00100000:3.0:1784290417.833514:0:65988:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1784290417.833514:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901160960:12345-0@lo:38:kworker.0 00000020:00000080:2.0:1784290417.833521:0:74876:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5953bbf6b3075454 00000100:00100000:1.0:1784290417.833534:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901159936:0@lo:400:kworker.0 00010000:00080000:0.0:1784290417.833542:0:66004:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2159 last 0 00000004:00100000:2.0:1784290417.833548:0:74876:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784290417.833566:0:65988:0:(import.c:65:import_set_state_nolock()) ffff9c2345299800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784290417.833588:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901160832:0@lo:400:kworker.0 00000020:00000080:0.0:1784290417.833593:0:66004:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5953bbf6b307545b 00000100:00080000:2.0:1784290417.833596:0:74876:0:(import.c:65:import_set_state_nolock()) ffff9c23454bd000 : changing import state from RECOVER to FULL 00000004:00100000:0.0:1784290417.833611:0:66004:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1784290417.833631:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901160448:0@lo:400:kworker.0 00000100:00080000:0.0:1784290417.833652:0:66004:0:(import.c:65:import_set_state_nolock()) ffff9c234687d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784290417.833653:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247580b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1870961901160064:12345-0@lo:38:kworker.0 Request processed in 263us (1660us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290417.833659:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1870961901160192:0@lo:400:kworker.0 00000100:00100000:2.0:1784290417.833668:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1870961901160320:12345-0@lo:38:kworker.0 Request processed in 220us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290417.833682:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:2.0:1784290417.833693:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00100000:2.0:1784290417.833725:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:0.0:1784290417.833727:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1870961901160960:12345-0@lo:38:kworker.0 Request processed in 207us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290417.833734:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3616:x1870961901161344:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1784290417.833753:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00010000:00080000:2.0:1784290417.833759:0:74876:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 2159 last 0 00000100:00080000:0.0:1784290417.833789:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1784290417.833799:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2345c24380 x1870961901160960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:2.0:1784290417.833804:0:74876:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5953bbf6b3075462 00000004:00100000:2.0:1784290417.833817:0:74876:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784290417.833824:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 28 00000100:00080000:2.0:1784290417.833839:0:74876:0:(import.c:65:import_set_state_nolock()) ffff9c2475c29800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784290417.833877:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467dedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1870961901161344:12345-0@lo:38:kworker.0 Request processed in 145us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290417.833885:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000004:00080000:1.0:1784290417.834464:0:94086:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1290us 00000100:00080000:3.0:1784290417.835170:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9c2345c24380 x1870961901160960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290442 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784290417.835180:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1784290417.835184:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c234563e800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1784290417.835190:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1784290417.835199:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1870961901160960:0@lo:38:kworker.0 00000100:00100000:3.0:1784290417.835221:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964117002 gen 3 00000004:00080000:3.0:1784290417.835229:0:3616:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964117001 committed transno 115964117002 00000004:00080000:3.0:1784290417.835257:0:3616:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 115964117002 committed transno 115964117002 00000100:00080000:3.0:1784290417.835275:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 28 00000100:00080000:3.0:1784290417.835285:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1784290417.835291:0:3616:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1784290417.835294:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964117002 gen 3 00000100:00080000:3.0:1784290417.835309:0:3616:0:(recover.c:53:ptlrpc_replay_next()) import ffff9c246dd98000 from lustre-MDT0000_UUID committed 115964117002 last 0 00000100:00080000:3.0:1784290417.835315:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1784290417.835646:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901160576:0@lo:38:kworker.0 00010000:00080000:3.0:1784290417.835668:0:94453:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1784290417.835674:0:94453:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00080000:1.0:1784290417.835675:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2474e8ea00 x1870961901160320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1784290417.835686:0:94453:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:1.0:1784290417.835691:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 28 00010000:00010000:3.0:1784290417.843434:0:94453:0:(ldlm_request.c:2860:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450abe00/0x5953bbf6b3074bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3074bb7 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1784290417.843457:0:94453:0:(ldlm_request.c:2910:lock_can_replay()) check lock replay limit, inflights = 1(512) 00010000:00010000:0.0:1784290417.843611:0:94086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe200/0x5953bbf6b3075469 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.843637:0:94086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe200/0x5953bbf6b3075469 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.843657:0:94086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe200/0x5953bbf6b3075469 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.843675:0:94086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b3075470 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.843683:0:94086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b3075470 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.843710:0:94086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b3075470 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784290417.844074:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9c2474e8ea00 x1870961901160320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290442 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784290417.844092:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1784290417.844117:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2342ef2800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1784290417.844141:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1784290417.844150:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1870961901160320:0@lo:38:kworker.0 00010000:00080000:1.0:1784290417.844194:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2474e8c380 x1870961901160064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784290417.844209:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00010000:00010000:0.0:1784290417.844413:0:94086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe200/0x5953bbf6b3075469 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.844424:0:94086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe200/0x5953bbf6b3075469 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.844433:0:94086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe200/0x5953bbf6b3075469 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.844441:0:94086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebe200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290417.844448:0:94086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe200/0x5953bbf6b3075469 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.844457:0:94086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe200/0x5953bbf6b3075469 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.844478:0:94086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800e00) 00010000:00010000:0.0:1784290417.844483:0:94086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290417.844488:0:94086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe200/0x5953bbf6b3075469 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.844497:0:94086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe200/0x5953bbf6b3075469 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290417.844529:0:94086:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d33ec453 reply state 00000000a0e5199c transno 115964117003 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b3075470 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.844544:0:94086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b3075470 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.844563:0:94086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2475800000) 00010000:00010000:0.0:1784290417.844566:0:94086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290417.844570:0:94086:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1784290417.844766:0:94086:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1784290417.844795:0:94086:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290417.844800:0:94086:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 115964117004 00000020:00080000:0.0:1784290417.844805:0:94086:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290417.844808:0:94086:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 0, req_transno: 0, next_transno: 115964117004 00000100:00080000:1.0:1784290417.845475:0:3616:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9c2474e8c380 x1870961901160064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290442 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784290417.845498:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1784290417.845504:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1784290417.845510:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1784290417.845516:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901160064:0@lo:38:kworker.0 00000100:00100000:1.0:1784290417.845590:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901161472:0@lo:101:ldlm_lock_repla.0 00000100:00100000:1.0:1784290417.845665:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1784290417.845768:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2345c25c00 x1870961901161344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290417.845781:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901161472 00000100:00080000:1.0:1784290417.845787:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 28 00000100:00100000:0.0:1784290417.845793:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901161472 00000100:00080000:1.0:1784290417.845799:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1784290417.845808:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784290417.845813:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246ff64000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784290417.845823:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1870961901161344:0@lo:38:kworker.0 00000100:00100000:0.0:1784290417.845853:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3897 00000100:00100000:0.0:1784290417.845864:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1870961901161472:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:0.0:1784290417.845887:0:8413:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c2445d6c700 x1870961901161472/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:438/0 lens 328/0 e 0 to 0 dl 1784290428 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290417.845908:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3616:x1870961901161472:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 47us (262us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784290417.845916:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3897 00000020:00080000:1.0:1784290417.845952:0:94086:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1784290417.845959:0:94086:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117004 00000001:00080000:3.0:1784290417.846268:0:94053:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117003 is committed 00010000:00010000:0.0:1784290417.846311:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b3075470 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.846328:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b3075470 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.846432:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b3075470 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.846464:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290417.846481:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b3075470 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.846494:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b3075470 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290417.846510:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:0.0:1784290417.846519:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2475800000) 00010000:00010000:0.0:1784290417.846527:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290417.846534:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b3075470 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.846546:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf000/0x5953bbf6b3075470 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290417.846568:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896270464 00000100:00100000:1.0:1784290417.846575:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896270464 00000100:00100000:1.0:1784290417.846627:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1295 00000100:00100000:1.0:1784290417.846638:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2396:x1870961896270464:12345-192.168.202.6@tcp:36:rm.0 00010000:00080000:1.0:1784290417.846652:0:65988:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 115964117004, current: 115964117004, replaying 00000100:00100000:1.0:1784290417.846670:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2396:x1870961896270464:12345-192.168.202.6@tcp:36:rm.0 Request processed in 35us (169us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784290417.846677:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1295 00000020:00080000:0.0:1784290417.846713:0:94086:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290417.846720:0:94086:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 115964117004, next_transno: 115964117004 00010000:00080000:0.0:1784290417.846727:0:94086:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (115964117004) 00000020:00080000:0.0:1784290417.846732:0:94086:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290417.846743:0:94086:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896270464 t115964117004 from 192.168.202.6@tcp req@ffff9c2467deca80 x1870961896270464/t0(115964117004) o36->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:438/0 lens 512/0 e 0 to 0 dl 1784290428 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784290417.846849:0:94086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b3075477 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.846866:0:94086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b3075477 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.846880:0:94086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b3075477 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.846903:0:94086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b307547e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.846937:0:94086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b307547e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.846951:0:94086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b307547e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.847036:0:94086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3075485 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.847052:0:94086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3075485 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.847065:0:94086:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3075485 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.847404:0:94086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3075485 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.847419:0:94086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3075485 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.847430:0:94086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3075485 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.847458:0:94086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290417.847465:0:94086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3075485 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.847477:0:94086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3075485 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.847495:0:94086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff9c2475800800) 00010000:00010000:0.0:1784290417.847514:0:94086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784290417.847522:0:94086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3075485 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.847535:0:94086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebf200/0x5953bbf6b3075485 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.847567:0:94086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b3075477 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.847580:0:94086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b3075477 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.847591:0:94086:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b3075477 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.847600:0:94086:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebe800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290417.847606:0:94086:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b3075477 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.847619:0:94086:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b3075477 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.847635:0:94086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800900) 00010000:00010000:0.0:1784290417.847640:0:94086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290417.847646:0:94086:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b3075477 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.847658:0:94086:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebe800/0x5953bbf6b3075477 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290417.847682:0:94086:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000035c08801 reply state 000000001e4e87bf transno 115964117004 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b307547e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.847738:0:94086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b307547e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.847749:0:94086:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2475800b00) 00010000:00010000:0.0:1784290417.847754:0:94086:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290417.847758:0:94086:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1784290417.847824:0:94086:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1784290417.847850:0:94086:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290417.847856:0:94086:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117005 00000020:00080000:0.0:1784290417.847862:0:94086:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290417.847867:0:94086:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117005 00000100:00100000:2.0:1784290417.850540:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290417.850608:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896278400 00000100:00100000:3.0:1784290417.850619:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896278400 00000100:00100000:3.0:1784290417.850683:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 752 00000100:00100000:3.0:1784290417.850700:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:2396:x1870961896278400:12345-192.168.202.6@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1784290417.850722:0:65989:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9c24581aad80 x1870961896278400/t0(0) o400->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:438/0 lens 224/0 e 0 to 0 dl 1784290428 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290417.850746:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:2396:x1870961896278400:12345-192.168.202.6@tcp:400:ldlm_lock_repla.0 Request processed in 54us (213us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784290417.850755:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 752 00000020:00080000:0.0:1784290417.850785:0:94086:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290417.850791:0:94086:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 115964117005 00010000:00080000:0.0:1784290417.850795:0:94086:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1784290417.850798:0:94086:0:(update_recovery.c:583:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1784290417.850807:0:94086:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1784290417.850810:0:94086:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:0.0:1784290417.850819:0:94086:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff9c2445d6c700 x1870961901161472/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:438/0 lens 328/0 e 0 to 0 dl 1784290428 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784290417.850839:0:94086:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290417.850863:0:94086:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b307548c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3074bb0 expref: -99 pid: 94086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.850887:0:94086:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b307548c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3074bb0 expref: 7 pid: 94086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.850901:0:94086:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebfa00/0x5953bbf6b307548c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3074bb0 expref: 7 pid: 94086 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.850927:0:94086:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2345ebfa00, rc 0) 00010000:00080000:0.0:1784290417.850982:0:94086:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:0.0:1784290417.850994:0:94086:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00010000:1.0:1784290417.851038:0:3616:0:(ldlm_request.c:2777:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c23450abe00/0x5953bbf6b3074bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307548c expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1784290417.851051:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1784290417.851076:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467deea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901161472:0@lo:101:ldlm_lock_repla.0 00000100:00100000:1.0:1784290417.851113:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2445d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901161600:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:1.0:1784290417.851147:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290417.851201:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901161600 00000100:00100000:2.0:1784290417.851212:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901161600 00000100:00100000:2.0:1784290417.851277:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3898 00000100:00100000:2.0:1784290417.851295:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3616:x1870961901161600:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1784290417.851317:0:23867:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9c2445d6f480 x1870961901161600/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:438/0 lens 224/0 e 0 to 0 dl 1784290428 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290417.851389:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3616:x1870961901161600:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 97us (237us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784290417.851403:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3898 00010000:00080000:0.0:1784290417.851421:0:94086:0:(ldlm_lib.c:2285:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1784290417.851539:0:94086:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 120259084288 00000001:00100000:3.0:1784290417.852580:0:94053:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1784290417.852588:0:94053:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 711f3c77-e791-4aa8-86ee-bc854fd0bcc5 00000001:00080000:3.0:1784290417.852608:0:94053:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117004 is committed 00010000:00010000:2.0:1784290417.852668:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b307547e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784290417.852680:0:94086:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:2.0:1784290417.852700:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b307547e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.852726:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b307547e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.852732:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebee00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290417.852736:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b307547e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.852744:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b307547e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1784290417.852755:0:94086:0:(ldlm_lib.c:1996:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00010000:2.0:1784290417.852760:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2475800b00) 00010000:00010000:2.0:1784290417.852766:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290417.852772:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b307547e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1784290417.852778:0:94086:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 192.168.202.6@tcp: req@ffff9c24581aad80 x1870961896278400/t0(0) o400->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:438/0 lens 224/0 e 0 to 0 dl 1784290428 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1784290417.852781:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2345ebee00/0x5953bbf6b307547e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 94086 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1784290417.852883:0:94086:0:(ldlm_lib.c:2940:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9c2445d6f480 x1870961901161600/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:438/0 lens 224/0 e 0 to 0 dl 1784290428 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1784290417.852974:0:94086:0:(ldlm_lib.c:1868:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:02, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1784290417.852999:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1784290417.853008:0:3616:0:(client.c:3234:ptlrpc_resend_req()) @@@ going to resend req@ffff9c2445d6ed80 x1870961901161600/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290433 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784290417.853019:0:3616:0:(client.c:3243:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9c2445d6ed80 x1870961901161600/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290433 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784290417.853026:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c246dd98000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1784290417.853047:0:3616:0:(import.c:1743:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1784290417.853053:0:3616:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000006b1cb5ae): req@ffff9c2468ab8380 x1870961901144320/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290415 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290417.853071:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2445d6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901161600:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1784290417.853168:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290417.853205:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901144320 00000100:00100000:1.0:1784290417.853212:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901161728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290417.853214:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901144320 00000100:00100000:1.0:1784290417.853263:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290417.853288:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901161728 00000100:00100000:2.0:1784290417.853298:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901161728 00000100:00100000:3.0:1784290417.853305:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3899 00000100:00100000:3.0:1784290417.853321:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3618:x1870961901144320:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784290417.853380:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3900 00000100:00100000:1.0:1784290417.853398:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3617:x1870961901161728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784290417.853441:0:22091:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444560896 avail 1298321408 00000004:00000024:3.0:1784290417.853468:0:8413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444560896 avail 1298321408 00000100:00100000:1.0:1784290417.853519:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3617:x1870961901161728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290417.853545:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3618:x1870961901144320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 226us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290417.853546:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3900 00000100:00100000:3.0:1784290417.853561:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3899 00000100:00100000:2.0:1784290417.853570:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901161728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290417.853630:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901144320:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290417.854316:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290417.854390:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896276992 00000100:00100000:1.0:1784290417.854397:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896276992 00000100:00100000:1.0:1784290417.854438:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1296 00000100:00100000:1.0:1784290417.854447:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:72160:x1870961896276992:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:1.0:1784290417.854465:0:66004:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444560896 avail 1298321408 00000100:00100000:1.0:1784290417.854523:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:72160:x1870961896276992:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 78us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290417.854530:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1296 00000100:00100000:3.0:1784290417.857612:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290417.857698:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896278528 00000100:00100000:1.0:1784290417.857709:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896278528 00000100:00100000:1.0:1784290417.857795:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1297 00000100:00100000:1.0:1784290417.857813:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:72160:x1870961896278528:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:1.0:1784290417.857852:0:66008:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445097472 avail 1298857984 00000100:00100000:1.0:1784290417.857931:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:72160:x1870961896278528:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 121us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290417.857948:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1297 00000100:00100000:2.0:1784290417.859730:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290417.859807:0:26253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896278656 00000100:00100000:3.0:1784290417.859816:0:26253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896278656 00000100:00100000:3.0:1784290417.859864:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4971 00000100:00100000:3.0:1784290417.859872:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:2396:x1870961896278656:12345-192.168.202.6@tcp:8:lfs.0 00010000:00080000:3.0:1784290417.859913:0:26253:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp t0 exp 0000000000000000 cur 2159 last 0 00000020:00000080:3.0:1784290417.859960:0:26253:0:(genops.c:1406:class_connect()) connect: client 711f3c77-e791-4aa8-86ee-bc854fd0bcc5, cookie 0x5953bbf6b3075493 00002000:00100000:3.0:1784290417.859984:0:26253:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 711f3c77-e791-4aa8-86ee-bc854fd0bcc5/ffff9c2474ee5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ad ocd_grant: 8409088 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784290417.860004:0:26253:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784290417.860155:0:26253:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784290417.860203:0:26253:0:(import.c:65:import_set_state_nolock()) ffff9c2343905000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784290417.860269:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2396:x1870961896278656:12345-192.168.202.6@tcp:8:lfs.0 Request processed in 394us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290417.860279:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4971 00000100:00100000:2.0:1784290417.861703:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000001:00100000:3.0:1784290417.861753:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 711f3c77-e791-4aa8-86ee-bc854fd0bcc5 00000001:00100000:3.0:1784290417.861767:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 711f3c77-e791-4aa8-86ee-bc854fd0bcc5 00000020:00000080:3.0:1784290417.861772:0:8397:0:(genops.c:906:class_export_put()) final put ffff9c234687a000/711f3c77-e791-4aa8-86ee-bc854fd0bcc5 00000100:00100000:1.0:1784290417.861797:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896278784 00000001:00100000:3.0:1784290417.861800:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1784290417.861805:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896278784 00000020:00000080:2.0:1784290417.861821:0:60390:0:(genops.c:865:class_export_destroy()) destroying export ffff9c234687a000/711f3c77-e791-4aa8-86ee-bc854fd0bcc5 for lustre-OST0000 00000100:00080000:3.0:1784290417.861853:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290417.861884:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1232 00000100:00100000:1.0:1784290417.861900:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:72160:x1870961896278784:12345-192.168.202.6@tcp:13:lfs.0 00000020:00000080:2.0:1784290417.861910:0:60390:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c234687f000 for lustre-OST0000 00002000:00000024:1.0:1784290417.861925:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1784290417.861981:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:72160:x1870961896278784:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 85us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290417.861991:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1232 00000100:00100000:1.0:1784290417.863332:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290417.863447:0:26255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896278912 00000100:00100000:2.0:1784290417.863456:0:26255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896278912 00000100:00100000:2.0:1784290417.863507:0:26255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4972 00000100:00100000:2.0:1784290417.863517:0:26255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2396:x1870961896278912:12345-192.168.202.6@tcp:8:lfs.0 00010000:00080000:2.0:1784290417.863550:0:26255:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp t0 exp 0000000000000000 cur 2159 last 0 00000020:00000080:2.0:1784290417.863583:0:26255:0:(genops.c:1406:class_connect()) connect: client 711f3c77-e791-4aa8-86ee-bc854fd0bcc5, cookie 0x5953bbf6b307549a 00002000:00100000:2.0:1784290417.863593:0:26255:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 711f3c77-e791-4aa8-86ee-bc854fd0bcc5/ffff9c234687f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ad ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784290417.863604:0:26255:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784290417.863683:0:26255:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784290417.863724:0:26255:0:(import.c:65:import_set_state_nolock()) ffff9c2475c2b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784290417.863787:0:26255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2396:x1870961896278912:12345-192.168.202.6@tcp:8:lfs.0 Request processed in 268us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290417.863803:0:26255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4972 00000100:00100000:2.0:1784290417.864895:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000001:00100000:1.0:1784290417.864912:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 711f3c77-e791-4aa8-86ee-bc854fd0bcc5 00000001:00100000:1.0:1784290417.864926:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 711f3c77-e791-4aa8-86ee-bc854fd0bcc5 00000020:00000080:1.0:1784290417.864931:0:9482:0:(genops.c:906:class_export_put()) final put ffff9c246d8aa000/711f3c77-e791-4aa8-86ee-bc854fd0bcc5 00000100:00100000:3.0:1784290417.864947:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896279040 00000100:00100000:3.0:1784290417.864956:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896279040 00000001:00100000:1.0:1784290417.864957:0:9482:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784290417.864972:0:60390:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246d8aa000/711f3c77-e791-4aa8-86ee-bc854fd0bcc5 for lustre-OST0001 00000100:00100000:3.0:1784290417.865021:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1233 00000100:00100000:3.0:1784290417.865044:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:72160:x1870961896279040:12345-192.168.202.6@tcp:13:lfs.0 00000020:00000080:2.0:1784290417.865045:0:60390:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2458115800 for lustre-OST0001 00002000:00000024:3.0:1784290417.865065:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784290417.865142:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:72160:x1870961896279040:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 102us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290417.865154:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1233 00000100:00080000:3.0:1784290417.865186:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00000080:1.0:1784290417.877250:0:94086:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffae54486f7e10 00100000:10000000:1.0:1784290417.877270:0:94086:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1784290417.877737:0:94073:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x702:0x0] 00000004:00080000:3.0:1784290417.877803:0:94071:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x703:0x0] 00000100:00100000:0.0:1784290417.877824:0:94073:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c27100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94073:1870961901161856:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784290417.877855:0:94071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467deea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94071:1870961901161984:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1784290417.877929:0:94073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290417.878000:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901161856 00000100:00100000:0.0:1784290417.878002:0:94073:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343b940c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290417.878012:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901161856 00000100:00100000:3.0:1784290417.878020:0:94071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290417.878065:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901161984 00000100:00100000:3.0:1784290417.878071:0:94071:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24582e9780 going to sleep for 11 seconds 00000100:00100000:0.0:1784290417.878073:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901161984 00000100:00100000:1.0:1784290417.878150:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4973 00000100:00100000:0.0:1784290417.878164:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4974 00000100:00100000:1.0:1784290417.878170:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:94073:x1870961901161856:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1784290417.878184:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:94071:x1870961901161984:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1784290417.878212:0:26258:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1889 -> diff = -95 00002000:00080000:0.0:1784290417.878213:0:26250:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1889 -> diff = -94 00002000:02000040:0.0:1784290417.878224:0:26250:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:1796 to 0x280000401:1889) 00002000:02000040:1.0:1784290417.878225:0:26258:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:1795 to 0x2c0000401:1889) 00002000:00010000:0.0:1784290417.878296:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x761:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290417.878308:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b441816/0x5953bbf6b30754a1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.878395:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x761:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.878402:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290417.878413:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b441816/0x5953bbf6b30754a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.878437:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b441816/0x5953bbf6b30754a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.878450:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b441816/0x5953bbf6b30754a1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.878460:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b441816/0x5953bbf6b30754a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.878483:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.878572:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.878583:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b441816/0x5953bbf6b30754a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.878596:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebe800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.878602:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b441816/0x5953bbf6b30754a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.878631:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b441816/0x5953bbf6b30754a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.878656:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b441816/0x5953bbf6b30754a1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.878665:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x760:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.878666:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b441816/0x5953bbf6b30754a1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.878684:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f3bd2c5/0x5953bbf6b30754a8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.878694:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.878699:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.878702:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.878704:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x760:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.878711:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x760:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290417.878734:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f3bd2c5/0x5953bbf6b30754a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.878746:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f3bd2c5/0x5953bbf6b30754a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.878778:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f3bd2c5/0x5953bbf6b30754a8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.878787:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f3bd2c5/0x5953bbf6b30754a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.878815:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.878835:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.878842:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f3bd2c5/0x5953bbf6b30754a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.878851:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.878855:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f3bd2c5/0x5953bbf6b30754a8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.878863:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f3bd2c5/0x5953bbf6b30754a8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.878875:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f3bd2c5/0x5953bbf6b30754a8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.878877:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290417.878888:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7565737/0x5953bbf6b30754af lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.878909:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f3bd2c5/0x5953bbf6b30754a8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.878912:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75f:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.878923:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290417.878933:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7565737/0x5953bbf6b30754af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.878940:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.878944:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7565737/0x5953bbf6b30754af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.878945:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.878950:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.878958:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7565737/0x5953bbf6b30754af lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.878965:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7565737/0x5953bbf6b30754af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879016:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290417.879067:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1784290417.879074:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290417.879079:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7565737/0x5953bbf6b30754af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879083:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007f4f536/0x5953bbf6b30754b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879151:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75e:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:3.0:1784290417.879153:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebf000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290417.879156:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290417.879163:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7565737/0x5953bbf6b30754af lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879163:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007f4f536/0x5953bbf6b30754b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.879200:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7565737/0x5953bbf6b30754af lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879200:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007f4f536/0x5953bbf6b30754b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879228:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007f4f536/0x5953bbf6b30754b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879238:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007f4f536/0x5953bbf6b30754b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.879241:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7565737/0x5953bbf6b30754af lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.879256:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7565737/0x5953bbf6b30754af lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879258:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.879278:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.879288:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007f4f536/0x5953bbf6b30754b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.879299:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebe200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.879304:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007f4f536/0x5953bbf6b30754b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.879306:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290417.879311:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.879320:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.879323:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007f4f536/0x5953bbf6b30754b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879324:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000473ae7e0/0x5953bbf6b30754bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.879325:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.879405:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007f4f536/0x5953bbf6b30754b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879412:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75d:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:2.0:1784290417.879418:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007f4f536/0x5953bbf6b30754b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879432:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290417.879439:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000473ae7e0/0x5953bbf6b30754bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.879444:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.879449:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.879455:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000473ae7e0/0x5953bbf6b30754bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.879463:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.879471:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000473ae7e0/0x5953bbf6b30754bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879479:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000473ae7e0/0x5953bbf6b30754bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879498:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.879526:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.879533:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000473ae7e0/0x5953bbf6b30754bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.879542:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2345ebee00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.879546:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000473ae7e0/0x5953bbf6b30754bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.879554:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000473ae7e0/0x5953bbf6b30754bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.879565:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.879566:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000473ae7e0/0x5953bbf6b30754bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879588:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000331ccedf/0x5953bbf6b30754c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.879591:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000473ae7e0/0x5953bbf6b30754bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879603:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75c:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.879607:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290417.879611:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000331ccedf/0x5953bbf6b30754c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.879612:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.879616:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.879619:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.879623:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000331ccedf/0x5953bbf6b30754c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879631:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000331ccedf/0x5953bbf6b30754c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879643:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000331ccedf/0x5953bbf6b30754c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879657:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.879673:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.879678:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000331ccedf/0x5953bbf6b30754c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.879694:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5c600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.879697:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000331ccedf/0x5953bbf6b30754c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.879713:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.879715:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000331ccedf/0x5953bbf6b30754c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879720:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043eec9cd/0x5953bbf6b30754cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879732:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75b:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:2.0:1784290417.879733:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000331ccedf/0x5953bbf6b30754c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879736:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290417.879745:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043eec9cd/0x5953bbf6b30754cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.879749:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000331ccedf/0x5953bbf6b30754c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879759:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043eec9cd/0x5953bbf6b30754cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.879766:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.879767:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043eec9cd/0x5953bbf6b30754cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.879769:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.879772:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.879778:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043eec9cd/0x5953bbf6b30754cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879790:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.879796:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.879801:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043eec9cd/0x5953bbf6b30754cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.879808:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5d800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.879811:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043eec9cd/0x5953bbf6b30754cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.879817:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043eec9cd/0x5953bbf6b30754cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.879825:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043eec9cd/0x5953bbf6b30754cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.879831:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x75a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290417.879837:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9da36c1/0x5953bbf6b30754d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.879843:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043eec9cd/0x5953bbf6b30754cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879869:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75a:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.879873:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x75a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290417.879877:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9da36c1/0x5953bbf6b30754d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.879879:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.879883:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.879885:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.879891:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9da36c1/0x5953bbf6b30754d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879898:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9da36c1/0x5953bbf6b30754d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879904:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9da36c1/0x5953bbf6b30754d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879916:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290417.879948:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290417.879955:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9da36c1/0x5953bbf6b30754d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.879966:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5ca00 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:0.0:1784290417.879969:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x759:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290417.879973:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9da36c1/0x5953bbf6b30754d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879974:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa18268a/0x5953bbf6b30754d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.879996:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x759:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.880000:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x759:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290417.880002:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9da36c1/0x5953bbf6b30754d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880004:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa18268a/0x5953bbf6b30754d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880026:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa18268a/0x5953bbf6b30754d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.880036:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9da36c1/0x5953bbf6b30754d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880063:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa18268a/0x5953bbf6b30754d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.880065:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9da36c1/0x5953bbf6b30754d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880085:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa18268a/0x5953bbf6b30754d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880114:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290417.880117:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290417.880122:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa18268a/0x5953bbf6b30754d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.880128:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5d000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.880130:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.880139:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa18268a/0x5953bbf6b30754d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.880147:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa18268a/0x5953bbf6b30754d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.880155:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x758:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290417.880158:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa18268a/0x5953bbf6b30754d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880161:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019058a20/0x5953bbf6b30754e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.880175:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa18268a/0x5953bbf6b30754d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880179:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x758:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.880185:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x758:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290417.880189:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019058a20/0x5953bbf6b30754e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.880191:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.880194:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.880197:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.880202:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019058a20/0x5953bbf6b30754e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880209:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019058a20/0x5953bbf6b30754e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880215:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019058a20/0x5953bbf6b30754e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880280:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.880282:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.880289:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019058a20/0x5953bbf6b30754e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880298:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5c000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.880303:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019058a20/0x5953bbf6b30754e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880313:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019058a20/0x5953bbf6b30754e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880330:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019058a20/0x5953bbf6b30754e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.880332:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x757:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290417.880383:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008144730a/0x5953bbf6b30754e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880396:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019058a20/0x5953bbf6b30754e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880399:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x757:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.880407:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x757:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290417.880413:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008144730a/0x5953bbf6b30754e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880417:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.880421:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008144730a/0x5953bbf6b30754e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880426:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.880431:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.880431:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008144730a/0x5953bbf6b30754e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880441:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008144730a/0x5953bbf6b30754e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880462:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.880470:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.880475:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008144730a/0x5953bbf6b30754e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880482:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5c800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.880485:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008144730a/0x5953bbf6b30754e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880492:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008144730a/0x5953bbf6b30754e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880502:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008144730a/0x5953bbf6b30754e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880508:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008144730a/0x5953bbf6b30754e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.880514:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x756:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290417.880521:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6fdb60e/0x5953bbf6b30754ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880522:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.880526:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.880529:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.880535:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x756:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.880543:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x756:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290417.880546:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6fdb60e/0x5953bbf6b30754ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880555:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6fdb60e/0x5953bbf6b30754ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880561:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6fdb60e/0x5953bbf6b30754ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880567:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6fdb60e/0x5953bbf6b30754ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880579:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.880584:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.880589:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6fdb60e/0x5953bbf6b30754ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880597:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5ce00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.880600:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6fdb60e/0x5953bbf6b30754ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880613:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6fdb60e/0x5953bbf6b30754ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.880615:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x755:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290417.880625:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b30754f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880630:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6fdb60e/0x5953bbf6b30754ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880632:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x755:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.880640:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x755:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290417.880650:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b30754f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880651:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6fdb60e/0x5953bbf6b30754ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880675:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b30754f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880680:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.880684:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.880685:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b30754f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880686:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.880711:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b30754f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880724:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.880730:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.880735:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b30754f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880742:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5c200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.880745:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b30754f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880752:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b30754f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880760:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b30754f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.880764:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x754:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290417.880770:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000caa993dc/0x5953bbf6b30754fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880790:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2581b1c/0x5953bbf6b30754f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880792:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x754:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.880801:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x754:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290417.880810:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000caa993dc/0x5953bbf6b30754fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.880815:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.880818:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.880819:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.880829:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000caa993dc/0x5953bbf6b30754fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880836:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000caa993dc/0x5953bbf6b30754fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880842:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000caa993dc/0x5953bbf6b30754fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880853:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290417.880876:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290417.880881:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000caa993dc/0x5953bbf6b30754fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.880884:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x753:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290417.880894:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006320ca05/0x5953bbf6b3075503 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.880896:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5da00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290417.880899:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000caa993dc/0x5953bbf6b30754fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.880921:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000caa993dc/0x5953bbf6b30754fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880924:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x753:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.880934:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x753:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290417.880959:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000caa993dc/0x5953bbf6b30754fc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.880980:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006320ca05/0x5953bbf6b3075503 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.881002:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000caa993dc/0x5953bbf6b30754fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881009:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006320ca05/0x5953bbf6b3075503 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881021:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006320ca05/0x5953bbf6b3075503 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.881024:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.881029:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.881034:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.881035:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006320ca05/0x5953bbf6b3075503 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881055:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.881081:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.881089:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006320ca05/0x5953bbf6b3075503 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881116:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5d200 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:0.0:1784290417.881119:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x752:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.881121:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006320ca05/0x5953bbf6b3075503 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881128:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049e9a1ab/0x5953bbf6b307550a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881138:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006320ca05/0x5953bbf6b3075503 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881166:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x752:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.881170:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x752:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290417.881173:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006320ca05/0x5953bbf6b3075503 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881174:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049e9a1ab/0x5953bbf6b307550a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881195:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006320ca05/0x5953bbf6b3075503 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881199:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049e9a1ab/0x5953bbf6b307550a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881216:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.881219:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.881227:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.881236:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049e9a1ab/0x5953bbf6b307550a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881242:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049e9a1ab/0x5953bbf6b307550a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881254:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.881261:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.881266:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049e9a1ab/0x5953bbf6b307550a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881274:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5d400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.881277:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049e9a1ab/0x5953bbf6b307550a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881284:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049e9a1ab/0x5953bbf6b307550a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881293:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049e9a1ab/0x5953bbf6b307550a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881298:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049e9a1ab/0x5953bbf6b307550a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.881301:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x751:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290417.881311:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1538750/0x5953bbf6b3075511 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881315:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.881320:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.881320:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x751:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:2.0:1784290417.881324:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.881325:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x751:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290417.881330:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1538750/0x5953bbf6b3075511 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881375:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1538750/0x5953bbf6b3075511 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881383:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1538750/0x5953bbf6b3075511 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881390:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1538750/0x5953bbf6b3075511 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881433:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.881456:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.881464:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1538750/0x5953bbf6b3075511 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881473:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5c400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.881478:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1538750/0x5953bbf6b3075511 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.881483:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x750:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290417.881491:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe2bd8a2/0x5953bbf6b3075518 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881520:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1538750/0x5953bbf6b3075511 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881521:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x750:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.881532:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x750:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290417.881561:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe2bd8a2/0x5953bbf6b3075518 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881567:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1538750/0x5953bbf6b3075511 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881572:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe2bd8a2/0x5953bbf6b3075518 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881579:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1538750/0x5953bbf6b3075511 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881586:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe2bd8a2/0x5953bbf6b3075518 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881602:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.881605:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe2bd8a2/0x5953bbf6b3075518 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881606:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.881610:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.881623:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.881628:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.881632:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe2bd8a2/0x5953bbf6b3075518 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881639:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5de00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.881642:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe2bd8a2/0x5953bbf6b3075518 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881649:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe2bd8a2/0x5953bbf6b3075518 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881658:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe2bd8a2/0x5953bbf6b3075518 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.881669:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.881675:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe2bd8a2/0x5953bbf6b3075518 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881676:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5e3e00b/0x5953bbf6b307551f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881683:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74f:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.881696:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290417.881700:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.881701:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5e3e00b/0x5953bbf6b307551f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881704:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.881707:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.881715:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5e3e00b/0x5953bbf6b307551f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881722:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5e3e00b/0x5953bbf6b307551f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881728:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5e3e00b/0x5953bbf6b307551f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881741:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290417.881773:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1784290417.881776:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290417.881782:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5e3e00b/0x5953bbf6b307551f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881783:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfd88036/0x5953bbf6b3075526 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881803:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74e:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.881811:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290417.881813:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5dc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:0.0:1784290417.881815:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfd88036/0x5953bbf6b3075526 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.881821:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5e3e00b/0x5953bbf6b307551f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.881838:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5e3e00b/0x5953bbf6b307551f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881839:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfd88036/0x5953bbf6b3075526 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881863:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfd88036/0x5953bbf6b3075526 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.881867:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5e3e00b/0x5953bbf6b307551f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881887:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfd88036/0x5953bbf6b3075526 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.881893:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5e3e00b/0x5953bbf6b307551f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881904:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.881920:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290417.881921:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.881926:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfd88036/0x5953bbf6b3075526 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.881927:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.881934:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2458d5cc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290417.881941:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.881942:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfd88036/0x5953bbf6b3075526 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881951:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfd88036/0x5953bbf6b3075526 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.881956:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.881961:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfd88036/0x5953bbf6b3075526 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881968:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfd88036/0x5953bbf6b3075526 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.881974:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab52dded/0x5953bbf6b307552d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881981:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.881983:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74d:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:2.0:1784290417.881985:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.881988:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290417.881992:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab52dded/0x5953bbf6b307552d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.881994:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.882004:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab52dded/0x5953bbf6b307552d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882011:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab52dded/0x5953bbf6b307552d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882016:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab52dded/0x5953bbf6b307552d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882027:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.882034:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.882039:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab52dded/0x5953bbf6b307552d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882047:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26c00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.882051:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab52dded/0x5953bbf6b307552d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.882057:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.882058:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab52dded/0x5953bbf6b307552d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882065:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b15e2a/0x5953bbf6b3075534 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882071:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab52dded/0x5953bbf6b307552d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882092:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab52dded/0x5953bbf6b307552d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882093:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74c:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.882113:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290417.882124:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043b15e2a/0x5953bbf6b3075534 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882130:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.882133:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043b15e2a/0x5953bbf6b3075534 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882134:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.882138:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.882145:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043b15e2a/0x5953bbf6b3075534 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882151:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043b15e2a/0x5953bbf6b3075534 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882161:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.882168:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.882173:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043b15e2a/0x5953bbf6b3075534 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882180:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.882183:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b15e2a/0x5953bbf6b3075534 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882200:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043b15e2a/0x5953bbf6b3075534 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.882206:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.882210:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043b15e2a/0x5953bbf6b3075534 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882213:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b791a16/0x5953bbf6b307553b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882226:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043b15e2a/0x5953bbf6b3075534 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882228:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74b:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.882236:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290417.882244:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b791a16/0x5953bbf6b307553b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882250:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.882253:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.882255:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.882262:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b791a16/0x5953bbf6b307553b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882280:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b791a16/0x5953bbf6b307553b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882286:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b791a16/0x5953bbf6b307553b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882302:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.882308:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.882313:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b791a16/0x5953bbf6b307553b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882321:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.882324:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b791a16/0x5953bbf6b307553b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882331:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b791a16/0x5953bbf6b307553b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882357:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b791a16/0x5953bbf6b307553b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882394:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b791a16/0x5953bbf6b307553b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.882398:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x74a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290417.882412:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3298557/0x5953bbf6b3075542 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882424:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.882424:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74a:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:2.0:1784290417.882430:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.882432:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x74a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290417.882438:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.882439:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3298557/0x5953bbf6b3075542 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882454:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3298557/0x5953bbf6b3075542 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882461:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3298557/0x5953bbf6b3075542 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882469:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3298557/0x5953bbf6b3075542 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882500:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290417.882527:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290417.882536:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3298557/0x5953bbf6b3075542 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.882563:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27a00 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:0.0:1784290417.882563:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x749:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290417.882571:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3298557/0x5953bbf6b3075542 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882572:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039bbe459/0x5953bbf6b3075549 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.882591:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3298557/0x5953bbf6b3075542 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882593:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x749:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.882602:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x749:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290417.882608:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039bbe459/0x5953bbf6b3075549 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.882613:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3298557/0x5953bbf6b3075542 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882619:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039bbe459/0x5953bbf6b3075549 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.882622:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3298557/0x5953bbf6b3075542 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.882639:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.882641:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039bbe459/0x5953bbf6b3075549 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.882642:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.882646:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.882665:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039bbe459/0x5953bbf6b3075549 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882679:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.882697:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.882702:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039bbe459/0x5953bbf6b3075549 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882710:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27400 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:0.0:1784290417.882712:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x748:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.882714:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039bbe459/0x5953bbf6b3075549 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882718:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003018f175/0x5953bbf6b3075550 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882727:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039bbe459/0x5953bbf6b3075549 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882730:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x748:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.882739:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x748:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290417.882740:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039bbe459/0x5953bbf6b3075549 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882744:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003018f175/0x5953bbf6b3075550 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882753:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039bbe459/0x5953bbf6b3075549 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882762:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003018f175/0x5953bbf6b3075550 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882771:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.882772:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003018f175/0x5953bbf6b3075550 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882775:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.882780:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003018f175/0x5953bbf6b3075550 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882785:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.882797:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.882804:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.882827:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003018f175/0x5953bbf6b3075550 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882837:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.882842:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003018f175/0x5953bbf6b3075550 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882851:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003018f175/0x5953bbf6b3075550 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.882857:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x747:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.882864:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003018f175/0x5953bbf6b3075550 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882866:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b641e28/0x5953bbf6b3075557 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882893:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003018f175/0x5953bbf6b3075550 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882895:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x747:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.882906:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x747:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290417.882920:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b641e28/0x5953bbf6b3075557 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882927:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.882932:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.882933:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b641e28/0x5953bbf6b3075557 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.882952:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.882961:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b641e28/0x5953bbf6b3075557 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882974:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b641e28/0x5953bbf6b3075557 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.882985:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.882991:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.882996:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b641e28/0x5953bbf6b3075557 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883022:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26a00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.883026:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b641e28/0x5953bbf6b3075557 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.883043:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x746:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.883049:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b641e28/0x5953bbf6b3075557 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.883051:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d771d7/0x5953bbf6b307555e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.883093:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x746:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.883108:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x746:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290417.883109:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b641e28/0x5953bbf6b3075557 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.883113:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084d771d7/0x5953bbf6b307555e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883125:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b641e28/0x5953bbf6b3075557 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.883130:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084d771d7/0x5953bbf6b307555e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883139:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.883140:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084d771d7/0x5953bbf6b307555e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883143:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.883146:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.883151:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084d771d7/0x5953bbf6b307555e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.883162:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.883169:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.883174:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084d771d7/0x5953bbf6b307555e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883181:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.883183:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d771d7/0x5953bbf6b307555e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883190:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084d771d7/0x5953bbf6b307555e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883200:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084d771d7/0x5953bbf6b307555e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883215:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084d771d7/0x5953bbf6b307555e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.883218:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x745:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290417.883225:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007bb595e/0x5953bbf6b3075565 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883230:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.883233:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.883235:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.883245:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x745:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.883248:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x745:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290417.883251:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007bb595e/0x5953bbf6b3075565 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.883260:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007bb595e/0x5953bbf6b3075565 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.883266:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007bb595e/0x5953bbf6b3075565 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.883272:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007bb595e/0x5953bbf6b3075565 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.883284:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290417.883304:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290417.883309:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007bb595e/0x5953bbf6b3075565 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.883317:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290417.883321:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007bb595e/0x5953bbf6b3075565 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.883321:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x744:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290417.883330:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000120e7c7/0x5953bbf6b307556c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.883337:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x744:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.883363:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x744:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290417.883373:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000120e7c7/0x5953bbf6b307556c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.883376:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007bb595e/0x5953bbf6b3075565 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.883389:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007bb595e/0x5953bbf6b3075565 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.883396:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007bb595e/0x5953bbf6b3075565 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.883404:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000120e7c7/0x5953bbf6b307556c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.883413:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.883415:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.883418:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.883427:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000120e7c7/0x5953bbf6b307556c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.883434:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000120e7c7/0x5953bbf6b307556c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.883445:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.883454:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.883460:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000120e7c7/0x5953bbf6b307556c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883468:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27c00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.883471:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000120e7c7/0x5953bbf6b307556c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883479:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000120e7c7/0x5953bbf6b307556c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.883481:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x743:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1784290417.883491:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebf1af59/0x5953bbf6b3075573 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883496:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000120e7c7/0x5953bbf6b307556c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.883499:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x743:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:0.0:1784290417.883508:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290417.883516:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000120e7c7/0x5953bbf6b307556c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.883517:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebf1af59/0x5953bbf6b3075573 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.883542:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebf1af59/0x5953bbf6b3075573 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883548:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.883548:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebf1af59/0x5953bbf6b3075573 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883552:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.883558:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebf1af59/0x5953bbf6b3075573 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883561:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.883592:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.883599:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.883604:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebf1af59/0x5953bbf6b3075573 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883611:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.883614:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebf1af59/0x5953bbf6b3075573 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883622:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebf1af59/0x5953bbf6b3075573 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883632:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebf1af59/0x5953bbf6b3075573 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290417.883635:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x742:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.883638:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebf1af59/0x5953bbf6b3075573 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.883642:0:26250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000008b5361/0x5953bbf6b307557a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.883653:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x742:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:2.0:1784290417.883655:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.883656:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290417.883659:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.883662:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000008b5361/0x5953bbf6b307557a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883663:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290417.883673:0:26250:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000008b5361/0x5953bbf6b307557a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.883689:0:26250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000008b5361/0x5953bbf6b307557a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.883694:0:26250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000008b5361/0x5953bbf6b307557a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290417.883705:0:26250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.883710:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.883715:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000008b5361/0x5953bbf6b307557a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883721:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.883724:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000008b5361/0x5953bbf6b307557a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883739:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000008b5361/0x5953bbf6b307557a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883750:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000008b5361/0x5953bbf6b307557a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883756:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000008b5361/0x5953bbf6b307557a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.883769:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.883771:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.883772:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1784290417.884086:0:26250:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:1795 00000100:00100000:0.0:1784290417.884176:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:94071:x1870961901161984:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6000us (6165us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290417.884183:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4974 00000100:00100000:3.0:1784290417.884241:0:94071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467deea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94071:1870961901161984:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1784290417.884255:0:94071:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x761:0x0] from OST, last_created [0x280000401:0x761:0x0]last_used is [0x280000401:0x703:0x0] 00000100:00100000:2.0:1784290417.884325:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901162112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784290417.884332:0:94071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467deea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94071:1870961901162240:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784290417.884402:0:94071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290417.884403:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290417.884429:0:94071:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24582e9780 going to sleep for 11 seconds 00000100:00100000:0.0:1784290417.884458:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901162240 00000100:00100000:0.0:1784290417.884472:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901162240 00000100:00100000:3.0:1784290417.884491:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901162112 00000100:00100000:3.0:1784290417.884498:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901162112 00000100:00100000:3.0:1784290417.884563:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:0.0:1784290417.884566:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4975 00000100:00100000:3.0:1784290417.884572:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901162112:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784290417.884579:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:94071:x1870961901162240:12345-0@lo:5:osp-pre-0-0.0 00002000:00000024:3.0:1784290417.884601:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3923529728 avail 3692007424 00002000:00080000:0.0:1784290417.884608:0:26252:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1890 00000100:00100000:3.0:1784290417.884647:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901162112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290417.884665:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00100000:2.0:1784290417.884675:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901162112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784290417.885895:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:94071:x1870961901162240:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1320us (1496us total) trans 4294968632 rc 0/0 00000100:00100000:0.0:1784290417.885901:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4975 00000100:00100000:3.0:1784290417.885925:0:94071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467deea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94071:1870961901162240:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1784290417.885934:0:94071:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x761:0x0]-[0x280000401:0x781:0x0] 00002000:00010000:1.0:1784290417.886052:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x761:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290417.886058:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cadb06b/0x5953bbf6b3075581 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886066:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x761:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.886069:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x761:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290417.886073:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cadb06b/0x5953bbf6b3075581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886083:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cadb06b/0x5953bbf6b3075581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886089:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cadb06b/0x5953bbf6b3075581 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886131:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cadb06b/0x5953bbf6b3075581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886146:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.886175:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.886183:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cadb06b/0x5953bbf6b3075581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886192:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cb800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.886196:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cadb06b/0x5953bbf6b3075581 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886204:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cadb06b/0x5953bbf6b3075581 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.886211:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x760:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290417.886221:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c7d4e35/0x5953bbf6b3075588 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886229:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cadb06b/0x5953bbf6b3075581 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886230:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x760:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.886238:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x760:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290417.886247:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c7d4e35/0x5953bbf6b3075588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886248:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cadb06b/0x5953bbf6b3075581 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x761:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886270:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c7d4e35/0x5953bbf6b3075588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886277:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.886277:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c7d4e35/0x5953bbf6b3075588 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886281:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.886283:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.886288:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c7d4e35/0x5953bbf6b3075588 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886302:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290417.886322:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290417.886328:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c7d4e35/0x5953bbf6b3075588 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.886335:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290417.886336:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cbc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290417.886355:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c7d4e35/0x5953bbf6b3075588 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.886363:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c7d4e35/0x5953bbf6b3075588 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886374:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005caf552d/0x5953bbf6b307558f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.886389:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c7d4e35/0x5953bbf6b3075588 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886393:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75f:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.886401:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290417.886404:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c7d4e35/0x5953bbf6b3075588 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x760:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886406:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005caf552d/0x5953bbf6b307558f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886426:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005caf552d/0x5953bbf6b307558f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.886429:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.886433:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.886436:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.886437:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005caf552d/0x5953bbf6b307558f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886449:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005caf552d/0x5953bbf6b307558f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886468:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.886482:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.886487:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005caf552d/0x5953bbf6b307558f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886495:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cac00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.886498:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005caf552d/0x5953bbf6b307558f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886505:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005caf552d/0x5953bbf6b307558f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886516:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005caf552d/0x5953bbf6b307558f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.886521:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.886522:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005caf552d/0x5953bbf6b307558f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886535:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ca690c2/0x5953bbf6b3075596 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886551:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75e:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.886555:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290417.886559:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ca690c2/0x5953bbf6b3075596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886562:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.886566:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.886570:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.886570:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ca690c2/0x5953bbf6b3075596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886590:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ca690c2/0x5953bbf6b3075596 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886596:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ca690c2/0x5953bbf6b3075596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886608:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.886614:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.886619:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ca690c2/0x5953bbf6b3075596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886627:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8ca800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.886630:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ca690c2/0x5953bbf6b3075596 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886636:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ca690c2/0x5953bbf6b3075596 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886646:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ca690c2/0x5953bbf6b3075596 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.886647:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290417.886656:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000849e7e60/0x5953bbf6b307559d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886658:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ca690c2/0x5953bbf6b3075596 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886669:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75d:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.886671:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290417.886674:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000849e7e60/0x5953bbf6b307559d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886692:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000849e7e60/0x5953bbf6b307559d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886694:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.886698:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.886702:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.886702:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000849e7e60/0x5953bbf6b307559d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886709:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000849e7e60/0x5953bbf6b307559d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886729:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.886734:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.886739:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000849e7e60/0x5953bbf6b307559d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886757:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.886760:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000849e7e60/0x5953bbf6b307559d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.886767:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.886768:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000849e7e60/0x5953bbf6b307559d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886774:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000228f1e82/0x5953bbf6b30755a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886783:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000849e7e60/0x5953bbf6b307559d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886784:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75c:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.886791:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290417.886799:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000228f1e82/0x5953bbf6b30755a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886801:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000849e7e60/0x5953bbf6b307559d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886817:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000228f1e82/0x5953bbf6b30755a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886822:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.886825:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.886827:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.886833:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000228f1e82/0x5953bbf6b30755a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886844:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000228f1e82/0x5953bbf6b30755a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886861:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.886866:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.886871:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000228f1e82/0x5953bbf6b30755a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886877:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.886880:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000228f1e82/0x5953bbf6b30755a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886886:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000228f1e82/0x5953bbf6b30755a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.886901:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.886902:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000228f1e82/0x5953bbf6b30755a4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886910:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f920d44d/0x5953bbf6b30755ab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886914:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000228f1e82/0x5953bbf6b30755a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886926:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75b:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:2.0:1784290417.886934:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.886936:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290417.886958:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.886963:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f920d44d/0x5953bbf6b30755ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.886964:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.886980:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f920d44d/0x5953bbf6b30755ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.886997:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f920d44d/0x5953bbf6b30755ab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887009:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f920d44d/0x5953bbf6b30755ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887034:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290417.887081:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290417.887089:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f920d44d/0x5953bbf6b30755ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.887114:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x75a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290417.887120:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7305fe5/0x5953bbf6b30755b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887148:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75a:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.887154:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x75a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290417.887156:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aac00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290417.887159:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7305fe5/0x5953bbf6b30755b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.887163:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f920d44d/0x5953bbf6b30755ab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887167:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7305fe5/0x5953bbf6b30755b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.887190:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f920d44d/0x5953bbf6b30755ab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887191:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7305fe5/0x5953bbf6b30755b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887238:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7305fe5/0x5953bbf6b30755b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.887239:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f920d44d/0x5953bbf6b30755ab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.887275:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f920d44d/0x5953bbf6b30755ab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887288:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290417.887303:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.887311:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.887313:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7305fe5/0x5953bbf6b30755b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.887328:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290417.887334:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7305fe5/0x5953bbf6b30755b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.887343:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7305fe5/0x5953bbf6b30755b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.887377:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x759:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290417.887382:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7305fe5/0x5953bbf6b30755b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887386:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001913307f/0x5953bbf6b30755b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887416:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x759:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:3.0:1784290417.887419:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7305fe5/0x5953bbf6b30755b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887422:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x759:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290417.887436:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001913307f/0x5953bbf6b30755b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.887447:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.887450:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001913307f/0x5953bbf6b30755b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.887452:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.887458:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.887467:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001913307f/0x5953bbf6b30755b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887475:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001913307f/0x5953bbf6b30755b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887493:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.887515:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.887523:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001913307f/0x5953bbf6b30755b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.887533:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa600 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:1.0:1784290417.887534:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x758:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.887554:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001913307f/0x5953bbf6b30755b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887557:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe30eacf/0x5953bbf6b30755c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.887563:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001913307f/0x5953bbf6b30755b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887584:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x758:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:2.0:1784290417.887588:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001913307f/0x5953bbf6b30755b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887589:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x758:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290417.887596:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe30eacf/0x5953bbf6b30755c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.887604:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001913307f/0x5953bbf6b30755b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x759:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887608:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe30eacf/0x5953bbf6b30755c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887615:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe30eacf/0x5953bbf6b30755c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887636:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe30eacf/0x5953bbf6b30755c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.887646:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.887650:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe30eacf/0x5953bbf6b30755c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887651:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784290417.887662:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.887665:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe30eacf/0x5953bbf6b30755c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.887669:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.887676:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe30eacf/0x5953bbf6b30755c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.887685:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe30eacf/0x5953bbf6b30755c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.887691:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe30eacf/0x5953bbf6b30755c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x758:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.887691:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x757:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290417.887700:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab0f9698/0x5953bbf6b30755c7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.887707:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.887707:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x757:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:2.0:1784290417.887710:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.887712:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x757:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290417.887714:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.887717:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab0f9698/0x5953bbf6b30755c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887725:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab0f9698/0x5953bbf6b30755c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887740:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab0f9698/0x5953bbf6b30755c7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887746:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab0f9698/0x5953bbf6b30755c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887757:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.887764:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.887769:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab0f9698/0x5953bbf6b30755c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.887776:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aae00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.887786:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab0f9698/0x5953bbf6b30755c7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.887792:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x756:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.887793:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab0f9698/0x5953bbf6b30755c7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887799:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053d0fe3d/0x5953bbf6b30755ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.887807:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab0f9698/0x5953bbf6b30755c7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887828:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x756:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:2.0:1784290417.887841:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab0f9698/0x5953bbf6b30755c7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x757:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887841:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x756:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290417.887857:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053d0fe3d/0x5953bbf6b30755ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.887866:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.887870:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.887876:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.887882:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053d0fe3d/0x5953bbf6b30755ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887899:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000053d0fe3d/0x5953bbf6b30755ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887911:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000053d0fe3d/0x5953bbf6b30755ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.887955:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.887967:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.887977:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000053d0fe3d/0x5953bbf6b30755ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.887991:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.887997:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000053d0fe3d/0x5953bbf6b30755ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.888010:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000053d0fe3d/0x5953bbf6b30755ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.888017:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x755:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.888024:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000053d0fe3d/0x5953bbf6b30755ce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888029:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a22083ed/0x5953bbf6b30755d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.888065:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053d0fe3d/0x5953bbf6b30755ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x756:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888066:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x755:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.888077:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x755:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290417.888089:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a22083ed/0x5953bbf6b30755d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.888119:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.888119:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a22083ed/0x5953bbf6b30755d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.888125:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.888130:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.888136:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a22083ed/0x5953bbf6b30755d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888160:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a22083ed/0x5953bbf6b30755d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888172:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290417.888192:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290417.888198:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a22083ed/0x5953bbf6b30755d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.888205:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290417.888208:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a22083ed/0x5953bbf6b30755d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.888210:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x754:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290417.888220:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e9f623d/0x5953bbf6b30755dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.888222:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a22083ed/0x5953bbf6b30755d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888233:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x754:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:3.0:1784290417.888240:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a22083ed/0x5953bbf6b30755d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888243:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x754:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290417.888252:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e9f623d/0x5953bbf6b30755dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.888253:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a22083ed/0x5953bbf6b30755d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x755:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888277:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e9f623d/0x5953bbf6b30755dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.888281:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.888286:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e9f623d/0x5953bbf6b30755dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.888291:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.888295:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.888295:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e9f623d/0x5953bbf6b30755dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888314:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290417.888327:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290417.888332:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e9f623d/0x5953bbf6b30755dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.888355:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290417.888359:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e9f623d/0x5953bbf6b30755dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.888366:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e9f623d/0x5953bbf6b30755dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.888366:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x753:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290417.888374:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b30755e3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.888381:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e9f623d/0x5953bbf6b30755dc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888382:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x753:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.888389:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x753:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290417.888398:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b30755e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.888400:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e9f623d/0x5953bbf6b30755dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x754:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888421:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b30755e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.888427:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.888428:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b30755e3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.888430:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.888432:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.888442:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b30755e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888454:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.888464:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.888469:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b30755e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.888477:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aba00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.888481:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b30755e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.888488:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b30755e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.888489:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x752:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290417.888499:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5b582ff/0x5953bbf6b30755ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.888506:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b30755e3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888507:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x752:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.888514:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x752:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290417.888523:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5b582ff/0x5953bbf6b30755ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.888524:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060d8f358/0x5953bbf6b30755e3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x753:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888543:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5b582ff/0x5953bbf6b30755ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.888549:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.888551:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5b582ff/0x5953bbf6b30755ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.888552:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.888559:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5b582ff/0x5953bbf6b30755ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.888562:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.888571:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.888575:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.888580:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5b582ff/0x5953bbf6b30755ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.888587:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.888591:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5b582ff/0x5953bbf6b30755ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.888597:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5b582ff/0x5953bbf6b30755ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.888599:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x751:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290417.888610:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c14e744/0x5953bbf6b30755f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.888613:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5b582ff/0x5953bbf6b30755ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.888629:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5b582ff/0x5953bbf6b30755ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x752:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888635:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x751:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.888640:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x751:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290417.888644:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.888644:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c14e744/0x5953bbf6b30755f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.888648:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.888651:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.888657:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c14e744/0x5953bbf6b30755f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888664:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c14e744/0x5953bbf6b30755f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888670:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c14e744/0x5953bbf6b30755f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888681:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.888686:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.888691:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c14e744/0x5953bbf6b30755f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.888698:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450abc00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.888702:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c14e744/0x5953bbf6b30755f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.888715:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x750:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290417.888727:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8d8b7e0/0x5953bbf6b30755f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.888729:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c14e744/0x5953bbf6b30755f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.888752:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c14e744/0x5953bbf6b30755f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888752:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x750:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.888762:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x750:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290417.888765:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c14e744/0x5953bbf6b30755f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x751:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888772:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8d8b7e0/0x5953bbf6b30755f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.888779:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.888782:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.888785:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.888789:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8d8b7e0/0x5953bbf6b30755f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888808:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8d8b7e0/0x5953bbf6b30755f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888814:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8d8b7e0/0x5953bbf6b30755f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888829:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290417.888846:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290417.888851:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8d8b7e0/0x5953bbf6b30755f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.888858:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290417.888862:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8d8b7e0/0x5953bbf6b30755f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.888874:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8d8b7e0/0x5953bbf6b30755f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.888877:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290417.888887:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6ee89c3/0x5953bbf6b30755ff lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.888892:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8d8b7e0/0x5953bbf6b30755f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888897:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74f:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:3.0:1784290417.888900:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8d8b7e0/0x5953bbf6b30755f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x750:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888902:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290417.888910:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6ee89c3/0x5953bbf6b30755ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888920:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6ee89c3/0x5953bbf6b30755ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.888922:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.888926:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.888928:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6ee89c3/0x5953bbf6b30755ff lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.888929:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.888938:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6ee89c3/0x5953bbf6b30755ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.888961:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290417.888975:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290417.888980:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6ee89c3/0x5953bbf6b30755ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.888987:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aaa00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290417.888991:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6ee89c3/0x5953bbf6b30755ff lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.888997:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6ee89c3/0x5953bbf6b30755ff lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.889006:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6ee89c3/0x5953bbf6b30755ff lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.889006:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290417.889020:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb4c2cc6/0x5953bbf6b3075606 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.889067:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6ee89c3/0x5953bbf6b30755ff lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889069:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74e:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.889080:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290417.889089:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb4c2cc6/0x5953bbf6b3075606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.889110:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.889116:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.889119:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.889122:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb4c2cc6/0x5953bbf6b3075606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889149:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb4c2cc6/0x5953bbf6b3075606 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889155:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb4c2cc6/0x5953bbf6b3075606 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889168:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.889187:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.889192:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb4c2cc6/0x5953bbf6b3075606 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.889200:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b9c00 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:1.0:1784290417.889201:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.889203:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb4c2cc6/0x5953bbf6b3075606 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889207:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d08aa7d4/0x5953bbf6b307560d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.889217:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb4c2cc6/0x5953bbf6b3075606 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889220:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74d:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:2.0:1784290417.889229:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb4c2cc6/0x5953bbf6b3075606 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889234:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290417.889242:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d08aa7d4/0x5953bbf6b307560d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.889258:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb4c2cc6/0x5953bbf6b3075606 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889265:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d08aa7d4/0x5953bbf6b307560d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.889271:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.889274:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.889278:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.889281:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d08aa7d4/0x5953bbf6b307560d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889292:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d08aa7d4/0x5953bbf6b307560d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889310:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.889315:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.889319:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d08aa7d4/0x5953bbf6b307560d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.889326:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b9200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.889329:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d08aa7d4/0x5953bbf6b307560d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.889336:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d08aa7d4/0x5953bbf6b307560d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.889367:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d08aa7d4/0x5953bbf6b307560d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.889371:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.889375:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d08aa7d4/0x5953bbf6b307560d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889378:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b3075614 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889391:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74c:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:2.0:1784290417.889393:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.889394:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290417.889397:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.889400:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b3075614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.889406:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.889411:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b3075614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889418:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b3075614 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889430:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b3075614 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889441:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.889449:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.889455:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b3075614 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.889462:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b8800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.889466:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b3075614 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.889473:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b3075614 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.889479:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.889482:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b3075614 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889484:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010366057/0x5953bbf6b307561b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.889501:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b3075614 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889503:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74b:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.889511:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290417.889516:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010366057/0x5953bbf6b307561b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.889521:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.889524:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.889525:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010366057/0x5953bbf6b307561b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.889527:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.889535:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010366057/0x5953bbf6b307561b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889541:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010366057/0x5953bbf6b307561b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889552:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290417.889570:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290417.889576:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010366057/0x5953bbf6b307561b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.889579:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x74a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290417.889589:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c218a886/0x5953bbf6b3075622 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.889590:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b9600 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290417.889593:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010366057/0x5953bbf6b307561b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.889612:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010366057/0x5953bbf6b307561b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889615:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74a:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.889623:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x74a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290417.889628:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c218a886/0x5953bbf6b3075622 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.889630:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010366057/0x5953bbf6b307561b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889644:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c218a886/0x5953bbf6b3075622 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.889645:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010366057/0x5953bbf6b307561b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889669:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c218a886/0x5953bbf6b3075622 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.889676:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.889676:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c218a886/0x5953bbf6b3075622 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.889680:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.889692:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290417.889697:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290417.889701:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c218a886/0x5953bbf6b3075622 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.889709:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b9000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.889709:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.889714:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c218a886/0x5953bbf6b3075622 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.889721:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c218a886/0x5953bbf6b3075622 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.889728:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x749:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290417.889730:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c218a886/0x5953bbf6b3075622 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889733:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac5b8d3/0x5953bbf6b3075629 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.889742:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c218a886/0x5953bbf6b3075622 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x74a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889745:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x749:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.889748:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x749:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290417.889752:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ac5b8d3/0x5953bbf6b3075629 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889768:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ac5b8d3/0x5953bbf6b3075629 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.889774:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.889779:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.889782:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.889791:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ac5b8d3/0x5953bbf6b3075629 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889800:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ac5b8d3/0x5953bbf6b3075629 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889818:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.889824:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.889828:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ac5b8d3/0x5953bbf6b3075629 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.889835:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b9a00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.889838:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac5b8d3/0x5953bbf6b3075629 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.889852:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ac5b8d3/0x5953bbf6b3075629 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.889862:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ac5b8d3/0x5953bbf6b3075629 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.889867:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x748:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.889869:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ac5b8d3/0x5953bbf6b3075629 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x749:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889874:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b3075630 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889883:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x748:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:2.0:1784290417.889885:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.889886:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x748:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290417.889888:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.889891:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b3075630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.889892:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.889902:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b3075630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889910:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b3075630 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889915:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b3075630 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889936:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.889944:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.889951:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b3075630 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.889962:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b8400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.889967:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b3075630 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.889970:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x747:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1784290417.889978:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058f7ad42/0x5953bbf6b3075637 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.889986:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b3075630 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.889989:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x747:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.889999:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x747:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290417.890004:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b3075630 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890007:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058f7ad42/0x5953bbf6b3075637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890029:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058f7ad42/0x5953bbf6b3075637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.890030:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b3075630 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x748:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890053:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058f7ad42/0x5953bbf6b3075637 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.890057:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.890060:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.890062:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058f7ad42/0x5953bbf6b3075637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.890064:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.890113:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.890120:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.890126:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058f7ad42/0x5953bbf6b3075637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.890137:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b8000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.890141:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058f7ad42/0x5953bbf6b3075637 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.890165:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058f7ad42/0x5953bbf6b3075637 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.890173:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x746:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.890176:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058f7ad42/0x5953bbf6b3075637 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890178:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e3e7169/0x5953bbf6b307563e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.890193:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058f7ad42/0x5953bbf6b3075637 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x747:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890196:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x746:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.890205:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x746:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290417.890206:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.890209:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.890209:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e3e7169/0x5953bbf6b307563e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.890219:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.890221:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e3e7169/0x5953bbf6b307563e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890229:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e3e7169/0x5953bbf6b307563e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890235:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e3e7169/0x5953bbf6b307563e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890246:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.890252:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.890257:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e3e7169/0x5953bbf6b307563e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.890264:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b9400 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290417.890268:0:19681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e3e7169/0x5953bbf6b307563e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.890275:0:19681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e3e7169/0x5953bbf6b307563e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.890281:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x745:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.890284:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e3e7169/0x5953bbf6b307563e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890286:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0ddd08c/0x5953bbf6b3075645 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.890300:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e3e7169/0x5953bbf6b307563e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x746:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890302:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x745:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.890309:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x745:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290417.890317:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0ddd08c/0x5953bbf6b3075645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.890323:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.890326:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.890327:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0ddd08c/0x5953bbf6b3075645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.890331:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.890361:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0ddd08c/0x5953bbf6b3075645 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890379:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0ddd08c/0x5953bbf6b3075645 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890412:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290417.890432:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290417.890439:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0ddd08c/0x5953bbf6b3075645 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.890449:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b9800 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290417.890454:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0ddd08c/0x5953bbf6b3075645 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.890477:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x744:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290417.890479:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0ddd08c/0x5953bbf6b3075645 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890489:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069b37486/0x5953bbf6b307564c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.890499:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0ddd08c/0x5953bbf6b3075645 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890502:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x744:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.890514:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x744:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290417.890526:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0ddd08c/0x5953bbf6b3075645 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x745:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890527:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069b37486/0x5953bbf6b307564c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890558:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069b37486/0x5953bbf6b307564c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.890581:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.890582:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069b37486/0x5953bbf6b307564c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.890584:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.890587:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.890593:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069b37486/0x5953bbf6b307564c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890607:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784290417.890625:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290417.890631:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069b37486/0x5953bbf6b307564c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.890638:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b8a00 already unused, calling callback (ffffffffc0ec3230) 00002000:00010000:1.0:1784290417.890641:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x743:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1784290417.890642:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069b37486/0x5953bbf6b307564c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890648:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af6d6aba/0x5953bbf6b3075653 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.890669:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069b37486/0x5953bbf6b307564c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890672:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x743:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.890679:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x743:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290417.890684:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af6d6aba/0x5953bbf6b3075653 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.890686:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069b37486/0x5953bbf6b307564c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890698:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af6d6aba/0x5953bbf6b3075653 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.890699:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069b37486/0x5953bbf6b307564c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x744:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890720:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af6d6aba/0x5953bbf6b3075653 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.890728:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.890728:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af6d6aba/0x5953bbf6b3075653 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.890732:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290417.890736:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290417.890748:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290417.890789:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290417.890799:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af6d6aba/0x5953bbf6b3075653 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290417.890807:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x742:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1784290417.890819:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b9e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:1.0:1784290417.890821:0:26258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004403ea8f/0x5953bbf6b307565a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.890831:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af6d6aba/0x5953bbf6b3075653 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890842:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x742:0x0].0x0 since=2159s v=(0 0) 00010000:00010000:1.0:1784290417.890853:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x742:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290417.890856:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af6d6aba/0x5953bbf6b3075653 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890862:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004403ea8f/0x5953bbf6b307565a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.890888:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af6d6aba/0x5953bbf6b3075653 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890891:0:26258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004403ea8f/0x5953bbf6b307565a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890942:0:26258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004403ea8f/0x5953bbf6b307565a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.890955:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af6d6aba/0x5953bbf6b3075653 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x743:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290417.890976:0:26258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004403ea8f/0x5953bbf6b307565a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.891008:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290417.891010:0:26258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1784290417.891014:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004403ea8f/0x5953bbf6b307565a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290417.891023:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.891025:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b8e00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290417.891030:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004403ea8f/0x5953bbf6b307565a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.891042:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004403ea8f/0x5953bbf6b307565a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.891056:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004403ea8f/0x5953bbf6b307565a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.891067:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004403ea8f/0x5953bbf6b307565a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x742:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290417.891087:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.891091:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290417.891108:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1784290417.891399:0:26258:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:1794 00000100:00100000:1.0:1784290417.891440:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:94073:x1870961901161856:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13280us (13514us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290417.891448:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4973 00000100:00100000:0.0:1784290417.891471:0:94073:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c27100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94073:1870961901161856:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784290417.891482:0:94073:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x761:0x0] from OST, last_created [0x2c0000401:0x761:0x0]last_used is [0x2c0000401:0x702:0x0] 00000100:00100000:1.0:1784290417.891530:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901162368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784290417.891537:0:94073:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c26300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94073:1870961901162496:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1784290417.891568:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290417.891576:0:94073:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290417.891601:0:94073:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2343b940c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290417.891605:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901162368 00000100:00100000:2.0:1784290417.891606:0:8999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901162496 00000100:00100000:3.0:1784290417.891611:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901162368 00000100:00100000:2.0:1784290417.891613:0:8999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901162496 00000100:00100000:2.0:1784290417.891656:0:8999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4976 00000100:00100000:3.0:1784290417.891661:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:2.0:1784290417.891669:0:8999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:94073:x1870961901162496:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784290417.891675:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901162368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784290417.891691:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3922481152 avail 3690958848 00002000:00080000:2.0:1784290417.891697:0:8999:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 1890 00000100:00100000:3.0:1784290417.891732:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1870961901162368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290417.891740:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:1.0:1784290417.891752:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901162368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290417.892856:0:8999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:94073:x1870961901162496:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1192us (1280us total) trans 4294968634 rc 0/0 00000100:00100000:2.0:1784290417.892862:0:8999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4976 00000100:00100000:0.0:1784290417.892889:0:94073:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c26300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:94073:1870961901162496:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1784290417.892899:0:94073:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x761:0x0]-[0x2c0000401:0x781:0x0] 00010000:00010000:2.0:1784290418.344543:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784290418.856507:0:75386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1784290419.367492:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784290419.951837:0:94635:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 1475 0 00010000:00010000:2.0:1784290420.391491:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784290420.560371:0:94683:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:3.0:1784290421.254426:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290421.254511:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290421.254576:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896279168 00000100:00100000:3.0:1784290421.254587:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290421.254598:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896279168 00000100:00100000:3.0:1784290421.254682:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290421.254692:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896279296 00000100:00100000:0.0:1784290421.254705:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896279296 00000100:00100000:1.0:1784290421.254744:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896279424 00000100:00100000:2.0:1784290421.254746:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 74 00000100:00100000:1.0:1784290421.254756:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896279424 00000100:00100000:3.0:1784290421.254768:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290421.254803:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c248207f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2400:x1870961896279168:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290421.254837:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896279552 00000100:00100000:0.0:1784290421.254848:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 753 00000100:00100000:3.0:1784290421.254852:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896279552 00000100:00100000:1.0:1784290421.254868:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 754 00000100:00100000:0.0:1784290421.254880:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234326b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2399:x1870961896279296:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290421.254898:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:2400:x1870961896279424:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290421.254947:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896279680 00000100:00100000:2.0:1784290421.254956:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c248207f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2400:x1870961896279168:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 160us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290421.254959:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896279680 00000100:00100000:0.0:1784290421.254974:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234326b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2399:x1870961896279296:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 106us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290421.254987:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:2400:x1870961896279424:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 93us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290421.254988:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 74 00000100:00100000:0.0:1784290421.255001:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 753 00000100:00100000:1.0:1784290421.255042:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 754 00000100:00100000:3.0:1784290421.255052:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1622 00000100:00100000:3.0:1784290421.255099:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2399:x1870961896279552:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290421.255168:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2399:x1870961896279552:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 100us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290421.255170:0:26251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1623 00000100:00100000:3.0:1784290421.255194:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1622 00000100:00100000:1.0:1784290421.255197:0:26251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234326a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2400:x1870961896279680:12345-192.168.202.6@tcp:400:kworker.0 00000100:00080000:0.0:1784290421.255219:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784290421.255230:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784290421.255236:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784290421.255240:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784290421.255273:0:26251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234326a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2400:x1870961896279680:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 82us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290421.255286:0:26251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1623 00010000:00010000:2.0:1784290421.415549:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290421.927686:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784290421.927702:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901162752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1784290421.927711:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2446e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901162624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290421.927824:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290421.927876:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901162624 00000100:00100000:1.0:1784290421.927877:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290421.927887:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901162624 00000100:00100000:2.0:1784290421.927911:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901162752 00000100:00100000:2.0:1784290421.927917:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901162752 00000100:00080000:0.0:1784290421.927947:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784290421.927954:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784290421.927977:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:2.0:1784290421.927985:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:3.0:1784290421.927991:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901162624:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290421.927998:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901162752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1784290421.928041:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1784290421.928041:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784290421.928136:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901162752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 144us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290421.928146:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901162624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 158us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290421.928147:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:3.0:1784290421.928158:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00100000:0.0:1784290421.928198:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2446e55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901162624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290421.928205:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901162752:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290421.967622:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290421.967697:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896279808 00000100:00100000:3.0:1784290421.967706:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896279808 00000100:00100000:3.0:1784290421.967762:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1298 00000100:00100000:3.0:1784290421.967773:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:72630:x1870961896279808:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:3.0:1784290421.967798:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290421.967828:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3075661 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b25b3 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.967904:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075668 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.967920:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075668 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.967934:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075668 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290421.968025:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784290421.968029:0:65988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784290421.968056:0:65988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075668 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.968153:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3075661 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25b3 expref: 8 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.968172:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075668 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25b3 expref: 7 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.968190:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:3.0:1784290421.968193:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784290421.968197:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2482045400, rc 0) 00000100:00100000:3.0:1784290421.968250:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:72630:x1870961896279808:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 480us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290421.968256:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1298 00000100:00100000:2.0:1784290421.970374:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290421.970454:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896279936 00000100:00100000:0.0:1784290421.970460:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896279936 00000100:00100000:0.0:1784290421.970498:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1299 00000100:00100000:0.0:1784290421.970504:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:72630:x1870961896279936:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:0.0:1784290421.970530:0:65990:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444560896 avail 1298321408 00000100:00100000:0.0:1784290421.970571:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:72630:x1870961896279936:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 67us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290421.970577:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1299 00000100:00100000:2.0:1784290421.971272:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290421.971367:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896280064 00000100:00100000:0.0:1784290421.971372:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896280064 00000100:00100000:0.0:1784290421.971407:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1300 00000100:00100000:0.0:1784290421.971414:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:72630:x1870961896280064:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:0.0:1784290421.971435:0:74876:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445097472 avail 1298857984 00000100:00100000:0.0:1784290421.971488:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:72630:x1870961896280064:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 74us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290421.971494:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1300 00000100:00100000:1.0:1784290421.972616:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290421.972658:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896280192 00000100:00100000:0.0:1784290421.972664:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896280192 00000100:00100000:0.0:1784290421.972696:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1238 00000100:00100000:0.0:1784290421.972704:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:72630:x1870961896280192:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:0.0:1784290421.972731:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290421.972766:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:72630:x1870961896280192:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 65us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290421.972783:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1238 00000100:00100000:2.0:1784290421.973475:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290421.973521:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896280320 00000100:00100000:3.0:1784290421.973525:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896280320 00000100:00100000:3.0:1784290421.973557:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1239 00000100:00100000:3.0:1784290421.973566:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:72630:x1870961896280320:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:3.0:1784290421.973583:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784290421.973622:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:72630:x1870961896280320:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 58us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290421.973631:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1239 00000100:00100000:2.0:1784290421.984898:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290421.984990:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896280448 00000100:00100000:1.0:1784290421.984999:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896280448 00000100:00100000:1.0:1784290421.985045:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1301 00000100:00100000:1.0:1784290421.985055:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:71531:x1870961896280448:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1784290421.985090:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290421.985112:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8400/0x5953bbf6b307566f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b25ba expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985171:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b9a00/0x5953bbf6b3075676 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985183:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b9a00/0x5953bbf6b3075676 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985195:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b9a00/0x5953bbf6b3075676 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985209:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8800/0x5953bbf6b307567d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985231:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8800/0x5953bbf6b307567d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985236:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8800/0x5953bbf6b307567d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985442:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b9200/0x5953bbf6b3075684 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985449:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b9200/0x5953bbf6b3075684 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985454:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b9200/0x5953bbf6b3075684 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290421.985479:0:66008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784290421.985482:0:66008:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784290421.985515:0:66008:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b9200/0x5953bbf6b3075684 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985527:0:66008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b9a00/0x5953bbf6b3075676 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985533:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b9a00/0x5953bbf6b3075676 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985539:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b9a00/0x5953bbf6b3075676 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985546:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b9a00/0x5953bbf6b3075676 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985565:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b9a00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290421.985571:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b9a00/0x5953bbf6b3075676 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985582:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b9a00/0x5953bbf6b3075676 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985598:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:1.0:1784290421.985601:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290421.985608:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b9a00/0x5953bbf6b3075676 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985615:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b9a00/0x5953bbf6b3075676 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985631:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8800/0x5953bbf6b307567d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985638:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8800/0x5953bbf6b307567d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985646:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8800/0x5953bbf6b307567d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985651:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b8800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290421.985654:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8800/0x5953bbf6b307567d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985661:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8800/0x5953bbf6b307567d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985682:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9c244179d200) 00010000:00010000:1.0:1784290421.985685:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290421.985689:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8800/0x5953bbf6b307567d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985695:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8800/0x5953bbf6b307567d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985730:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8400/0x5953bbf6b307566f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25ba expref: 9 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985744:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b9200/0x5953bbf6b3075684 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25ba expref: 8 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.985753:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c244179da00) 00010000:00010000:1.0:1784290421.985755:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784290421.985758:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24414b9200, rc 0) 00000100:00100000:1.0:1784290421.985809:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:71531:x1870961896280448:12345-192.168.202.6@tcp:101:bash.0 Request processed in 756us (918us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290421.985818:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1301 00000100:00100000:1.0:1784290421.987127:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290421.987175:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896280576 00000100:00100000:3.0:1784290421.987180:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896280576 00000100:00100000:3.0:1784290421.987213:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1302 00000100:00100000:3.0:1784290421.987223:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:71531:x1870961896280576:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1784290421.987234:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290421.987248:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b307568b lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b25c1 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.987291:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075692 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.987330:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075692 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.987358:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075692 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.987437:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075699 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.987463:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075699 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.987476:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075699 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290421.987654:0:65989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234326a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:65989:1870961901162880:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784290421.987729:0:65989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290421.987777:0:65989:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247c105540 going to sleep for 11 seconds 00000100:00100000:2.0:1784290421.987844:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901162880 00000100:00100000:2.0:1784290421.987849:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901162880 00000100:00100000:2.0:1784290421.987890:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3901 00000100:00100000:2.0:1784290421.987896:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234326ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:65989:x1870961901162880:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1784290421.987979:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234326ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:65989:x1870961901162880:12345-0@lo:1000:mdt00_001.0 Request processed in 82us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290421.988002:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3901 00000100:00100000:3.0:1784290421.988045:0:65989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234326a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:65989:1870961901162880:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1784290421.988116:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044a00/0x5953bbf6b30756a0 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.988129:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044a00/0x5953bbf6b30756a0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.988138:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044a00/0x5953bbf6b30756a0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290421.988157:0:65989:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044a00/0x5953bbf6b30756a0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.988170:0:65989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075692 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.988192:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075692 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.988199:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075692 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.988207:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075692 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.988214:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290421.988218:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075692 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.988226:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075692 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.988238:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c244179da00) 00010000:00010000:3.0:1784290421.988241:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290421.988245:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075692 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.988253:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075692 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.988268:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075699 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.988276:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075699 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.988284:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075699 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.988300:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482044c00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290421.988304:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075699 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.988313:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075699 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.988333:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff9c245a793300) 00010000:00010000:3.0:1784290421.988336:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290421.988364:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075699 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.988374:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075699 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.988409:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b307568b lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25c1 expref: 10 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.988424:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044a00/0x5953bbf6b30756a0 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25c1 expref: 9 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.988434:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c245a793e00) 00010000:00010000:3.0:1784290421.988438:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784290421.988441:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2482044a00, rc 0) 00000100:00100000:3.0:1784290421.988506:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:71531:x1870961896280576:12345-192.168.202.6@tcp:101:bash.0 Request processed in 1281us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290421.988518:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1302 00000100:00100000:2.0:1784290421.989697:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290421.989759:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896280704 00000100:00100000:0.0:1784290421.989767:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896280704 00000100:00100000:0.0:1784290421.989813:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1303 00000100:00100000:0.0:1784290421.989824:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:71531:x1870961896280704:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1784290421.989835:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290421.989854:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27000/0x5953bbf6b30756a7 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b25c8 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.989898:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd26a00/0x5953bbf6b30756ae lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.989912:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd26a00/0x5953bbf6b30756ae lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.989926:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd26a00/0x5953bbf6b30756ae lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290421.989963:0:74876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00200000:0.0:1784290421.989967:0:74876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1784290421.990013:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd27000/0x5953bbf6b30756a7 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25c8 expref: 11 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.990032:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd26a00/0x5953bbf6b30756ae lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25c8 expref: 10 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.990041:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c2475807a00) 00010000:00010000:0.0:1784290421.990044:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1784290421.990054:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26a00, rc 0) 00000100:00100000:0.0:1784290421.990113:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:71531:x1870961896280704:12345-192.168.202.6@tcp:101:bash.0 Request processed in 292us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290421.990123:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1303 00000100:00100000:2.0:1784290421.992157:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290421.992190:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290421.992201:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896280832 00000100:00100000:3.0:1784290421.992214:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896280832 00000100:00100000:0.0:1784290421.992241:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896280960 00000100:00100000:0.0:1784290421.992247:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896280960 00000100:00100000:3.0:1784290421.992256:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1304 00000100:00100000:3.0:1784290421.992267:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:71531:x1870961896280832:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:3.0:1784290421.992278:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290421.992291:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2482045000/0x5953bbf6b30756b5 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b25cf expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290421.992295:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 687 00000100:00100000:0.0:1784290421.992310:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245818cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+12:2398:x1870961896280960:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784290421.992323:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290421.992361:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2482045e00/0x5953bbf6b30756bc lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.992364:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c246dd26a00/0x5953bbf6b30756ae lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25c8 expref: 12 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992387:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c2482045e00/0x5953bbf6b30756bc lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992401:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c2482045e00/0x5953bbf6b30756bc lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.992401:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c2475807a00) 00010000:00010000:0.0:1784290421.992408:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290421.992423:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450abc00/0x5953bbf6b30756c3 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992431:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450abc00/0x5953bbf6b30756c3 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992437:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450abc00/0x5953bbf6b30756c3 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290421.992443:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245818cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:2398:x1870961896280960:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 136us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290421.992451:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 687 00010000:00010000:3.0:1784290421.992495:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab800/0x5953bbf6b30756ca lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992503:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab800/0x5953bbf6b30756ca lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992509:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab800/0x5953bbf6b30756ca lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290421.992546:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x4:0x0]: returning size 0 00000004:00200000:3.0:1784290421.992550:0:65988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1784290421.992609:0:65988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab800/0x5953bbf6b30756ca lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992625:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab800/0x5953bbf6b30756ca lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992635:0:65988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2482045e00/0x5953bbf6b30756bc lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992642:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c2482045e00/0x5953bbf6b30756bc lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992650:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c2482045e00/0x5953bbf6b30756bc lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992657:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c2482045e00/0x5953bbf6b30756bc lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992664:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045e00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290421.992668:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2482045e00/0x5953bbf6b30756bc lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992676:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c2482045e00/0x5953bbf6b30756bc lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992686:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9c2475807a00) 00010000:00010000:3.0:1784290421.992690:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290421.992694:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c2482045e00/0x5953bbf6b30756bc lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992714:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2482045e00/0x5953bbf6b30756bc lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992727:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450abc00/0x5953bbf6b30756c3 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992735:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450abc00/0x5953bbf6b30756c3 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992742:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450abc00/0x5953bbf6b30756c3 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992748:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450abc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290421.992753:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450abc00/0x5953bbf6b30756c3 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992760:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450abc00/0x5953bbf6b30756c3 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992769:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x9add8152 (ffff9c245a793b00) 00010000:00010000:3.0:1784290421.992773:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290421.992776:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450abc00/0x5953bbf6b30756c3 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992783:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450abc00/0x5953bbf6b30756c3 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992813:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c2482045000/0x5953bbf6b30756b5 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25cf expref: 11 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992843:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c23450ab800/0x5953bbf6b30756ca lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25cf expref: 10 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290421.992852:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff9c2475800200) 00010000:00010000:3.0:1784290421.992855:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784290421.992858:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450ab800, rc 0) 00000100:00100000:3.0:1784290421.992890:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:71531:x1870961896280832:12345-192.168.202.6@tcp:101:bash.0 Request processed in 626us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290421.992899:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1304 00000100:00100000:2.0:1784290421.995051:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290421.995167:0:26261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896281088 00000100:00100000:1.0:1784290421.995174:0:26261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896281088 00000100:00100000:1.0:1784290421.995225:0:26261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4977 00000100:00100000:1.0:1784290421.995235:0:26261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2399:x1870961896281088:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1784290421.995248:0:26261:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290421.995264:0:26261:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b30756d1 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b25d6 expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290421.995315:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x242:0x0] initial LVB size: 0, mtime: 0x6a5a1c5c, atime: 0x6a5a1c5c, ctime: 0x6a5a1c5c, blocks: 0x0 00010000:00010000:1.0:1784290421.995345:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x242:0x0].0x0 since=2163s v=(0 0) 00010000:00010000:1.0:1784290421.995352:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x242:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290421.995399:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b30756d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25d6 expref: 6 pid: 26261 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.995419:0:26261:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000e5ccc77/0x5953bbf6b30756d1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25d6 expref: 6 pid: 26261 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.995432:0:26261:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24414b8800, rc 0) 00000100:00100000:1.0:1784290421.995477:0:26261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2399:x1870961896281088:12345-192.168.202.6@tcp:101:bash.0 Request processed in 242us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290421.995491:0:26261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4977 00000100:00100000:1.0:1784290421.997041:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290421.997144:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896281216 00000100:00100000:0.0:1784290421.997149:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896281216 00000100:00100000:0.0:1784290421.997183:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1305 00000100:00100000:0.0:1784290421.997189:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:71531:x1870961896281216:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:0.0:1784290421.997199:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290421.997208:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b30756d8 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b25dd expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997241:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b30756df lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997261:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b30756df lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997268:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b30756df lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997280:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27400/0x5953bbf6b30756e6 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997286:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27400/0x5953bbf6b30756e6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997315:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27400/0x5953bbf6b30756e6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290421.997442:0:65990:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c27100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:65990:1870961901163008:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784290421.997497:0:65990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290421.997525:0:65990:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24454a7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784290421.997547:0:22091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901163008 00000100:00100000:1.0:1784290421.997558:0:22091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901163008 00000100:00100000:1.0:1784290421.997611:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3902 00000100:00100000:1.0:1784290421.997624:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:65990:x1870961901163008:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1784290421.997736:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:65990:x1870961901163008:12345-0@lo:1000:mdt00_002.0 Request processed in 113us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290421.997750:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3902 00000100:00100000:0.0:1784290421.997777:0:65990:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c27100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:65990:1870961901163008:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1784290421.997830:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30756ed lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997838:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30756ed lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997843:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30756ed lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290421.997856:0:65990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30756ed lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997873:0:65990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b30756df lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997878:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b30756df lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997883:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b30756df lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997887:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b30756df lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997891:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290421.997894:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b30756df lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997898:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b30756df lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997904:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9c244179da00) 00010000:00010000:0.0:1784290421.997906:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290421.997909:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b30756df lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997913:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b30756df lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997920:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27400/0x5953bbf6b30756e6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997924:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27400/0x5953bbf6b30756e6 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997935:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27400/0x5953bbf6b30756e6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997942:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290421.997945:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27400/0x5953bbf6b30756e6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997954:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27400/0x5953bbf6b30756e6 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997964:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff9c2474f5f500) 00010000:00010000:0.0:1784290421.997967:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290421.997970:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27400/0x5953bbf6b30756e6 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.997978:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27400/0x5953bbf6b30756e6 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.998017:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b30756d8 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25dd expref: 11 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.998026:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26000/0x5953bbf6b30756ed lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25dd expref: 10 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290421.998032:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c2474f5fb00) 00010000:00010000:0.0:1784290421.998034:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784290421.998036:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26000, rc 0) 00000100:00100000:0.0:1784290421.998099:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:71531:x1870961896281216:12345-192.168.202.6@tcp:101:bash.0 Request processed in 908us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290421.998141:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1305 00000100:00100000:2.0:1784290421.999386:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290421.999489:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896281344 00000100:00100000:1.0:1784290421.999495:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896281344 00000100:00100000:1.0:1784290421.999529:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1306 00000100:00100000:1.0:1784290421.999535:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:71531:x1870961896281344:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1784290421.999551:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290421.999561:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9a00/0x5953bbf6b30756f4 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b25e4 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.999589:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b8e00/0x5953bbf6b30756fb lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.999598:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b8e00/0x5953bbf6b30756fb lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.999605:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b8e00/0x5953bbf6b30756fb lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290421.999630:0:66004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1784290421.999634:0:66004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1784290421.999662:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9a00/0x5953bbf6b30756f4 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25e4 expref: 12 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.999680:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b8e00/0x5953bbf6b30756fb lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25e4 expref: 11 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290421.999689:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c244c870300) 00010000:00010000:1.0:1784290421.999704:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1784290421.999707:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24414b8e00, rc 0) 00000100:00100000:1.0:1784290421.999745:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:71531:x1870961896281344:12345-192.168.202.6@tcp:101:bash.0 Request processed in 209us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290421.999755:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1306 00000100:00100000:2.0:1784290422.001180:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290422.001223:0:19593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896281472 00000100:00100000:1.0:1784290422.001228:0:19593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896281472 00000100:00100000:1.0:1784290422.001265:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 688 00000100:00100000:1.0:1784290422.001270:0:19593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:2400:x1870961896281472:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784290422.001279:0:19593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290422.001290:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b8e00/0x5953bbf6b30756fb lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25e4 expref: 11 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001301:0:19593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c244c870300) 00010000:00010000:1.0:1784290422.001303:0:19593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784290422.001337:0:19593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:2400:x1870961896281472:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 67us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290422.001369:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 688 00000100:00100000:3.0:1784290422.001461:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290422.001511:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896281600 00000100:00100000:1.0:1784290422.001517:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896281600 00000100:00100000:1.0:1784290422.001551:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1307 00000100:00100000:1.0:1784290422.001563:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234326a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:71531:x1870961896281600:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1784290422.001573:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290422.001584:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9e00/0x5953bbf6b3075702 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b25eb expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001623:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9800/0x5953bbf6b3075709 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001634:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9800/0x5953bbf6b3075709 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001644:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9800/0x5953bbf6b3075709 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001660:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9000/0x5953bbf6b3075710 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001676:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9000/0x5953bbf6b3075710 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001681:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9000/0x5953bbf6b3075710 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001725:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9600/0x5953bbf6b3075717 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001731:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9600/0x5953bbf6b3075717 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001747:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9600/0x5953bbf6b3075717 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290422.001767:0:66008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2400090a5:0x5:0x0]: returning size 0 00000004:00200000:1.0:1784290422.001770:0:66008:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784290422.001778:0:66008:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9600/0x5953bbf6b3075717 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001784:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9600/0x5953bbf6b3075717 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001790:0:66008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9800/0x5953bbf6b3075709 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001795:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9800/0x5953bbf6b3075709 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001800:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9800/0x5953bbf6b3075709 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001813:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9800/0x5953bbf6b3075709 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001818:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b9800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290422.001820:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9800/0x5953bbf6b3075709 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001825:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9800/0x5953bbf6b3075709 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001832:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff9c244c870300) 00010000:00010000:1.0:1784290422.001834:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290422.001837:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9800/0x5953bbf6b3075709 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001842:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9800/0x5953bbf6b3075709 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001849:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9000/0x5953bbf6b3075710 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001853:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9000/0x5953bbf6b3075710 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001857:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9000/0x5953bbf6b3075710 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001861:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b9000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290422.001863:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9000/0x5953bbf6b3075710 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001874:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9000/0x5953bbf6b3075710 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001880:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x9add8152 (ffff9c244179d700) 00010000:00010000:1.0:1784290422.001881:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290422.001883:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9000/0x5953bbf6b3075710 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001887:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9000/0x5953bbf6b3075710 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001905:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9e00/0x5953bbf6b3075702 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25eb expref: 12 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001912:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c24414b9600/0x5953bbf6b3075717 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25eb expref: 11 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.001917:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff9c2475800c00) 00010000:00010000:1.0:1784290422.001918:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784290422.001920:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24414b9600, rc 0) 00000100:00100000:1.0:1784290422.001948:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234326a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:71531:x1870961896281600:12345-192.168.202.6@tcp:101:bash.0 Request processed in 390us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290422.001955:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1307 00000100:00100000:2.0:1784290422.003477:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290422.003513:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896281728 00000100:00100000:1.0:1784290422.003520:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896281728 00000100:00100000:1.0:1784290422.003553:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4978 00000100:00100000:1.0:1784290422.003561:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2400:x1870961896281728:12345-192.168.202.6@tcp:101:bash.0 00010000:00010000:1.0:1784290422.003581:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290422.003594:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b307571e lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b25f2 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290422.003612:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000400:0x243:0x0] initial LVB size: 0, mtime: 0x6a5a1c5c, atime: 0x6a5a1c5c, ctime: 0x6a5a1c5c, blocks: 0x0 00010000:00010000:1.0:1784290422.003623:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x243:0x0].0x0 since=2163s v=(0 0) 00010000:00010000:1.0:1784290422.003627:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000400:0x243:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290422.003633:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b307571e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25f2 expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.003643:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007e7dae47/0x5953bbf6b307571e lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25f2 expref: 7 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290422.003652:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24414b8400, rc 0) 00000100:00100000:1.0:1784290422.003680:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2400:x1870961896281728:12345-192.168.202.6@tcp:101:bash.0 Request processed in 120us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290422.003685:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4978 00010000:00010000:3.0:1784290422.440495:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290422.951519:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2446e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901163264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290422.951533:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784290422.951558:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901163136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784290422.951624:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290422.951630:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290422.951697:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784290422.951705:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901163392:0@lo:400:kworker.0 00000100:00100000:2.0:1784290422.951720:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901163136 00000100:00100000:2.0:1784290422.951732:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901163136 00000100:00100000:3.0:1784290422.951745:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290422.951777:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901163392 00000100:00100000:1.0:1784290422.951784:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901163392 00000100:00100000:3.0:1784290422.951795:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1870961901163776:0@lo:400:kworker.0 00000100:00100000:2.0:1784290422.951819:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:3.0:1784290422.951827:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290422.951827:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784290422.951833:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901163136:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784290422.951837:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3619:x1870961901163392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290422.951851:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961901164288:0@lo:400:kworker.0 00002000:00000024:2.0:1784290422.951862:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290422.951878:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290422.951921:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901163136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290422.951921:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3619:x1870961901163392:12345-0@lo:400:kworker.0 Request processed in 82us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290422.951922:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901163392:0@lo:400:kworker.0 00000100:00100000:0.0:1784290422.951924:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901163648:0@lo:400:kworker.0 00000100:00100000:2.0:1784290422.951941:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:1.0:1784290422.951941:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784290422.951950:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784290422.951959:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901163904:0@lo:400:kworker.0 00000100:00100000:2.0:1784290422.951987:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901163776 00000100:00100000:0.0:1784290422.951987:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290422.951994:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901163776 00000100:00080000:3.0:1784290422.952010:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784290422.952023:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784290422.952034:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901164160:0@lo:400:kworker.0 00000100:00100000:3.0:1784290422.952041:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901163264 00000100:00100000:2.0:1784290422.952042:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901164288 00000100:00100000:3.0:1784290422.952047:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901163264 00000100:00100000:2.0:1784290422.952064:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901164288 00000100:00100000:0.0:1784290422.952090:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290422.952103:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901163648 00000100:00100000:2.0:1784290422.952109:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901163648 00000100:00100000:3.0:1784290422.952113:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3903 00000100:00100000:0.0:1784290422.952122:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2469c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1870961901164672:0@lo:400:kworker.0 00000100:00100000:3.0:1784290422.952124:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3619:x1870961901163264:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290422.952157:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000004:00000024:3.0:1784290422.952161:0:23867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444560896 avail 1298321408 00000100:00100000:0.0:1784290422.952163:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290422.952174:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1870961901163776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290422.952185:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1784290422.952196:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1870961901163520:0@lo:400:kworker.0 00000100:00100000:3.0:1784290422.952204:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3619:x1870961901163264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290422.952210:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3903 00000100:00100000:3.0:1784290422.952236:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901164672 00000100:00100000:0.0:1784290422.952240:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290422.952241:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901164672 00000100:00100000:2.0:1784290422.952248:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1870961901163776:12345-0@lo:400:kworker.0 Request processed in 76us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290422.952259:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:3.0:1784290422.952261:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901163520 00000100:00100000:3.0:1784290422.952265:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901163520 00000100:00100000:0.0:1784290422.952266:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345c27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901164032:0@lo:400:kworker.0 00000100:00100000:2.0:1784290422.952287:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:3.0:1784290422.952296:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:2.0:1784290422.952301:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1870961901164288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290422.952306:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290422.952311:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901163648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290422.952377:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901164544:0@lo:400:kworker.0 00000100:00100000:3.0:1784290422.952384:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901163648:12345-0@lo:400:kworker.0 Request processed in 75us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290422.952385:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1870961901164288:12345-0@lo:400:kworker.0 Request processed in 84us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290422.952396:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:2.0:1784290422.952404:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:3.0:1784290422.952412:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:0.0:1784290422.952418:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290422.952423:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1870961901164672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290422.952430:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:2.0:1784290422.952443:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1870961901163520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290422.952460:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1870961901164672:12345-0@lo:400:kworker.0 Request processed in 38us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290422.952467:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:0.0:1784290422.952468:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901163648:0@lo:400:kworker.0 00000100:00100000:2.0:1784290422.952494:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1870961901163520:12345-0@lo:400:kworker.0 Request processed in 53us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290422.952495:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2469c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1870961901164672:0@lo:400:kworker.0 00000100:00100000:3.0:1784290422.952496:0:26253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901164160 00000100:00100000:3.0:1784290422.952500:0:26253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901164160 00000100:00100000:2.0:1784290422.952513:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:3.0:1784290422.952548:0:26253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901164032 00000100:00100000:3.0:1784290422.952552:0:26253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901164032 00000100:00100000:0.0:1784290422.952556:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1870961901163520:0@lo:400:kworker.0 00000100:00100000:3.0:1784290422.952603:0:26253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901164544 00000100:00100000:3.0:1784290422.952613:0:26253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901164544 00000100:00100000:3.0:1784290422.952643:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1624 00000100:00100000:3.0:1784290422.952650:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901164160:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784290422.952652:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290422.952659:0:26254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1625 00000100:00080000:2.0:1784290422.952660:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784290422.952667:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784290422.952675:0:26254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901164032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290422.952676:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784290422.952688:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901164160:12345-0@lo:400:kworker.0 Request processed in 39us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290422.952695:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901164800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784290422.952698:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1624 00000100:00100000:3.0:1784290422.952714:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1626 00000100:00100000:3.0:1784290422.952722:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901164544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290422.952735:0:26254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901164032:12345-0@lo:400:kworker.0 Request processed in 63us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290422.952745:0:26254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1625 00000100:00100000:2.0:1784290422.952753:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290422.952758:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3618:x1870961901164544:12345-0@lo:400:kworker.0 Request processed in 36us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290422.952765:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1626 00000100:00100000:3.0:1784290422.952801:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901164800 00000100:00100000:3.0:1784290422.952804:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901164800 00000100:00100000:2.0:1784290422.952828:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901163136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784290422.952834:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3904 00000100:00100000:3.0:1784290422.952842:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901164800:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784290422.952861:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901164928:0@lo:13:osp-pre-1-0.0 00000004:00000024:3.0:1784290422.952865:0:8413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445097472 avail 1298857984 00000100:00100000:2.0:1784290422.952915:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901164032:0@lo:400:kworker.0 00000100:00100000:3.0:1784290422.952917:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901164800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290422.952932:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3904 00000100:00100000:0.0:1784290422.952935:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290422.952953:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901164544:0@lo:400:kworker.0 00000100:00100000:3.0:1784290422.952970:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901164928 00000100:00100000:3.0:1784290422.952974:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901164928 00000100:00100000:2.0:1784290422.952976:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901164160:0@lo:400:kworker.0 00000100:00100000:0.0:1784290422.952989:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901164800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784290422.953003:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:3.0:1784290422.953010:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d55c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901164928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784290422.953019:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784290422.953033:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290422.953066:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d55c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901164928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290422.953074:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00100000:2.0:1784290422.953090:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901164416:0@lo:400:kworker.0 00000100:00100000:2.0:1784290422.953126:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290422.953169:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961901164288:0@lo:400:kworker.0 00000100:00100000:2.0:1784290422.953186:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1870961901163776:0@lo:400:kworker.0 00000100:00100000:2.0:1784290422.953209:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2446e57b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901163264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290422.953286:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901164928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290422.953323:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901163904 00000100:00100000:2.0:1784290422.953328:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901163904 00000100:00080000:0.0:1784290422.953394:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784290422.953415:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901164416 00000100:00100000:0.0:1784290422.953419:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901164416 00000100:00100000:0.0:1784290422.953449:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3905 00000100:00100000:0.0:1784290422.953458:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901164416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290422.953500:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901164416:12345-0@lo:400:kworker.0 Request processed in 45us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290422.953507:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3905 00000100:00100000:0.0:1784290422.953555:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901164416:0@lo:400:kworker.0 00000100:00100000:2.0:1784290422.953569:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:2.0:1784290422.953579:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901163904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290422.953632:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901163904:12345-0@lo:400:kworker.0 Request processed in 53us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290422.953642:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:0.0:1784290422.953671:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901163904:0@lo:400:kworker.0 00010000:00010000:2.0:1784290423.463584:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784290423.465476:0:9482:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294968634 is committed 00000001:00080000:3.0:1784290423.977465:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968632 is committed 00010000:00010000:3.0:1784290424.488667:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784290424.820756:0:94974:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffee3e411a0 20000000:00000080:0.0:1784290424.820777:0:94974:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9c2467d11400 uarg=0000000000000000 00000040:00100000:0.0:1784290424.821457:0:94974:0:(llog.c:1072:llog_reverse_process()) index 57 : idx 49 20000000:01000000:0.0:1784290424.821463:0:94974:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 56 cmd:0xce021 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:0.0:1784290424.821478:0:94974:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1784290424.821801:0:94975:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 55 marker 43 1->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:0.0:1784290424.821890:0:94975:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 57 marker 43 2->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1784290424.821900:0:94975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000040:00080000:3.0:1784290424.822106:0:94974:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].58, 224 off18320 20000000:01000000:3.0:1784290424.822125:0:94974:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1784290424.822142:0:94974:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].59, 136 off18456 00000040:00080000:3.0:1784290424.822154:0:94974:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].60, 224 off18680 20000000:01000000:3.0:1784290424.822177:0:94974:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1784290424.822522:0:94976:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 50 marker 44 1->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:0.0:1784290424.822565:0:94976:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 44 2->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1784290424.822582:0:94976:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000040:00080000:3.0:1784290424.822667:0:94974:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].53, 224 off17424 20000000:01000000:3.0:1784290424.822675:0:94974:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1784290424.822684:0:94974:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].54, 144 off17568 00000040:00080000:3.0:1784290424.822703:0:94974:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].55, 224 off17792 20000000:01000000:3.0:1784290424.822710:0:94974:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1784290424.823276:0:94977:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 50 marker 45 1->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:0.0:1784290424.823323:0:94977:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 45 2->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1784290424.823331:0:94977:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000040:00080000:3.0:1784290424.823454:0:94974:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].53, 224 off17424 20000000:01000000:3.0:1784290424.823461:0:94974:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1784290424.823471:0:94974:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].54, 144 off17568 00000040:00080000:3.0:1784290424.823480:0:94974:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].55, 224 off17792 10000000:01000000:3.0:1784290424.823489:0:94974:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784290424.823510:0:94974:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c23450aba00/0x5953bbf6b3075725 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.823529:0:94974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c234236c800/0x5953bbf6b3075271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307526a expref: 23 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.823537:0:94974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c247d2ff200/0x5953bbf6b307534a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075343 expref: 23 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.823543:0:94974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c247f8ca200/0x5953bbf6b307537b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075374 expref: 23 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.823547:0:94974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c247d2ffc00/0x5953bbf6b3075397 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075390 expref: 23 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.823562:0:94974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b30753c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30753ba expref: 23 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.823577:0:94974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2345ebfc00/0x5953bbf6b30753cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30753c8 expref: 23 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.823581:0:94974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b30753eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30753e4 expref: 23 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.823586:0:94974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b30753f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30753f2 expref: 23 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.823590:0:94974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2345ebec00/0x5953bbf6b3075423 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307541c expref: 23 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.823598:0:94974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c247d2fe200/0x5953bbf6b3075438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b259e expref: 9 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.823603:0:94974:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c247f8cb000/0x5953bbf6b3075446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25ac expref: 9 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.823608:0:94974:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c23450aba00/0x5953bbf6b3075725 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.823652:0:94974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c247f8cb000/0x5953bbf6b3075446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25ac expref: 9 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.823665:0:94974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c247f8cb000/0x5953bbf6b3075446 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25ac expref: 9 pid: 94060 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.823688:0:94974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433db800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901165056:192.168.202.6@tcp:104: 00010000:00010000:3.0:1784290424.823801:0:94974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c247d2fe200/0x5953bbf6b3075438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b259e expref: 9 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.823808:0:94974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c247d2fe200/0x5953bbf6b3075438 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b259e expref: 9 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.823815:0:94974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433db480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901165184:192.168.202.6@tcp:104: 00010000:00010000:3.0:1784290424.823842:0:94974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2345ebec00/0x5953bbf6b3075423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b307541c expref: 23 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.823850:0:94974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2345ebec00/0x5953bbf6b3075423 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b307541c expref: 23 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.823857:0:94974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433daa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901165312:0@lo:104: 00000100:00100000:3.0:1784290424.823898:0:94974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784290424.823943:0:94974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b30753f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b30753f2 expref: 23 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.823950:0:94974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b30753f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b30753f2 expref: 23 pid: 94062 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.823956:0:94974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901165440:0@lo:104: 00000100:00100000:1.0:1784290424.823975:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901165312 00000100:00100000:1.0:1784290424.823987:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901165312 00000100:00100000:1.0:1784290424.824069:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1784290424.824081:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:94974:x1870961901165312:12345-0@lo:104: 00000100:00100000:3.0:1784290424.824090:0:94974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784290424.824096:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb200/0x5953bbf6b307541c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3075423 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290424.824114:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901165440 00000100:00100000:0.0:1784290424.824120:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901165440 00010000:00010000:3.0:1784290424.824156:0:94974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b30753eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b30753e4 expref: 23 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290424.824157:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00010000:00010000:1.0:1784290424.824158:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784290424.824174:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:94974:x1870961901165312:12345-0@lo:104: Request processed in 90us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290424.824175:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:94974:x1870961901165440:12345-0@lo:104: 00010000:00010000:3.0:1784290424.824176:0:94974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b30753eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b30753e4 expref: 23 pid: 94060 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290424.824188:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290424.824191:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c247d2fea00/0x5953bbf6b30753f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b30753f9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290424.824205:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00010000:00010000:2.0:1784290424.824210:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb200/0x5953bbf6b307541c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3075423 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.824214:0:94974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433d9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901165568:0@lo:104: 00010000:00010000:2.0:1784290424.824241:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cb200 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:2.0:1784290424.824247:0:8418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb200/0x5953bbf6b307541c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3075423 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290424.824258:0:8418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb200/0x5953bbf6b307541c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3075423 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290424.824267:0:8418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb200/0x5953bbf6b307541c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3075423 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.824270:0:94974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784290424.824272:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784290424.824284:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:94974:x1870961901165440:12345-0@lo:104: Request processed in 111us (188us total) trans 0 rc 0/0 00010000:00010000:1.0:1784290424.824297:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1784290424.824310:0:8418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290424.824313:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247d2fea00/0x5953bbf6b30753f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b30753f9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290424.824314:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00010000:00010000:1.0:1784290424.824375:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fea00 already unused, calling callback (ffffffffc14a9c20) 00000100:00100000:0.0:1784290424.824379:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901165568 10000000:00010000:1.0:1784290424.824381:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2fea00/0x5953bbf6b30753f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b30753f9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290424.824383:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901165568 00010000:00010000:1.0:1784290424.824398:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2fea00/0x5953bbf6b30753f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b30753f9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290424.824411:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2fea00/0x5953bbf6b30753f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b30753f9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290424.824418:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1784290424.824423:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1784290424.824434:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:94974:x1870961901165568:12345-0@lo:104: 00010000:00010000:2.0:1784290424.824443:0:8418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb200/0x5953bbf6b307541c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075423 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.824444:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b30753e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b30753eb expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290424.824452:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247d2fea00/0x5953bbf6b30753f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30753f9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.824456:0:94974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2345ebfc00/0x5953bbf6b30753cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b30753c8 expref: 23 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290424.824501:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784290424.824510:0:8418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784290424.824517:0:94974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2345ebfc00/0x5953bbf6b30753cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b30753c8 expref: 23 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.824535:0:94974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433d9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901165952:0@lo:104: 00010000:00010000:0.0:1784290424.824535:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1784290424.824537:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247d2fea00/0x5953bbf6b30753f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30753f9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290424.824548:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb200/0x5953bbf6b307541c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075423 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290424.824548:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:94974:x1870961901165568:12345-0@lo:104: Request processed in 114us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290424.824576:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1784290424.824592:0:94974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784290424.824603:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290424.824607:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2fea00/0x5953bbf6b30753f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30753f9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.824615:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b30753e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b30753eb expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290424.824619:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb200/0x5953bbf6b307541c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075423 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.824629:0:94974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b30753c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b30753ba expref: 23 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290424.824649:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290424.824655:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290424.824663:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290424.824663:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2ff000 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:0.0:1784290424.824677:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b30753e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b30753eb expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.824678:0:94974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b30753c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b30753ba expref: 23 pid: 94062 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290424.824678:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901165952 00000100:00100000:1.0:1784290424.824685:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901165952 00010000:00010000:2.0:1784290424.824695:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290424.824700:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b30753e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b30753eb expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.824706:0:94974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f98b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901166080:0@lo:104: 00010000:00010000:2.0:1784290424.824707:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1784290424.824710:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b30753e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b30753eb expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290424.824719:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784290424.824723:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290424.824727:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1784290424.824744:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:94974:x1870961901165952:12345-0@lo:104: 00010000:00010000:0.0:1784290424.824744:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b30753e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30753eb expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.824745:0:94974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784290424.824758:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784290424.824761:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c247f8ca600/0x5953bbf6b30753c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b30753cf expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.824771:0:94974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c247d2ffc00/0x5953bbf6b3075397 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3075390 expref: 23 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290424.824771:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901165824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290424.824781:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b30753e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30753eb expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290424.824800:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1784290424.824809:0:94974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c247d2ffc00/0x5953bbf6b3075397 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3075390 expref: 23 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.824811:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2ff000/0x5953bbf6b30753e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30753eb expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290424.824816:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:94974:x1870961901165952:12345-0@lo:104: Request processed in 76us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290424.824832:0:94974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f988e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901166336:0@lo:104: 00000100:00100000:1.0:1784290424.824836:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00010000:00010000:0.0:1784290424.824843:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290424.824850:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247f8ca600/0x5953bbf6b30753c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b30753cf expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.824858:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8ca600 already unused, calling callback (ffffffffc14a9c20) 00000100:00100000:1.0:1784290424.824865:0:6471:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784290424.824871:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1784290424.824871:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247f8ca600/0x5953bbf6b30753c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b30753cf expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290424.824892:0:6471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784290424.824893:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247f8ca600/0x5953bbf6b30753c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b30753cf expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290424.824917:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901166080 10000000:00010000:0.0:1784290424.824919:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247f8ca600/0x5953bbf6b30753c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b30753cf expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290424.824923:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901166080 00000100:00100000:2.0:1784290424.824931:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 10000000:01000000:0.0:1784290424.824931:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1784290424.824945:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901166336 00000100:00100000:1.0:1784290424.824951:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901166336 00000100:00100000:2.0:1784290424.824956:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901165696:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784290424.824968:0:94974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c247f8ca200/0x5953bbf6b307537b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3075374 expref: 23 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290424.824972:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00010000:00010000:0.0:1784290424.824978:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247f8ca600/0x5953bbf6b30753c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30753cf expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290424.824987:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24691ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:94974:x1870961901166080:12345-0@lo:104: 00000100:00100000:2.0:1784290424.825015:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784290424.825015:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784290424.825016:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb600/0x5953bbf6b30753ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b30753c1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.825021:0:94974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c247f8ca200/0x5953bbf6b307537b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3075374 expref: 23 pid: 94062 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.825047:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247f8ca600/0x5953bbf6b30753c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30753cf expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.825056:0:94974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f98a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901166464:0@lo:104: 00010000:00010000:0.0:1784290424.825064:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247f8ca600/0x5953bbf6b30753c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30753cf expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.825091:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290424.825094:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290424.825096:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901166592:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290424.825098:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290424.825112:0:94974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290424.825117:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901166208:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290424.825132:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784290424.825140:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24691ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:94974:x1870961901166080:12345-0@lo:104: Request processed in 157us (401us total) trans 0 rc 0/0 00010000:00010000:3.0:1784290424.825149:0:94974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c247d2ff200/0x5953bbf6b307534a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3075343 expref: 23 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290424.825151:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1784290424.825178:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290424.825185:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901166464 00000100:00100000:0.0:1784290424.825190:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901166464 00000100:00100000:1.0:1784290424.825231:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1784290424.825248:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1784290424.825250:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:94974:x1870961901166336:12345-0@lo:104: 00010000:00010000:2.0:1784290424.825255:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1784290424.825262:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:94974:x1870961901166464:12345-0@lo:104: 00010000:00010000:1.0:1784290424.825265:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c234236d400/0x5953bbf6b3075390 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3075397 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290424.825266:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb600/0x5953bbf6b30753ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b30753c1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.825272:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3075374 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b307537b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.825288:0:94974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c247d2ff200/0x5953bbf6b307534a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3075343 expref: 23 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290424.825328:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cb600 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:2.0:1784290424.825334:0:19681:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb600/0x5953bbf6b30753ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b30753c1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.825382:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1784290424.825387:0:19681:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb600/0x5953bbf6b30753ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b30753c1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290424.825394:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:94974:x1870961901166464:12345-0@lo:104: Request processed in 132us (286us total) trans 0 rc 0/0 00010000:00010000:1.0:1784290424.825400:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784290424.825406:0:94974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901166720:0@lo:104: 00000100:00100000:1.0:1784290424.825426:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:94974:x1870961901166336:12345-0@lo:104: Request processed in 178us (527us total) trans 0 rc 0/0 10000000:00010000:2.0:1784290424.825436:0:19681:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb600/0x5953bbf6b30753ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b30753c1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290424.825448:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1784290424.825463:0:94974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290424.825469:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 10000000:01000000:2.0:1784290424.825476:0:19681:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784290424.825502:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784290424.825509:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3075374 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b307537b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290424.825510:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901166720 00000100:00100000:1.0:1784290424.825516:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901166720 00010000:00010000:2.0:1784290424.825517:0:19681:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb600/0x5953bbf6b30753ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30753c1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.825520:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2ffe00 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:0.0:1784290424.825531:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3075374 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b307537b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.825534:0:94974:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c234236c800/0x5953bbf6b3075271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b307526a expref: 23 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290424.825547:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00010000:00010000:2.0:1784290424.825555:0:19681:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784290424.825566:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444058a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:94974:x1870961901166720:12345-0@lo:104: 00010000:00010000:0.0:1784290424.825575:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3075374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b307537b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290424.825580:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b3075343 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b307534a expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.825581:0:94974:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c234236c800/0x5953bbf6b3075271 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b307526a expref: 23 pid: 94059 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290424.825583:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3075374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b307537b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290424.825586:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb600/0x5953bbf6b30753ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30753c1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290424.825634:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1784290424.825637:0:94974:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901166976:0@lo:104: 00010000:00010000:2.0:1784290424.825639:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247f8cb600/0x5953bbf6b30753ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30753c1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.825662:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3075374 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307537b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.825668:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784290424.825678:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784290424.825678:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1784290424.825680:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3075374 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307537b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.825692:0:94974:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784290424.825696:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c234236d400/0x5953bbf6b3075390 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3075397 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290424.825698:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444058a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:94974:x1870961901166720:12345-0@lo:104: Request processed in 136us (246us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290424.825700:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffe00/0x5953bbf6b3075374 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307537b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.825707:0:94974:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344dd43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290424.825742:0:94974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433daa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901165312:0@lo:104: 00000100:00100000:1.0:1784290424.825742:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00010000:00010000:0.0:1784290424.825750:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290424.825762:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b3075343 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b307534a expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290424.825766:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d400 already unused, calling callback (ffffffffc14a9c20) 00000100:00100000:1.0:1784290424.825766:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901166976 00000100:00100000:3.0:1784290424.825771:0:94974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901165440:0@lo:104: 00000100:00100000:1.0:1784290424.825782:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901166976 10000000:00010000:2.0:1784290424.825783:0:19681:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c234236d400/0x5953bbf6b3075390 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3075397 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.825791:0:94974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433d9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901165568:0@lo:104: 00010000:00010000:0.0:1784290424.825794:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c200 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:0.0:1784290424.825805:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b3075343 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b307534a expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290424.825808:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1784290424.825815:0:94974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433d9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901165952:0@lo:104: 00000100:00100000:1.0:1784290424.825838:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c244405aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:94974:x1870961901166976:12345-0@lo:104: 00010000:00010000:0.0:1784290424.825842:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b3075343 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b307534a expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290424.825846:0:19681:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c234236d400/0x5953bbf6b3075390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3075397 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290424.825847:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c247d2fec00/0x5953bbf6b307526a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3075271 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.825852:0:94974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f98b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901166080:0@lo:104: 10000000:00010000:0.0:1784290424.825854:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b3075343 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b307534a expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.825886:0:94974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f988e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901166336:0@lo:104: 10000000:01000000:0.0:1784290424.825908:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:2.0:1784290424.825913:0:19681:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c234236d400/0x5953bbf6b3075390 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3075397 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.825925:0:94974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f98a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901166464:0@lo:104: 00010000:00010000:0.0:1784290424.825929:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b3075343 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307534a expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290424.825932:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784290424.825955:0:94974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901166720:0@lo:104: 00000100:00100000:1.0:1784290424.825961:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c244405aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:94974:x1870961901166976:12345-0@lo:104: Request processed in 122us (268us total) trans 0 rc 0/0 10000000:01000000:2.0:1784290424.825962:0:19681:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784290424.825967:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1784290424.825972:0:94974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901166976:0@lo:104: 00000100:00100000:1.0:1784290424.825990:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00010000:00010000:0.0:1784290424.825997:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b3075343 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307534a expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.826005:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c234236c200/0x5953bbf6b3075343 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307534a expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290424.826015:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290424.826017:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290424.826019:0:19681:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c234236d400/0x5953bbf6b3075390 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075397 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290424.826021:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247d2fec00/0x5953bbf6b307526a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3075271 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.826021:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290424.826028:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290424.826052:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fec00 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:1.0:1784290424.826062:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2fec00/0x5953bbf6b307526a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3075271 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290424.826064:0:19681:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784290424.826065:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901165824 00000100:00100000:0.0:1784290424.826074:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901165824 00010000:00010000:1.0:1784290424.826085:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2fec00/0x5953bbf6b307526a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3075271 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290424.826091:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c234236d400/0x5953bbf6b3075390 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075397 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290424.826093:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2fec00/0x5953bbf6b307526a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3075271 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.826102:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b30753f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b30753f2 expref: 24 pid: 94062 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.826133:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 10000000:01000000:1.0:1784290424.826140:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784290424.826141:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c234236d400/0x5953bbf6b3075390 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075397 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290424.826161:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901165696 00000100:00100000:3.0:1784290424.826171:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290424.826173:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901165696 00010000:00010000:2.0:1784290424.826176:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290424.826183:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290424.826192:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290424.826195:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247d2fec00/0x5953bbf6b307526a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075271 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.826199:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2345ebec00/0x5953bbf6b3075423 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b307541c expref: 25 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290424.826208:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784290424.826221:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247d2fec00/0x5953bbf6b307526a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075271 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.826231:0:10356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896281856 00000100:00100000:2.0:1784290424.826232:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901166592 00000100:00100000:0.0:1784290424.826236:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896281984 00000100:00100000:0.0:1784290424.826245:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896281984 00010000:00010000:1.0:1784290424.826250:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2fec00/0x5953bbf6b307526a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075271 expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.826254:0:10356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896281856 00000100:00100000:2.0:1784290424.826254:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901166592 00010000:00010000:0.0:1784290424.826266:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c247d2fe200/0x5953bbf6b3075438 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b259e expref: 10 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290424.826288:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2615 00010000:00010000:1.0:1784290424.826290:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290424.826294:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290424.826298:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290424.826301:0:10356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c247f8cb000/0x5953bbf6b3075446 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25ac expref: 11 pid: 94060 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290424.826306:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+26:3617:x1870961901165824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290424.826307:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2345ebfc00/0x5953bbf6b30753cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b30753c8 expref: 26 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290424.826308:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290424.826318:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290424.826384:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784290424.826385:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2616 00000100:00100000:3.0:1784290424.826395:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2617 00010000:00010000:0.0:1784290424.826398:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b30753f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b30753f2 expref: 26 pid: 94062 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290424.826399:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e54cd1c-9dbd-4e31-b60e-998135d46053+26:3617:x1870961901165696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290424.826415:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1784290424.826423:0:10356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+11:2397:x1870961896281984:12345-192.168.202.6@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1784290424.826423:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2618 00010000:00010000:1.0:1784290424.826427:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2345ebec00/0x5953bbf6b3075423 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b307541c expref: 26 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.826434:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b30753f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b30753f2 expref: 26 pid: 94062 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.826449:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1784290424.826460:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+11:2400:x1870961896281856:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784290424.826468:0:10356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c247d2fe200/0x5953bbf6b3075438 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b259e expref: 11 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290424.826469:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2345ebec00/0x5953bbf6b3075423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b307541c expref: 26 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290424.826491:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290424.826500:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c247f8cb000/0x5953bbf6b3075446 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25ac expref: 11 pid: 94060 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.826506:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebea00/0x5953bbf6b30753f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 19 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b30753f2 expref: 26 pid: 94062 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.826507:0:10356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c247d2fe200/0x5953bbf6b3075438 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 19 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b259e expref: 11 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290424.826550:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebec00/0x5953bbf6b3075423 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b307541c expref: 25 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290424.826558:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c247f8cb000/0x5953bbf6b3075446 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25ac expref: 11 pid: 94060 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.826581:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290424.826583:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290424.826597:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290424.826600:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784290424.826637:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3617:x1870961901165824:12345-0@lo:103:ldlm_bl.0 Request processed in 339us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290424.826639:0:10356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+11:2397:x1870961896281984:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 228us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290424.826641:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3617:x1870961901165696:12345-0@lo:103:ldlm_bl.0 Request processed in 243us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290424.826655:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2615 00000100:00100000:3.0:1784290424.826662:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2617 00000100:00100000:1.0:1784290424.826675:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2616 00000100:00100000:2.0:1784290424.826678:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2400:x1870961896281856:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 218us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290424.826684:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619 00000100:00100000:0.0:1784290424.826701:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:3620:x1870961901166592:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290424.826712:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2618 00010000:00010000:0.0:1784290424.826716:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290424.826724:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2345ebfc00/0x5953bbf6b30753cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b30753c8 expref: 22 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.826745:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2345ebfc00/0x5953bbf6b30753cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b30753c8 expref: 22 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.826760:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebfc00/0x5953bbf6b30753cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b30753c8 expref: 22 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.826770:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784290424.826786:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901167104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290424.826816:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:3620:x1870961901166592:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290424.826831:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619 00000100:00100000:1.0:1784290424.826840:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290424.826868:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901167104 00000100:00100000:0.0:1784290424.826873:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901167104 00010000:00010000:0.0:1784290424.826899:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c247f8ca200/0x5953bbf6b307537b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075374 expref: 21 pid: 94062 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290424.826905:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901167360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290424.826910:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00010000:00010000:3.0:1784290424.826920:0:94974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247f8cb000/0x5953bbf6b3075446 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25ac expref: 9 pid: 94060 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290424.826921:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2620 00000100:00100000:1.0:1784290424.826930:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901166848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290424.826935:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:3618:x1870961901167104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290424.826951:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1784290424.826959:0:94974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433db800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901165056:192.168.202.6@tcp:104: 00010000:00010000:0.0:1784290424.826961:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c247f8ca200/0x5953bbf6b307537b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075374 expref: 21 pid: 94062 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290424.826973:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290424.826991:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784290424.826994:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c247f8ca200/0x5953bbf6b307537b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3075374 expref: 21 pid: 94062 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.827004:0:94974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247d2fe200/0x5953bbf6b3075438 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b259e expref: 8 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.827009:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247f8ca200/0x5953bbf6b307537b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3075374 expref: 21 pid: 94062 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.827021:0:94974:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433db480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94974:1870961901165184:192.168.202.6@tcp:104: 00010000:00010000:0.0:1784290424.827023:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784290424.827097:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901167232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290424.827117:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:3618:x1870961901167104:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290424.827128:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901166592:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784290424.827142:0:94974:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c23450aba00/0x5953bbf6b3075725 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290424.827151:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290424.827152:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2620 00000100:00100000:0.0:1784290424.827195:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901167360 00000100:00100000:0.0:1784290424.827200:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901167360 00000100:00100000:3.0:1784290424.827213:0:19593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901166208 00000100:00100000:3.0:1784290424.827219:0:19593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901166208 00000100:00100000:2.0:1784290424.827219:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290424.827222:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901167232 00010000:00010000:0.0:1784290424.827225:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c247d2ffc00/0x5953bbf6b3075397 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075390 expref: 20 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290424.827230:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901167232 00010000:00010000:3.0:1784290424.827248:0:19593:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b30753eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b30753e4 expref: 22 pid: 94060 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290424.827263:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c247d2ff200/0x5953bbf6b307534a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075343 expref: 22 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290424.827264:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901166848 00000100:00100000:0.0:1784290424.827270:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901166848 00000100:00100000:2.0:1784290424.827274:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901167488:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290424.827291:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b30753c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b30753ba expref: 23 pid: 94062 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.827296:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621 00000100:00100000:3.0:1784290424.827318:0:19593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3620:x1870961901167360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784290424.827331:0:19593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290424.827374:0:19593:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c247d2ffc00/0x5953bbf6b3075397 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075390 expref: 23 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.827384:0:19593:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c247d2ffc00/0x5953bbf6b3075397 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3075390 expref: 23 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290424.827392:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784290424.827417:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247d2ffc00/0x5953bbf6b3075397 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3075390 expref: 23 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.827437:0:19593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784290424.827472:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901167104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784290424.827503:0:19593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:3620:x1870961901167360:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290424.827528:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901167488 00000100:00100000:2.0:1784290424.827534:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901167488 00010000:00010000:2.0:1784290424.827554:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c234236c800/0x5953bbf6b3075271 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b307526a expref: 23 pid: 94059 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290424.827557:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2622 00000100:00100000:1.0:1784290424.827576:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2623 00000100:00100000:0.0:1784290424.827582:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2458024050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3619:x1870961901166208:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784290424.827587:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621 00000100:00100000:1.0:1784290424.827590:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3619:x1870961901167232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290424.827605:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290424.827605:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290424.827619:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c247d2ff200/0x5953bbf6b307534a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075343 expref: 22 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.827619:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b30753eb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b30753e4 expref: 22 pid: 94060 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290424.827637:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624 00000100:00100000:3.0:1784290424.827658:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2625 00010000:00010000:0.0:1784290424.827661:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b30753eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b30753e4 expref: 22 pid: 94060 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290424.827663:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:3618:x1870961901166848:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784290424.827676:0:19593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:3618:x1870961901167488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290424.827700:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c247d2ff200/0x5953bbf6b307534a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3075343 expref: 22 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.827706:0:19593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290424.827707:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290424.827714:0:19593:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c234236c800/0x5953bbf6b3075271 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b307526a expref: 22 pid: 94059 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.827718:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247f8ca400/0x5953bbf6b30753eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b30753e4 expref: 22 pid: 94060 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290424.827724:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247d2ff200/0x5953bbf6b307534a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3075343 expref: 22 pid: 94058 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290424.827726:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b30753c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b30753ba expref: 22 pid: 94062 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.827732:0:19593:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c234236c800/0x5953bbf6b3075271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b307526a expref: 22 pid: 94059 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290424.827788:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290424.827789:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290424.827797:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236c800/0x5953bbf6b3075271 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b307526a expref: 20 pid: 94059 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290424.827807:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b30753c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b30753ba expref: 19 pid: 94062 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.827817:0:19593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290424.827830:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebfe00/0x5953bbf6b30753c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b30753ba expref: 19 pid: 94062 timeout: 2266 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290424.827852:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2458024050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:3619:x1870961901166208:12345-0@lo:103:ldlm_bl.0 Request processed in 275us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290424.827854:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:3619:x1870961901167232:12345-0@lo:103:ldlm_bl.0 Request processed in 266us (714us total) trans 0 rc 0/0 00010000:00010000:2.0:1784290424.827862:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c23450aba00/0x5953bbf6b3075725 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.827873:0:19593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:3618:x1870961901167488:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290424.827875:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2622 00000100:00100000:1.0:1784290424.827897:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2623 00010000:00010000:2.0:1784290424.827912:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c23450aba00/0x5953bbf6b3075725 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.827913:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2625 00010000:00010000:2.0:1784290424.827943:0:6474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c23450aba00/0x5953bbf6b3075725 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290424.827966:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901167232:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290424.827972:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c23450aba00/0x5953bbf6b3075725 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.827981:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901165696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290424.827989:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901166208:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290424.828004:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c23450aba00/0x5953bbf6b3075725 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290424.828017:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c23450aba00/0x5953bbf6b3075725 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290424.828026:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901165824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290424.828026:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901167360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290424.828084:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901167488:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290424.828085:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aba00 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290424.828092:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c23450aba00/0x5953bbf6b3075725 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290424.828109:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c23450aba00/0x5953bbf6b3075725 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290424.828130:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c23450aba00/0x5953bbf6b3075725 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290424.828141:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290424.828152:0:94974:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c23450aba00/0x5953bbf6b3075725 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.828160:0:94974:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c23450aba00/0x5953bbf6b3075725 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290424.828166:0:94974:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c23450aba00/0x5953bbf6b3075725 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290424.828199:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:3618:x1870961901166848:12345-0@lo:103:ldlm_bl.0 Request processed in 542us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290424.828221:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901166848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290424.828222:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624 00010000:00010000:0.0:1784290425.511556:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290425.990120:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290425.990229:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896282112 00000100:00100000:0.0:1784290425.990247:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896282112 00000100:00100000:0.0:1784290425.990399:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:0.0:1784290425.990419:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70750:x1870961896282112:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290425.990449:0:94062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290425.990480:0:94062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246dd27200/0x5953bbf6b307572c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b25f9 expref: -99 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290425.990527:0:94062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd27200/0x5953bbf6b307572c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25f9 expref: 9 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290425.990543:0:94062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246dd27200/0x5953bbf6b307572c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25f9 expref: 9 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290425.990558:0:94062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27200, rc 0) 00000100:00100000:0.0:1784290425.990650:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896282112:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 238us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290425.990659:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 76 00000100:00100000:3.0:1784290425.992888:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290425.993062:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896282240 00000100:00100000:1.0:1784290425.993072:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896282240 00000100:00100000:1.0:1784290425.993133:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:1.0:1784290425.993144:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896282240:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290425.993429:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896282240:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 283us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290425.993442:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 77 00000100:00100000:3.0:1784290425.994984:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290425.995117:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896282368 00000100:00100000:2.0:1784290425.995127:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896282368 00000100:00100000:2.0:1784290425.995180:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 78 00000100:00100000:2.0:1784290425.995191:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896282368:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290425.995380:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896282368:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 150us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290425.995393:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 78 00000100:00100000:2.0:1784290425.997893:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290425.997982:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896282496 00000100:00100000:1.0:1784290425.997991:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896282496 00000100:00100000:1.0:1784290425.998073:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00100000:1.0:1784290425.998084:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:73112:x1870961896282496:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784290425.998223:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:73112:x1870961896282496:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 138us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290425.998239:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 79 00000100:00100000:3.0:1784290425.999690:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290425.999834:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896282624 00000100:00100000:0.0:1784290425.999848:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896282624 00000100:00100000:0.0:1784290425.999917:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00100000:0.0:1784290425.999930:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:73112:x1870961896282624:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784290426.000095:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:73112:x1870961896282624:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 165us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290426.000109:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 80 00000100:00100000:3.0:1784290426.002131:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290426.002224:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896282752 00000100:00100000:2.0:1784290426.002237:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896282752 00000100:00100000:2.0:1784290426.002304:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:2.0:1784290426.002317:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896282752:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290426.002330:0:94058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290426.002385:0:94058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236d000/0x5953bbf6b3075733 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2600 expref: -99 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290426.002414:0:94058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236d000/0x5953bbf6b3075733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2600 expref: 10 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290426.002428:0:94058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236d000/0x5953bbf6b3075733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2600 expref: 10 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290426.002440:0:94058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236d000, rc 0) 00000100:00100000:2.0:1784290426.002494:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70750:x1870961896282752:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 179us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290426.002522:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 81 00000100:00100000:2.0:1784290426.004220:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290426.004325:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896282880 00000100:00100000:0.0:1784290426.004336:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896282880 00000100:00100000:0.0:1784290426.004420:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:0.0:1784290426.004448:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70750:x1870961896282880:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290426.004556:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70750:x1870961896282880:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 100us (327us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784290426.004573:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 82 00000100:00100000:3.0:1784290426.373932:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290426.374033:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290426.374093:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896283008 00000100:00100000:3.0:1784290426.374106:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290426.374111:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896283008 00000100:00100000:1.0:1784290426.374136:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896283136 00000100:00100000:1.0:1784290426.374147:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896283136 00000100:00100000:3.0:1784290426.374189:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290426.374209:0:26259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896283392 00000100:00100000:0.0:1784290426.374219:0:26259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896283392 00000100:00100000:3.0:1784290426.374286:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896283264 00000100:00100000:2.0:1784290426.374289:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 761 00000100:00100000:3.0:1784290426.374296:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896283264 00000100:00100000:1.0:1784290426.374309:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 762 00000100:00100000:2.0:1784290426.374322:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:2397:x1870961896283008:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290426.374323:0:26259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1627 00000100:00100000:0.0:1784290426.374347:0:26259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2398:x1870961896283392:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290426.374392:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:2398:x1870961896283136:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290426.374413:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1628 00000100:00100000:3.0:1784290426.374429:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2397:x1870961896283264:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290426.374517:0:26259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2398:x1870961896283392:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 167us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290426.374518:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:2398:x1870961896283136:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 177us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290426.374521:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:2397:x1870961896283008:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 205us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290426.374522:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2397:x1870961896283264:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 92us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290426.374555:0:26259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1627 00000100:00100000:1.0:1784290426.374557:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 762 00000100:00100000:3.0:1784290426.374570:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1628 00000100:00100000:2.0:1784290426.374576:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 761 00000100:00080000:3.0:1784290426.374620:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784290426.374629:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784290426.374635:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1784290426.374640:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784290426.535582:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784290426.791510:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784290426.791523:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c247e403000 from 58 10000000:01000000:3.0:1784290426.791531:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784290426.791615:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450abc00/0x5953bbf6b307573a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.791632:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450abc00/0x5953bbf6b307573a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.791691:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450abc00/0x5953bbf6b307573a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290426.791732:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901167616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.791861:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.791930:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344dd43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290426.791963:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901167616 00000100:00100000:1.0:1784290426.791976:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901167616 00000100:00100000:1.0:1784290426.792086:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784290426.792109:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:6485:x1870961901167616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290426.792129:0:94060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290426.792147:0:94060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c24414b8200/0x5953bbf6b3075741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307573a expref: -99 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290426.792181:0:94060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c24414b8200/0x5953bbf6b3075741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307573a expref: 16 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290426.792192:0:94060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c24414b8200/0x5953bbf6b3075741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307573a expref: 16 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290426.792203:0:94060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24414b8200, rc 0) 00000100:00100000:1.0:1784290426.792263:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901167616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290426.792271:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784290426.792335:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901167616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290426.792391:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450abc00/0x5953bbf6b307573a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075741 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.792406:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450abc00/0x5953bbf6b307573a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075741 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290426.792486:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901167744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.792519:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.792553:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344dd43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290426.792612:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901167744 00000100:00100000:2.0:1784290426.792623:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901167744 00000100:00100000:2.0:1784290426.792678:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784290426.792688:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901167744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290426.792863:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901167744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 176us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290426.792872:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1784290426.792928:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901167744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.792979:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901167872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.793066:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.793096:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344dd43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290426.793126:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901167872 00000100:00100000:2.0:1784290426.793132:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901167872 00000100:00100000:2.0:1784290426.793166:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1784290426.793173:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901167872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290426.793294:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901167872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290426.793302:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784290426.793393:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901167872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290426.793941:0:94978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94978:1870961901168000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290426.794005:0:94978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290426.794094:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901168000 00000100:00100000:0.0:1784290426.794102:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901168000 00000100:00100000:0.0:1784290426.794160:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784290426.794167:0:94978:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344a793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290426.794177:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:94978:x1870961901168000:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290426.794336:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:94978:x1870961901168000:12345-0@lo:502:llog_process_th.0 Request processed in 164us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290426.794406:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784290426.794409:0:94978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94978:1870961901168000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290426.794502:0:94978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94978:1870961901168128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290426.794606:0:94978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290426.794640:0:94978:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b38ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290426.794671:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901168128 00000100:00100000:2.0:1784290426.794688:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901168128 00000100:00100000:2.0:1784290426.794728:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784290426.794740:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:94978:x1870961901168128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290426.794846:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:94978:x1870961901168128:12345-0@lo:502:llog_process_th.0 Request processed in 109us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290426.794855:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1784290426.794873:0:94978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94978:1870961901168128:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784290426.794903:0:94978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1784290426.795098:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1784290426.795139:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290426.795151:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450abc00/0x5953bbf6b307573a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075741 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.795179:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450abc00/0x5953bbf6b307573a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075741 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290426.795194:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1784290426.795197:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 53 10000000:01000000:3.0:1784290426.795202:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784290426.795227:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3075748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.795240:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3075748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.795253:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3075748 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290426.795277:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901168256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.795318:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290426.795390:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901168256 00000100:00100000:2.0:1784290426.795397:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901168256 00000100:00100000:3.0:1784290426.795449:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24412ed240 going to sleep for 11 seconds 00000100:00100000:2.0:1784290426.795468:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784290426.795482:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901168256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290426.795494:0:94062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290426.795508:0:94062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236d600/0x5953bbf6b307574f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3075748 expref: -99 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290426.795533:0:94062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236d600/0x5953bbf6b307574f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3075748 expref: 17 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290426.795548:0:94062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236d600/0x5953bbf6b307574f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075748 expref: 17 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290426.795558:0:94062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236d600, rc 0) 00000100:00100000:2.0:1784290426.795601:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901168256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290426.795608:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784290426.795667:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901168256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290426.795699:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3075748 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307574f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.795714:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3075748 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307574f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290426.795779:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901168384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.795823:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.795868:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24412ed240 going to sleep for 11 seconds 00000100:00100000:1.0:1784290426.795912:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901168384 00000100:00100000:1.0:1784290426.795920:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901168384 00000100:00100000:1.0:1784290426.795975:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1784290426.796003:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901168384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290426.796175:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901168384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290426.796184:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784290426.796245:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901168384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.796290:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901168512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.796410:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.796453:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24412ed240 going to sleep for 11 seconds 00000100:00100000:0.0:1784290426.796483:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901168512 00000100:00100000:0.0:1784290426.796491:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901168512 00000100:00100000:0.0:1784290426.796533:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1784290426.796545:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901168512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290426.796657:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901168512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290426.796665:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784290426.796726:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901168512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290426.797124:0:94979:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94979:1870961901168640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290426.797169:0:94979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290426.797200:0:94979:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b260a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784290426.797230:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901168640 00000100:00100000:2.0:1784290426.797237:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901168640 00000100:00100000:2.0:1784290426.797292:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784290426.797300:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:94979:x1870961901168640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290426.797446:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:94979:x1870961901168640:12345-0@lo:502:llog_process_th.0 Request processed in 143us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290426.797458:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784290426.797498:0:94979:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94979:1870961901168640:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784290426.797535:0:94979:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784290426.797552:0:94979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290426.797555:0:94979:0:(obd_config.c:1561:class_process_config()) marker 45 (0x1) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:0.0:1784290426.797561:0:94979:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:0.0:1784290426.797586:0:94979:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000020:01000004:0.0:1784290426.797995:0:94980:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c247e403000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784290426.798002:0:94980:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c247e403000 4 00000100:00100000:2.0:1784290426.798038:0:94979:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94979:1870961901168768:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290426.798103:0:94979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290426.798146:0:94979:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246d46a900 going to sleep for 11 seconds 00000100:00100000:3.0:1784290426.798187:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901168768 00000100:00100000:3.0:1784290426.798197:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901168768 00000100:00100000:3.0:1784290426.798251:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784290426.798263:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:94979:x1870961901168768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290426.798424:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:94979:x1870961901168768:12345-0@lo:502:llog_process_th.0 Request processed in 161us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290426.798443:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784290426.798475:0:94979:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94979:1870961901168768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784290426.798507:0:94979:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784290426.798513:0:94979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290426.798516:0:94979:0:(obd_config.c:1561:class_process_config()) marker 45 (0x2) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1784290426.798520:0:94979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000020:01000000:3.0:1784290426.798614:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 53-55 (rc=0) 10000000:01000000:3.0:1784290426.798639:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784290426.798649:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3075748 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307574f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.798663:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3075748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307574f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290426.798675:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784290426.798678:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c23452c5000 from 58 10000000:01000000:3.0:1784290426.798682:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784290426.798716:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b3075756 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.798729:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b3075756 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.798753:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b3075756 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290426.798776:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901168896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.798819:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290426.798871:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901168896 00000100:00100000:3.0:1784290426.798873:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24412ed6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290426.798881:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901168896 00000100:00100000:1.0:1784290426.798923:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1784290426.798933:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901168896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290426.798945:0:94058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290426.798964:0:94058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c24414b8c00/0x5953bbf6b307575d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3075756 expref: -99 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290426.798991:0:94058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c24414b8c00/0x5953bbf6b307575d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3075756 expref: 18 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290426.799003:0:94058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c24414b8c00/0x5953bbf6b307575d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075756 expref: 18 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290426.799028:0:94058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24414b8c00, rc 0) 00000100:00100000:1.0:1784290426.799081:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901168896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290426.799089:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784290426.799145:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901168896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290426.799165:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b3075756 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307575d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.799180:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b3075756 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307575d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290426.799241:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901169024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.799286:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.799316:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24412ed6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290426.799385:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901169024 00000100:00100000:0.0:1784290426.799393:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901169024 00000100:00100000:0.0:1784290426.799455:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784290426.799469:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901169024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290426.799566:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901169024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290426.799577:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784290426.799607:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901169024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.799651:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901169152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.799705:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.799740:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24412ed6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290426.799771:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901169152 00000100:00100000:2.0:1784290426.799778:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901169152 00000100:00100000:2.0:1784290426.799812:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784290426.799819:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901169152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290426.799907:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901169152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290426.799915:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784290426.799956:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901169152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290426.800231:0:94981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94981:1870961901169280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290426.800278:0:94981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290426.800303:0:94981:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458193cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290426.800309:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901169280 00000100:00100000:3.0:1784290426.800315:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901169280 00000100:00100000:3.0:1784290426.800388:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784290426.800403:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:94981:x1870961901169280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290426.800502:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:94981:x1870961901169280:12345-0@lo:502:llog_process_th.0 Request processed in 105us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290426.800513:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784290426.800556:0:94981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94981:1870961901169280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290426.800626:0:94981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94981:1870961901169408:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290426.800684:0:94981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290426.800743:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901169408 00000100:00100000:0.0:1784290426.800747:0:94981:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458193cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290426.800753:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901169408 00000100:00100000:1.0:1784290426.800799:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1784290426.800808:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:94981:x1870961901169408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290426.800945:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:94981:x1870961901169408:12345-0@lo:502:llog_process_th.0 Request processed in 120us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290426.800975:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784290426.800997:0:94981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94981:1870961901169408:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784290426.801087:0:94981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1784290426.801183:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1784290426.801206:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290426.801214:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b3075756 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307575d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.801224:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b3075756 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307575d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290426.801232:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1784290426.801234:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:3.0:1784290426.801237:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1784290426.801254:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3075764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.801262:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3075764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.801270:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3075764 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290426.801294:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901169536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.801327:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.801396:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24412ed6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290426.801429:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901169536 00000100:00100000:0.0:1784290426.801440:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901169536 00000100:00100000:0.0:1784290426.801494:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784290426.801509:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901169536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290426.801523:0:94059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290426.801539:0:94059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246dd26a00/0x5953bbf6b307576b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3075764 expref: -99 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290426.801565:0:94059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd26a00/0x5953bbf6b307576b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3075764 expref: 19 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290426.801580:0:94059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246dd26a00/0x5953bbf6b307576b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075764 expref: 19 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290426.801594:0:94059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26a00, rc 0) 00000100:00100000:0.0:1784290426.801652:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901169536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290426.801665:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1784290426.801679:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901169536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290426.801696:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3075764 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307576b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.801713:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3075764 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307576b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290426.801753:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901169664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.801780:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.801800:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24412ed6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290426.801866:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901169664 00000100:00100000:2.0:1784290426.801874:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901169664 00000100:00100000:2.0:1784290426.801919:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1784290426.801927:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901169664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290426.802056:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901169664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290426.802076:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784290426.802108:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901169664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.802142:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901169792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.802182:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.802203:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24412ed6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290426.802231:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901169792 00000100:00100000:2.0:1784290426.802240:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901169792 00000100:00100000:2.0:1784290426.802288:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1784290426.802301:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901169792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290426.802474:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901169792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290426.802489:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784290426.802516:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901169792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290426.802805:0:94982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94982:1870961901169920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290426.802868:0:94982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290426.802913:0:94982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458193180 going to sleep for 11 seconds 00000100:00100000:1.0:1784290426.802949:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901169920 00000100:00100000:1.0:1784290426.802957:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901169920 00000100:00100000:1.0:1784290426.802991:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784290426.802997:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:94982:x1870961901169920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290426.803103:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:94982:x1870961901169920:12345-0@lo:502:llog_process_th.0 Request processed in 106us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290426.803110:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1784290426.803168:0:94982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94982:1870961901169920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784290426.803204:0:94982:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784290426.803215:0:94982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290426.803219:0:94982:0:(obd_config.c:1561:class_process_config()) marker 46 (0x1) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:0.0:1784290426.803226:0:94982:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:0.0:1784290426.803272:0:94982:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:0.0:1784290426.803307:0:94982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94982:1870961901170048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290426.803434:0:94982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290426.803486:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901170048 00000100:00100000:0.0:1784290426.803492:0:94982:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2458193180 going to sleep for 11 seconds 00000100:00100000:2.0:1784290426.803493:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901170048 00000100:00100000:2.0:1784290426.803540:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1784290426.803548:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:94982:x1870961901170048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290426.803651:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:94982:x1870961901170048:12345-0@lo:502:llog_process_th.0 Request processed in 101us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290426.803662:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1784290426.803690:0:94982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ca680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94982:1870961901170048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784290426.803732:0:94982:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784290426.803740:0:94982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784290426.803743:0:94982:0:(obd_config.c:1561:class_process_config()) marker 46 (0x2) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1784290426.803748:0:94982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000020:01000000:3.0:1784290426.803833:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-55 (rc=0) 10000000:01000000:3.0:1784290426.803863:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1784290426.803871:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3075764 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307576b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.803883:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3075764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307576b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290426.803894:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784290426.803896:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c246ff27800 from 58 10000000:01000000:3.0:1784290426.803898:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784290426.803927:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3075772 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.803938:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3075772 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.803980:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3075772 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290426.804008:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901170176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.804083:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.804110:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344dd43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290426.804134:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901170176 00000100:00100000:2.0:1784290426.804140:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901170176 00000100:00100000:2.0:1784290426.804175:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1784290426.804182:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901170176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290426.804190:0:94060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290426.804202:0:94060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236c400/0x5953bbf6b3075779 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3075772 expref: -99 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290426.804222:0:94060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236c400/0x5953bbf6b3075779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3075772 expref: 20 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290426.804236:0:94060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236c400/0x5953bbf6b3075779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075772 expref: 20 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290426.804266:0:94060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236c400, rc 0) 00000100:00100000:2.0:1784290426.804323:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901170176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290426.804331:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784290426.804400:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901170176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290426.804415:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3075772 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075779 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.804424:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3075772 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075779 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290426.804464:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901170304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.804493:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.804523:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344dd43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290426.804538:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901170304 00000100:00100000:2.0:1784290426.804544:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901170304 00000100:00100000:2.0:1784290426.804578:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784290426.804585:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901170304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290426.804666:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901170304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290426.804676:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784290426.804692:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901170304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.804721:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901170432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.804761:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.804781:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344dd43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290426.804839:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901170432 00000100:00100000:1.0:1784290426.804846:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901170432 00000100:00100000:1.0:1784290426.804882:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784290426.804888:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901170432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290426.805006:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901170432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290426.805033:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784290426.805098:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901170432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290426.805491:0:94983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94983:1870961901170560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290426.805539:0:94983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290426.805574:0:94983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342f59a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784290426.805591:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901170560 00000100:00100000:0.0:1784290426.805600:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901170560 00000100:00100000:0.0:1784290426.805641:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784290426.805650:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:94983:x1870961901170560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290426.805791:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:94983:x1870961901170560:12345-0@lo:502:llog_process_th.0 Request processed in 140us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290426.805802:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784290426.805812:0:94983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94983:1870961901170560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290426.805856:0:94983:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94983:1870961901170688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290426.805887:0:94983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290426.805914:0:94983:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342f59a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784290426.805958:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901170688 00000100:00100000:2.0:1784290426.805982:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901170688 00000100:00100000:2.0:1784290426.806038:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784290426.806049:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:94983:x1870961901170688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290426.806145:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:94983:x1870961901170688:12345-0@lo:502:llog_process_th.0 Request processed in 96us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290426.806157:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784290426.806169:0:94983:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94983:1870961901170688:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784290426.806204:0:94983:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1784290426.806383:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1784290426.806428:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290426.806437:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3075772 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075779 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.806461:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3075772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075779 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290426.806473:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1784290426.806475:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1784290426.806478:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784290426.806510:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3075780 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.806528:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3075780 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.806538:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3075780 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290426.806555:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901170816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.806593:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290426.806643:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901170816 00000100:00100000:3.0:1784290426.806644:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2444f53900 going to sleep for 11 seconds 00000100:00100000:2.0:1784290426.806651:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901170816 00000100:00100000:2.0:1784290426.806704:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784290426.806711:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901170816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290426.806720:0:94062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290426.806730:0:94062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236ca00/0x5953bbf6b3075787 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3075780 expref: -99 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290426.806762:0:94062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236ca00/0x5953bbf6b3075787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3075780 expref: 21 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290426.806772:0:94062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236ca00/0x5953bbf6b3075787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075780 expref: 21 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290426.806780:0:94062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236ca00, rc 0) 00000100:00100000:2.0:1784290426.806824:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901170816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290426.806831:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1784290426.806897:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901170816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290426.806917:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3075780 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075787 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.806929:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3075780 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075787 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290426.806989:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901170944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.807050:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.807090:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2444f53900 going to sleep for 11 seconds 00000100:00100000:1.0:1784290426.807110:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901170944 00000100:00100000:1.0:1784290426.807116:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901170944 00000100:00100000:1.0:1784290426.807155:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1784290426.807166:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901170944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290426.807254:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901170944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290426.807261:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1784290426.807292:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901170944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.807334:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901171072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.807427:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290426.807462:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901171072 00000100:00100000:3.0:1784290426.807464:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2444f53900 going to sleep for 11 seconds 00000100:00100000:0.0:1784290426.807473:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901171072 00000100:00100000:0.0:1784290426.807533:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784290426.807546:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dde1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901171072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290426.807681:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dde1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901171072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290426.807694:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1784290426.807698:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901171072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784290426.809038:0:94984:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1784290426.809142:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1784290426.809170:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1784290426.809177:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3075780 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075787 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.809188:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3075780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075787 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290426.809197:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784290426.809199:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c247d3d2000 from 58 10000000:01000000:3.0:1784290426.809202:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784290426.809220:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b307578e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.809229:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b307578e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.809237:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b307578e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290426.809251:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901171200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.809284:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.809327:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344dd43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290426.809394:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901171200 00000100:00100000:2.0:1784290426.809402:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901171200 00000100:00100000:2.0:1784290426.809443:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784290426.809452:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dde2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901171200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290426.809462:0:94060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290426.809473:0:94060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236ce00/0x5953bbf6b3075795 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307578e expref: -99 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290426.809491:0:94060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236ce00/0x5953bbf6b3075795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307578e expref: 22 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290426.809501:0:94060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236ce00/0x5953bbf6b3075795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307578e expref: 22 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290426.809508:0:94060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236ce00, rc 0) 00000100:00100000:2.0:1784290426.809553:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dde2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901171200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290426.809576:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784290426.809600:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901171200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290426.809616:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b307578e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075795 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.809625:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b307578e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075795 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290426.809666:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901171328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.809694:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.809721:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344dd43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290426.809749:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901171328 00000100:00100000:2.0:1784290426.809755:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901171328 00000100:00100000:2.0:1784290426.809787:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1784290426.809793:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dde0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901171328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290426.809890:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dde0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901171328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290426.809902:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1784290426.809928:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901171328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.809973:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901171456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.810054:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.810085:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344dd43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290426.810115:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901171456 00000100:00100000:1.0:1784290426.810123:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901171456 00000100:00100000:1.0:1784290426.810166:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784290426.810176:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dde1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901171456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290426.810319:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dde1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901171456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290426.810333:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901171456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290426.810372:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784290426.810668:0:94985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94985:1870961901171584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290426.810701:0:94985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290426.810726:0:94985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b279c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784290426.810757:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901171584 00000100:00100000:0.0:1784290426.810764:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901171584 00000100:00100000:0.0:1784290426.810804:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1784290426.810826:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dde3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:94985:x1870961901171584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290426.810930:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dde3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:94985:x1870961901171584:12345-0@lo:502:llog_process_th.0 Request processed in 107us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290426.810939:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784290426.810959:0:94985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94985:1870961901171584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290426.811004:0:94985:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94985:1870961901171712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290426.811051:0:94985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290426.811067:0:94985:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b279c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784290426.811102:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901171712 00000100:00100000:2.0:1784290426.811109:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901171712 00000100:00100000:2.0:1784290426.811145:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1784290426.811153:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:94985:x1870961901171712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290426.811281:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:94985:x1870961901171712:12345-0@lo:502:llog_process_th.0 Request processed in 109us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290426.811282:0:94985:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:94985:1870961901171712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290426.811326:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000040:00080000:1.0:1784290426.811351:0:94985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1784290426.811527:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1784290426.811568:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784290426.811576:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b307578e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075795 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.811588:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b307578e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075795 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290426.811598:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1784290426.811600:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1784290426.811603:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784290426.811637:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa800/0x5953bbf6b307579c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.811646:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450aa800/0x5953bbf6b307579c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.811656:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450aa800/0x5953bbf6b307579c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290426.811672:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901171840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.811721:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.811759:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2444f53900 going to sleep for 11 seconds 00000100:00100000:2.0:1784290426.811788:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901171840 00000100:00100000:2.0:1784290426.811795:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901171840 00000100:00100000:2.0:1784290426.811832:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1784290426.811839:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901171840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290426.811849:0:94062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290426.811859:0:94062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236dc00/0x5953bbf6b30757a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307579c expref: -99 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290426.811883:0:94062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236dc00/0x5953bbf6b30757a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307579c expref: 23 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290426.811898:0:94062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236dc00/0x5953bbf6b30757a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307579c expref: 23 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290426.811922:0:94062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236dc00, rc 0) 00000100:00100000:2.0:1784290426.812032:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901171840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290426.812041:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1784290426.812085:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901171840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290426.812101:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450aa800/0x5953bbf6b307579c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30757a3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.812110:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450aa800/0x5953bbf6b307579c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30757a3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290426.812152:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901171968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.812179:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.812201:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2444f53900 going to sleep for 11 seconds 00000100:00100000:1.0:1784290426.812220:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901171968 00000100:00100000:1.0:1784290426.812226:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901171968 00000100:00100000:1.0:1784290426.812286:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1784290426.812294:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901171968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290426.812540:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901171968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290426.812548:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1784290426.812661:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901171968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.812714:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901172096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.812768:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.812804:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2444f53900 going to sleep for 11 seconds 00000100:00100000:0.0:1784290426.812821:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901172096 00000100:00100000:0.0:1784290426.812830:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901172096 00000100:00100000:0.0:1784290426.812872:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1784290426.812881:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901172096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290426.813005:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901172096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290426.813030:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1784290426.813090:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901172096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784290426.814315:0:94986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1784290426.814452:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1784290426.814477:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784290426.814486:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aa800/0x5953bbf6b307579c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30757a3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.814498:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450aa800/0x5953bbf6b307579c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30757a3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784290426.814509:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784290426.814512:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9c2480260000 from 1 10000000:01000000:3.0:1784290426.814515:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784290426.814533:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aaa00/0x5953bbf6b30757aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.814543:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450aaa00/0x5953bbf6b30757aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.814554:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450aaa00/0x5953bbf6b30757aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290426.814570:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901172224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.814605:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.814643:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344dd40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290426.814659:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901172224 00000100:00100000:2.0:1784290426.814668:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901172224 00000100:00100000:2.0:1784290426.814714:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1784290426.814722:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901172224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290426.814732:0:94060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290426.814742:0:94060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236d400/0x5953bbf6b30757b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30757aa expref: -99 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290426.814762:0:94060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236d400/0x5953bbf6b30757b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30757aa expref: 24 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290426.814772:0:94060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236d400/0x5953bbf6b30757b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30757aa expref: 24 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290426.814780:0:94060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236d400, rc 0) 00000100:00100000:2.0:1784290426.814826:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901172224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290426.814833:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784290426.814882:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901172224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290426.814900:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450aaa00/0x5953bbf6b30757aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30757b1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.814913:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450aaa00/0x5953bbf6b30757aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30757b1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290426.814988:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901172352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290426.815047:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290426.815073:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344dd40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290426.815105:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901172352 00000100:00100000:2.0:1784290426.815111:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901172352 00000100:00100000:2.0:1784290426.815144:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1784290426.815151:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901172352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290426.815221:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901172352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 68us (172us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784290426.815246:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1784290426.815249:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901172352:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1784290426.815294:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784290426.815301:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aaa00/0x5953bbf6b30757aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30757b1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290426.815310:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450aaa00/0x5953bbf6b30757aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30757b1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290427.047568:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901172480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290427.047655:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290427.047765:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901172480 00000100:00100000:1.0:1784290427.047774:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901172480 00000100:00100000:1.0:1784290427.047842:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:1.0:1784290427.047854:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901172480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1784290427.047886:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1784290427.047898:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784290427.047953:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901172480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290427.047964:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00100000:0.0:1784290427.047996:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901172480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290427.048543:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901172608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290427.048584:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290427.048661:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901172608 00000100:00100000:1.0:1784290427.048665:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901172608 00000100:00100000:1.0:1784290427.048747:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00080000:0.0:1784290427.048751:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784290427.048765:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901172608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1784290427.048785:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784290427.048840:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901172608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290427.048849:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:0.0:1784290427.048899:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901172608:0@lo:13:osp-pre-1-1.0 00000020:00000080:3.0:1784290427.554070:0:95084:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd55eff180 20000000:00000080:3.0:1784290427.554083:0:95084:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9c245fe60400 uarg=0000000000000000 00000040:00100000:3.0:1784290427.554585:0:95084:0:(llog.c:1072:llog_reverse_process()) index 60 : idx 49 20000000:01000000:3.0:1784290427.554590:0:95084:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 59 cmd:0xce022 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:3.0:1784290427.554600:0:95084:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.pool_134 fl=4 20000000:01000000:0.0:1784290427.554901:0:95085:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 52 marker 40 1->4: lustre-clilov new lustre.pool_134 20000000:01000000:0.0:1784290427.554939:0:95085:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 54 marker 40 2->4: lustre-clilov new lustre.pool_134 00000040:00080000:0.0:1784290427.554950:0:95085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000040:00080000:3.0:1784290427.555058:0:95084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].61, 224 off18904 20000000:01000000:3.0:1784290427.555069:0:95084:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:3.0:1784290427.555079:0:95084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].62, 112 off19016 00000040:00080000:3.0:1784290427.555089:0:95084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].63, 224 off19240 20000000:01000000:3.0:1784290427.555097:0:95084:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:0.0:1784290427.555294:0:95086:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 46 marker 41 1->4: lustre-MDT0000-mdtlov new lustre.pool_134 20000000:01000000:0.0:1784290427.555319:0:95086:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 49 marker 41 2->4: lustre-MDT0000-mdtlov new lustre.pool_134 00000040:00080000:0.0:1784290427.555328:0:95086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000040:00080000:3.0:1784290427.555440:0:95084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].56, 224 off18016 20000000:01000000:3.0:1784290427.555448:0:95084:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:3.0:1784290427.555456:0:95084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].57, 120 off18136 00000040:00080000:3.0:1784290427.555465:0:95084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].58, 224 off18360 20000000:01000000:3.0:1784290427.555472:0:95084:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:0.0:1784290427.555704:0:95087:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 46 marker 42 1->4: lustre-MDT0001-mdtlov new lustre.pool_134 20000000:01000000:0.0:1784290427.555724:0:95087:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 49 marker 42 2->4: lustre-MDT0001-mdtlov new lustre.pool_134 00000040:00080000:0.0:1784290427.555734:0:95087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000040:00080000:3.0:1784290427.555796:0:95084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].56, 224 off18016 20000000:01000000:3.0:1784290427.555812:0:95084:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:3.0:1784290427.555821:0:95084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].57, 120 off18136 00000040:00080000:3.0:1784290427.555830:0:95084:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].58, 224 off18360 10000000:01000000:3.0:1784290427.555838:0:95084:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784290427.555855:0:95084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c23450aa000/0x5953bbf6b30757b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.555871:0:95084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c246dd27200/0x5953bbf6b307572c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25f9 expref: 9 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.555877:0:95084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c234236d000/0x5953bbf6b3075733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2600 expref: 9 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.555883:0:95084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c24414b8200/0x5953bbf6b3075741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307573a expref: 23 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.555887:0:95084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c234236d600/0x5953bbf6b307574f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075748 expref: 23 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.555892:0:95084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c24414b8c00/0x5953bbf6b307575d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075756 expref: 23 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.555896:0:95084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c246dd26a00/0x5953bbf6b307576b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075764 expref: 23 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.555900:0:95084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c234236c400/0x5953bbf6b3075779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075772 expref: 23 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.555904:0:95084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c234236ca00/0x5953bbf6b3075787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075780 expref: 23 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.555909:0:95084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c234236ce00/0x5953bbf6b3075795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307578e expref: 23 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.555918:0:95084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c234236dc00/0x5953bbf6b30757a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307579c expref: 23 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.555923:0:95084:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c234236d400/0x5953bbf6b30757b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30757aa expref: 23 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.555928:0:95084:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c23450aa000/0x5953bbf6b30757b8 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.555959:0:95084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c234236d400/0x5953bbf6b30757b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b30757aa expref: 23 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.555969:0:95084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c234236d400/0x5953bbf6b30757b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b30757aa expref: 23 pid: 94060 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290427.555980:0:95084:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901172736:0@lo:104: 00000100:00100000:3.0:1784290427.556050:0:95084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290427.556092:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901172736 00010000:00010000:3.0:1784290427.556099:0:95084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c234236dc00/0x5953bbf6b30757a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b307579c expref: 23 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290427.556105:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901172736 00010000:00010000:3.0:1784290427.556107:0:95084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c234236dc00/0x5953bbf6b30757a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b307579c expref: 23 pid: 94062 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290427.556116:0:95084:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f98a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901172864:0@lo:104: 00000100:00100000:3.0:1784290427.556138:0:95084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290427.556161:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901172864 00000100:00100000:1.0:1784290427.556165:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901172864 00010000:00010000:3.0:1784290427.556171:0:95084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c234236ce00/0x5953bbf6b3075795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b307578e expref: 23 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290427.556174:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00010000:00010000:3.0:1784290427.556183:0:95084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c234236ce00/0x5953bbf6b3075795 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b307578e expref: 23 pid: 94060 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290427.556201:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2444058700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:95084:x1870961901172736:12345-0@lo:104: 00000100:00100000:3.0:1784290427.556207:0:95084:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f98b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901172992:0@lo:104: 00000100:00100000:1.0:1784290427.556211:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00010000:00010000:0.0:1784290427.556219:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c23450aaa00/0x5953bbf6b30757aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b30757b1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290427.556222:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f988e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:95084:x1870961901172864:12345-0@lo:104: 00010000:00010000:1.0:1784290427.556240:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c23450aa800/0x5953bbf6b307579c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b30757a3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290427.556243:0:95084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784290427.556296:0:95084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c234236ca00/0x5953bbf6b3075787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3075780 expref: 23 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290427.556296:0:6472:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1784290427.556305:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1784290427.556312:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1784290427.556322:0:95084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c234236ca00/0x5953bbf6b3075787 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3075780 expref: 23 pid: 94062 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290427.556326:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f988e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:95084:x1870961901172864:12345-0@lo:104: Request processed in 101us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290427.556327:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2444058700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:95084:x1870961901172736:12345-0@lo:104: Request processed in 127us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290427.556331:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901172992 00000100:00100000:1.0:1784290427.556379:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1784290427.556390:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00010000:00010000:1.0:1784290427.556422:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1784290427.556424:0:95084:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475808700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901173120:0@lo:104: 00010000:00010000:1.0:1784290427.556430:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c23450aaa00/0x5953bbf6b30757aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b30757b1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.556430:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290427.556440:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c23450aa800/0x5953bbf6b307579c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b30757a3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290427.556442:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aaa00 already unused, calling callback (ffffffffc14a9c20) 00010000:00010000:0.0:1784290427.556452:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa800 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:1.0:1784290427.556453:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aaa00/0x5953bbf6b30757aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b30757b1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290427.556457:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aa800/0x5953bbf6b307579c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b30757a3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290427.556462:0:95084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784290427.556474:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450aaa00/0x5953bbf6b30757aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b30757b1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.556475:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450aa800/0x5953bbf6b307579c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b30757a3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290427.556500:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aaa00/0x5953bbf6b30757aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b30757b1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290427.556501:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aa800/0x5953bbf6b307579c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b30757a3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.556516:0:95084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c234236c400/0x5953bbf6b3075779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3075772 expref: 23 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290427.556523:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784290427.556524:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784290427.556529:0:95084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c234236c400/0x5953bbf6b3075779 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3075772 expref: 23 pid: 94060 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290427.556530:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901172992 00000100:00100000:3.0:1784290427.556546:0:95084:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247581ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901173248:0@lo:104: 00010000:00010000:0.0:1784290427.556563:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c23450aa800/0x5953bbf6b307579c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30757a3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290427.556564:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c23450aaa00/0x5953bbf6b30757aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30757b1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290427.556580:0:95084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784290427.556582:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784290427.556584:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784290427.556610:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901173120 00010000:00010000:0.0:1784290427.556611:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c23450aa800/0x5953bbf6b307579c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30757a3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290427.556621:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901173120 00010000:00010000:1.0:1784290427.556622:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c23450aaa00/0x5953bbf6b30757aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30757b1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.556626:0:95084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c246dd26a00/0x5953bbf6b307576b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3075764 expref: 23 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290427.556645:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901173248 00010000:00010000:1.0:1784290427.556646:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450aaa00/0x5953bbf6b30757aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30757b1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290427.556655:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901173248 00010000:00010000:3.0:1784290427.556658:0:95084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c246dd26a00/0x5953bbf6b307576b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3075764 expref: 23 pid: 94059 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.556659:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450aa800/0x5953bbf6b307579c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b30757a3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290427.556669:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290427.556675:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290427.556683:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290427.556688:0:95084:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247581aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901173632:0@lo:104: 00010000:00010000:0.0:1784290427.556695:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290427.556697:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1784290427.556699:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901173504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290427.556700:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290427.556709:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290427.556722:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468b03050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:95084:x1870961901172992:12345-0@lo:104: 00000100:00100000:3.0:1784290427.556734:0:95084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290427.556739:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290427.556740:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901173376:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290427.556746:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b307578e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3075795 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.556764:0:95084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c24414b8c00/0x5953bbf6b307575d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3075756 expref: 23 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290427.556780:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901173504 00000100:00100000:1.0:1784290427.556785:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901173504 00010000:00010000:3.0:1784290427.556788:0:95084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c24414b8c00/0x5953bbf6b307575d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3075756 expref: 23 pid: 94058 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290427.556794:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290427.556807:0:95084:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247581b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901173760:0@lo:104: 00010000:00010000:1.0:1784290427.556809:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c234236d400/0x5953bbf6b30757b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b30757aa expref: 24 pid: 94060 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290427.556842:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901173376 00000100:00100000:1.0:1784290427.556846:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901173376 00010000:00010000:1.0:1784290427.556864:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c234236dc00/0x5953bbf6b30757a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b307579c expref: 25 pid: 94062 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290427.556870:0:95084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290427.556870:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2626 00010000:00010000:2.0:1784290427.556879:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784290427.556887:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+25:3617:x1870961901173504:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290427.556897:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468b03050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:95084:x1870961901172992:12345-0@lo:104: Request processed in 176us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290427.556899:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627 00010000:00010000:0.0:1784290427.556902:0:19592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290427.556907:0:95084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c234236d600/0x5953bbf6b307574f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3075748 expref: 25 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.556919:0:19592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c234236d400/0x5953bbf6b30757b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b30757aa expref: 25 pid: 94060 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290427.556920:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245818c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+25:3620:x1870961901173376:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290427.556930:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00010000:00010000:3.0:1784290427.556936:0:95084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c234236d600/0x5953bbf6b307574f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3075748 expref: 25 pid: 94062 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290427.556942:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290427.556951:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c234236dc00/0x5953bbf6b30757a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b307579c expref: 25 pid: 94062 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290427.556961:0:95084:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247581b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901173888:0@lo:104: 00010000:00010000:0.0:1784290427.556966:0:19592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c234236d400/0x5953bbf6b30757b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b30757aa expref: 25 pid: 94060 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290427.556988:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c234236dc00/0x5953bbf6b30757a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b307579c expref: 25 pid: 94062 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290427.556993:0:95084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784290427.557028:0:19592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290427.557030:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784290427.557034:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901173632 00010000:00010000:3.0:1784290427.557041:0:95084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c24414b8200/0x5953bbf6b3075741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b307573a expref: 25 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290427.557043:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901173632 00010000:00010000:3.0:1784290427.557057:0:95084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c24414b8200/0x5953bbf6b3075741 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b307573a expref: 25 pid: 94060 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290427.557071:0:95084:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247581b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901174016:0@lo:104: 00000100:00100000:2.0:1784290427.557084:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1784290427.557084:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+25:3617:x1870961901173504:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290427.557095:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245818c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+25:3620:x1870961901173376:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290427.557103:0:95084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290427.557120:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475818a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:95084:x1870961901173120:12345-0@lo:104: 00000100:00100000:0.0:1784290427.557120:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2626 00010000:00010000:3.0:1784290427.557132:0:95084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c234236d000/0x5953bbf6b3075733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2600 expref: 9 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290427.557137:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627 00010000:00010000:2.0:1784290427.557144:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3075780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3075787 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.557152:0:95084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c234236d000/0x5953bbf6b3075733 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2600 expref: 9 pid: 94058 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290427.557179:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474e8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901173504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784290427.557189:0:95084:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247581a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901174144:192.168.202.6@tcp:104: 00000100:00100000:1.0:1784290427.557226:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901173760 00000100:00100000:0.0:1784290427.557232:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901173376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290427.557233:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901173760 00000100:00100000:1.0:1784290427.557259:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901173888 00000100:00100000:1.0:1784290427.557263:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901173888 00010000:00010000:2.0:1784290427.557272:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784290427.557281:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901174016 00000100:00100000:2.0:1784290427.557284:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475818a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:95084:x1870961901173120:12345-0@lo:104: Request processed in 178us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290427.557287:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901174016 00010000:00010000:0.0:1784290427.557296:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784290427.557304:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b307578e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3075795 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290427.557305:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00010000:00010000:0.0:1784290427.557327:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab600 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:0.0:1784290427.557330:0:8418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b307578e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3075795 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.557363:0:8418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b307578e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3075795 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290427.557369:0:8418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b307578e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3075795 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290427.557373:0:8418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1784290427.557380:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1784290427.557395:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475818700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:95084:x1870961901173248:12345-0@lo:104: 00000100:00100000:2.0:1784290427.557401:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00010000:00010000:0.0:1784290427.557407:0:8418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b307578e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075795 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290427.557414:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3075772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3075779 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.557414:0:8418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1784290427.557427:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475819f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:95084:x1870961901173632:12345-0@lo:104: 00010000:00010000:0.0:1784290427.557429:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b307578e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075795 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.557443:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450ab600/0x5953bbf6b307578e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075795 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.557447:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3075764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b307576b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.557456:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784290427.557460:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3075780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3075787 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.557465:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa600 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:0.0:1784290427.557469:0:8418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3075780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3075787 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290427.557472:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784290427.557483:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475818700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+7:95084:x1870961901173248:12345-0@lo:104: Request processed in 89us (902us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290427.557489:0:8418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3075780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3075787 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.557495:0:95084:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c246dd27200/0x5953bbf6b307572c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25f9 expref: 9 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290427.557497:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 10000000:00010000:0.0:1784290427.557508:0:8418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3075780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3075787 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.557515:0:95084:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c246dd27200/0x5953bbf6b307572c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25f9 expref: 9 pid: 94062 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290427.557516:0:8418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784290427.557523:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784290427.557528:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00010000:00010000:0.0:1784290427.557536:0:8418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3075780 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075787 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290427.557538:0:95084:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475819c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901174400:192.168.202.6@tcp:104: 00000100:00100000:2.0:1784290427.557548:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475819f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:95084:x1870961901173632:12345-0@lo:104: Request processed in 124us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290427.557549:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475818000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+6:95084:x1870961901173760:12345-0@lo:104: 00010000:00010000:0.0:1784290427.557568:0:8418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784290427.557575:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b3075756 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b307575d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290427.557587:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00010000:00010000:0.0:1784290427.557589:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3075780 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075787 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.557605:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450aa600/0x5953bbf6b3075780 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075787 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.557623:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:2.0:1784290427.557627:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00010000:00010000:0.0:1784290427.557631:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3075772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3075779 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290427.557636:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784290427.557646:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475819180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:95084:x1870961901173888:12345-0@lo:104: 00010000:00010000:0.0:1784290427.557649:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab000 already unused, calling callback (ffffffffc14a9c20) 00000100:00100000:3.0:1784290427.557653:0:95084:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e0fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784290427.557655:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475818000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+5:95084:x1870961901173760:12345-0@lo:104: Request processed in 110us (786us total) trans 0 rc 0/0 10000000:00010000:0.0:1784290427.557659:0:8418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3075772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3075779 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.557670:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3075748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b307574f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.557675:0:8418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3075772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3075779 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290427.557677:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1784290427.557711:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 10000000:00010000:0.0:1784290427.557725:0:8418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3075772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3075779 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290427.557727:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:95084:x1870961901174016:12345-0@lo:104: 10000000:01000000:0.0:1784290427.557747:0:8418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290427.557752:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c23450abc00/0x5953bbf6b307573a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3075741 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.557774:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1784290427.557777:0:8418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3075772 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075779 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290427.557788:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475819180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:95084:x1870961901173888:12345-0@lo:104: Request processed in 146us (792us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290427.557791:0:8418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784290427.557804:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:0.0:1784290427.557810:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3075772 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075779 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290427.557815:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00010000:00010000:3.0:1784290427.557817:0:95084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236d400/0x5953bbf6b30757b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b30757aa expref: 23 pid: 94060 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290427.557818:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:95084:x1870961901174016:12345-0@lo:104: Request processed in 91us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290427.557840:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00010000:00010000:0.0:1784290427.557841:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3075772 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075779 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290427.557850:0:95084:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901172736:0@lo:104: 00010000:00010000:0.0:1784290427.557859:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784290427.557863:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784290427.557864:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3075764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b307576b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.557873:0:95084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236dc00/0x5953bbf6b30757a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b307579c expref: 22 pid: 94062 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.557880:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aae00 already unused, calling callback (ffffffffc14a9c20) 00010000:00010000:2.0:1784290427.557881:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b3075756 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b307575d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290427.557884:0:8418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3075764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b307576b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290427.557896:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901174272:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290427.557927:0:8418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3075764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b307576b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.557929:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa400 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:2.0:1784290427.557942:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b3075756 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b307575d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290427.557944:0:8418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3075764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b307576b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290427.557945:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290427.557961:0:95084:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f98a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901172864:0@lo:104: 00000100:00100000:1.0:1784290427.557982:0:19593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901174272 00000100:00100000:1.0:1784290427.557993:0:19593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901174272 10000000:01000000:0.0:1784290427.557993:0:8418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1784290427.557994:0:95084:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f98b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901172992:0@lo:104: 00010000:00010000:2.0:1784290427.557997:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b3075756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b307575d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.558028:0:8418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3075764 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307576b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290427.558030:0:19593:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c234236ce00/0x5953bbf6b3075795 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b307578e expref: 22 pid: 94060 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.558060:0:8418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1784290427.558080:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b3075756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b307575d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290427.558091:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784290427.558094:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3075764 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307576b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290427.558100:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2628 00000100:00100000:3.0:1784290427.558101:0:95084:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2475808700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901173120:0@lo:104: 00000100:00100000:1.0:1784290427.558113:0:19593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:3618:x1870961901174272:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784290427.558115:0:95084:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247581ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901173248:0@lo:104: 00010000:00010000:0.0:1784290427.558116:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3075764 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307576b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290427.558125:0:19593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290427.558127:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b3075756 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307575d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290427.558133:0:95084:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247581aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901173632:0@lo:104: 00010000:00010000:1.0:1784290427.558133:0:19593:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c234236ce00/0x5953bbf6b3075795 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b307578e expref: 22 pid: 94060 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.558135:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784290427.558149:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3075748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b307574f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.558153:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1784290427.558160:0:95084:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247581b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901173760:0@lo:104: 00010000:00010000:0.0:1784290427.558176:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aba00 already unused, calling callback (ffffffffc14a9c20) 00010000:00010000:1.0:1784290427.558179:0:19593:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c234236ce00/0x5953bbf6b3075795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b307578e expref: 22 pid: 94060 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.558180:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b3075756 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307575d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290427.558181:0:8418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3075748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b307574f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290427.558187:0:95084:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247581b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901173888:0@lo:104: 00000100:00100000:3.0:1784290427.558214:0:95084:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247581b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901174016:0@lo:104: 00010000:00010000:2.0:1784290427.558236:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450aa400/0x5953bbf6b3075756 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307575d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.558237:0:8418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3075748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b307574f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290427.558244:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236ce00/0x5953bbf6b3075795 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b307578e expref: 22 pid: 94060 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784290427.558297:0:8418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3075748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b307574f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784290427.558304:0:8418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784290427.558307:0:19593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290427.558314:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784290427.558321:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c23450abc00/0x5953bbf6b307573a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3075741 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.558329:0:8418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3075748 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307574f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.558330:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450abc00 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:2.0:1784290427.558364:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c23450abc00/0x5953bbf6b307573a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3075741 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.558371:0:8418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784290427.558380:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3075748 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307574f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.558386:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c23450abc00/0x5953bbf6b307573a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3075741 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.558387:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450aba00/0x5953bbf6b3075748 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307574f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290427.558434:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c23450abc00/0x5953bbf6b307573a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3075741 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.558437:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784290427.558442:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784290427.558447:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290427.558449:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290427.558468:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901174528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290427.558483:0:19593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:3618:x1870961901174272:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (399us total) trans 0 rc 0/0 00010000:00010000:2.0:1784290427.558487:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c23450abc00/0x5953bbf6b307573a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075741 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290427.558509:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784290427.558510:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784290427.558519:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2628 00010000:00010000:2.0:1784290427.558529:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c23450abc00/0x5953bbf6b307573a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075741 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.558540:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c23450abc00/0x5953bbf6b307573a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075741 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290427.558544:0:19593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901174528 00000100:00100000:1.0:1784290427.558551:0:19593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901174528 00000100:00100000:0.0:1784290427.558570:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901175040:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290427.558572:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290427.558575:0:19593:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c234236ca00/0x5953bbf6b3075787 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075780 expref: 21 pid: 94062 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.558578:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290427.558586:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290427.558603:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290427.558616:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290427.558624:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2629 00000100:00100000:1.0:1784290427.558633:0:19593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:3619:x1870961901174528:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784290427.558637:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901175040 00000100:00100000:3.0:1784290427.558641:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901175040 00010000:00010000:1.0:1784290427.558643:0:19593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290427.558649:0:19593:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c234236ca00/0x5953bbf6b3075787 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075780 expref: 22 pid: 94062 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290427.558650:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00010000:00010000:3.0:1784290427.558659:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c234236d600/0x5953bbf6b307574f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075748 expref: 22 pid: 94062 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290427.558660:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901174656:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290427.558665:0:19593:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c234236ca00/0x5953bbf6b3075787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3075780 expref: 22 pid: 94062 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290427.558685:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236ca00/0x5953bbf6b3075787 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3075780 expref: 22 pid: 94062 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290427.558690:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290427.558696:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2630 00010000:00010000:1.0:1784290427.558708:0:19593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784290427.558709:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:3619:x1870961901175040:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290427.558717:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901175168:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784290427.558719:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784290427.558771:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290427.558773:0:19593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:3619:x1870961901174528:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (269us total) trans 0 rc 0/0 00010000:00010000:3.0:1784290427.558774:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c234236d600/0x5953bbf6b307574f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075748 expref: 21 pid: 94062 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290427.558784:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2629 00010000:00010000:3.0:1784290427.558786:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c234236d600/0x5953bbf6b307574f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3075748 expref: 21 pid: 94062 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.558807:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236d600/0x5953bbf6b307574f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3075748 expref: 20 pid: 94062 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290427.558808:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901174656 00000100:00100000:1.0:1784290427.558810:0:19593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901175168 00000100:00100000:2.0:1784290427.558821:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901174656 00010000:00010000:3.0:1784290427.558822:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784290427.558822:0:19593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901175168 00000100:00100000:0.0:1784290427.558829:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901174528:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290427.558856:0:19593:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c24414b8200/0x5953bbf6b3075741 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b307573a expref: 21 pid: 94060 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.558870:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c234236c400/0x5953bbf6b3075779 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075772 expref: 21 pid: 94060 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290427.558870:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901174912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784290427.558874:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:3619:x1870961901175040:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290427.558890:0:19593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631 00000100:00100000:3.0:1784290427.558909:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2630 00000100:00100000:1.0:1784290427.558909:0:19593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:3619:x1870961901175168:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290427.558915:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784290427.558929:0:19593:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290427.558937:0:19593:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c24414b8200/0x5953bbf6b3075741 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b307573a expref: 20 pid: 94060 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290427.558945:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901174912 00010000:00010000:1.0:1784290427.558950:0:19593:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c24414b8200/0x5953bbf6b3075741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b307573a expref: 20 pid: 94060 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290427.558954:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901174912 00000100:00100000:3.0:1784290427.558955:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632 00000100:00100000:0.0:1784290427.558965:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901174272:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290427.558967:0:19593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c24414b8200/0x5953bbf6b3075741 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b307573a expref: 21 pid: 94060 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290427.558971:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:3619:x1870961901174656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290427.558983:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c24414b8c00/0x5953bbf6b307575d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075756 expref: 20 pid: 94058 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.558985:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290427.558985:0:19593:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784290427.558989:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1784290427.558996:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c234236c400/0x5953bbf6b3075779 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075772 expref: 20 pid: 94060 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290427.559018:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901174784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784290427.559037:0:19593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_008:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:3619:x1870961901175168:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (271us total) trans 0 rc 0/0 00010000:00010000:3.0:1784290427.559038:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c234236c400/0x5953bbf6b3075779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3075772 expref: 20 pid: 94060 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290427.559050:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2633 00010000:00010000:3.0:1784290427.559056:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236c400/0x5953bbf6b3075779 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3075772 expref: 20 pid: 94060 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290427.559058:0:19593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631 00000100:00100000:2.0:1784290427.559075:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:3618:x1870961901174912:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290427.559082:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784290427.559104:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290427.559105:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784290427.559114:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901174784 00010000:00010000:2.0:1784290427.559115:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c24414b8c00/0x5953bbf6b307575d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075756 expref: 18 pid: 94058 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290427.559122:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901174784 00010000:00010000:0.0:1784290427.559136:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290427.559138:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c24414b8c00/0x5953bbf6b307575d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3075756 expref: 19 pid: 94058 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290427.559144:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:3619:x1870961901174656:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (460us total) trans 0 rc 0/0 00010000:00010000:1.0:1784290427.559144:0:19591:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c246dd26a00/0x5953bbf6b307576b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075764 expref: 19 pid: 94059 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290427.559156:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901174656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784290427.559176:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632 00000100:00100000:0.0:1784290427.559183:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901175168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290427.559205:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901175040:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290427.559210:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c24414b8c00/0x5953bbf6b307575d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3075756 expref: 18 pid: 94058 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290427.559212:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2634 00000100:00100000:3.0:1784290427.559229:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:3618:x1870961901174784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290427.559238:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290427.559240:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290427.559252:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c246dd26a00/0x5953bbf6b307576b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075764 expref: 17 pid: 94059 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.559267:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c246dd26a00/0x5953bbf6b307576b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3075764 expref: 17 pid: 94059 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.559275:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290427.559285:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd26a00/0x5953bbf6b307576b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3075764 expref: 17 pid: 94059 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290427.559305:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784290427.559311:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:3618:x1870961901174912:12345-0@lo:103:ldlm_bl.0 Request processed in 247us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290427.559316:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290427.559333:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2633 00000100:00100000:1.0:1784290427.559336:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901174912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290427.559405:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896283520 00000100:00100000:3.0:1784290427.559414:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:3618:x1870961901174784:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290427.559414:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896283520 00000100:00100000:1.0:1784290427.559415:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901174784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290427.559426:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290427.559433:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2634 00010000:00010000:2.0:1784290427.559443:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c234236d000/0x5953bbf6b3075733 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2600 expref: 10 pid: 94058 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290427.559455:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896283648 00000100:00100000:3.0:1784290427.559462:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896283648 00010000:00010000:3.0:1784290427.559483:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c246dd27200/0x5953bbf6b307572c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25f9 expref: 11 pid: 94062 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290427.559487:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2635 00000100:00100000:1.0:1784290427.559500:0:95084:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247581a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901174144:192.168.202.6@tcp:104: 00000100:00100000:0.0:1784290427.559505:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2458025450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+11:2398:x1870961896283520:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784290427.559514:0:19591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290427.559522:0:19591:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c234236d000/0x5953bbf6b3075733 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2600 expref: 11 pid: 94058 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290427.559524:0:95084:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2475819c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95084:1870961901174400:192.168.202.6@tcp:104: 00000100:00100000:2.0:1784290427.559536:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2636 00010000:00010000:0.0:1784290427.559557:0:19591:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c234236d000/0x5953bbf6b3075733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2600 expref: 11 pid: 94058 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290427.559568:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+11:2399:x1870961896283648:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784290427.559587:0:19591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236d000/0x5953bbf6b3075733 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2600 expref: 11 pid: 94058 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.559588:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290427.559590:0:95084:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c23450aa000/0x5953bbf6b30757b8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.559608:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c246dd27200/0x5953bbf6b307572c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25f9 expref: 11 pid: 94062 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290427.559615:0:19591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290427.559641:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c246dd27200/0x5953bbf6b307572c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25f9 expref: 10 pid: 94062 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290427.559654:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2458025450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2398:x1870961896283520:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 154us (343us total) trans 0 rc 0/0 00010000:00010000:1.0:1784290427.559663:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290427.559666:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd27200/0x5953bbf6b307572c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25f9 expref: 10 pid: 94062 timeout: 2268 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290427.559667:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2635 00010000:00010000:2.0:1784290427.559697:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c23450aa000/0x5953bbf6b30757b8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.559707:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c23450aa000/0x5953bbf6b30757b8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.559732:0:7430:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c23450aa000/0x5953bbf6b30757b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.559740:0:7430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c23450aa000/0x5953bbf6b30757b8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.559747:0:7430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c23450aa000/0x5953bbf6b30757b8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.559754:0:7430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c23450aa000/0x5953bbf6b30757b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.559759:0:7430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa000 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:2.0:1784290427.559764:0:7430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c23450aa000/0x5953bbf6b30757b8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.559772:0:7430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c23450aa000/0x5953bbf6b30757b8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.559791:0:7430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c23450aa000/0x5953bbf6b30757b8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290427.559803:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290427.559821:0:95084:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c23450aa000/0x5953bbf6b30757b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290427.559841:0:95084:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c23450aa000/0x5953bbf6b30757b8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290427.559849:0:95084:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c23450aa000/0x5953bbf6b30757b8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95084 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290427.559858:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:2399:x1870961896283648:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 297us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290427.559870:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2636 00000100:00100000:3.0:1784290428.071675:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901175680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784290428.071721:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901175296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784290428.071735:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901175808:0@lo:400:kworker.0 00000100:00100000:3.0:1784290428.071781:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.071827:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290428.071850:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290428.071868:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901175680 00000100:00100000:3.0:1784290428.071872:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1870961901176192:0@lo:400:kworker.0 00000100:00100000:0.0:1784290428.071881:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901175680 00000100:00100000:1.0:1784290428.071901:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901176320:0@lo:400:kworker.0 00000100:00100000:2.0:1784290428.071921:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475818e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901175424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1784290428.071932:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.071954:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901175808 00000100:00100000:1.0:1784290428.071960:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901175808 00000100:00100000:3.0:1784290428.071989:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901176704:0@lo:400:kworker.0 00000100:00100000:0.0:1784290428.071992:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:2.0:1784290428.072020:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290428.072032:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901175680:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784290428.072035:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1784290428.072078:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:3619:x1870961901175808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290428.072092:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901175552:0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784290428.072093:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1784290428.072096:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290428.072193:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901177216:0@lo:400:kworker.0 00000100:00100000:2.0:1784290428.072216:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.072234:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:3619:x1870961901175808:12345-0@lo:400:kworker.0 Request processed in 165us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290428.072245:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1784290428.072265:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901175680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 259us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290428.072279:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:3.0:1784290428.072293:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290428.072309:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901176064:0@lo:400:kworker.0 00000100:00100000:1.0:1784290428.072311:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901175552 00000100:00100000:1.0:1784290428.072319:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901175552 00000100:00080000:0.0:1784290428.072331:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784290428.072370:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784290428.072401:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:3.0:1784290428.072407:0:3618:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968632 gen 2 00000100:00100000:1.0:1784290428.072415:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1870961901175552:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290428.072426:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290428.072433:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1870961901175936:0@lo:400:kworker.0 00002000:00000024:1.0:1784290428.072434:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784290428.072457:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901175680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784290428.072501:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901176576:0@lo:400:kworker.0 00000100:00100000:1.0:1784290428.072516:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1870961901175552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290428.072521:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901176704 00000100:00100000:0.0:1784290428.072527:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290428.072531:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901176704 00000100:00100000:1.0:1784290428.072534:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:2.0:1784290428.072589:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.072591:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901176192 00000100:00100000:0.0:1784290428.072597:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901176448:0@lo:400:kworker.0 00000100:00100000:1.0:1784290428.072608:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901176192 00000100:00100000:3.0:1784290428.072610:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901177216 00000100:00100000:3.0:1784290428.072619:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901177216 00000100:00100000:2.0:1784290428.072664:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901177088:0@lo:400:kworker.0 00000100:00100000:0.0:1784290428.072678:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290428.072685:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901176576 00000100:00100000:3.0:1784290428.072691:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901176576 00000100:00100000:1.0:1784290428.072692:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901176064 00000100:00100000:1.0:1784290428.072700:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901176064 00000100:00100000:0.0:1784290428.072743:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901176960:0@lo:400:kworker.0 00000100:00100000:1.0:1784290428.072755:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901175936 00000100:00100000:2.0:1784290428.072758:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290428.072761:0:26262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1629 00000100:00100000:1.0:1784290428.072763:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901175936 00000100:00100000:3.0:1784290428.072784:0:26262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901176704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290428.072814:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:0.0:1784290428.072816:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.072829:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1870961901176192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290428.072840:0:3617:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968634 gen 2 00000100:00100000:3.0:1784290428.072879:0:26262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901176704:12345-0@lo:400:kworker.0 Request processed in 97us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290428.072888:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901175296 00000100:00100000:2.0:1784290428.072890:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901175552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784290428.072895:0:26262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1629 00000100:00100000:0.0:1784290428.072895:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901175296 00000100:00100000:1.0:1784290428.072906:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1870961901176192:12345-0@lo:400:kworker.0 Request processed in 73us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290428.072921:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:3.0:1784290428.072948:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901177088 00000100:00100000:3.0:1784290428.072955:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901177088 00000100:00100000:0.0:1784290428.072965:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901175424 00000100:00100000:1.0:1784290428.072966:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:2.0:1784290428.072985:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901176448 00000100:00100000:0.0:1784290428.072992:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901175424 00000100:00100000:2.0:1784290428.072996:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901176448 00000100:00100000:1.0:1784290428.073028:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901176064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290428.073075:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901176960 00000100:00100000:3.0:1784290428.073084:0:26262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1630 00000100:00100000:2.0:1784290428.073084:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901176960 00000100:00100000:0.0:1784290428.073094:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3906 00000100:00100000:3.0:1784290428.073117:0:26262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901177216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290428.073117:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3617:x1870961901175296:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784290428.073119:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1870961901176064:12345-0@lo:400:kworker.0 Request processed in 113us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.073135:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3907 00000100:00100000:1.0:1784290428.073162:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:2.0:1784290428.073163:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3620:x1870961901176448:12345-0@lo:400:kworker.0 00000004:00000024:0.0:1784290428.073171:0:23867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444560896 avail 1298321408 00000100:00100000:1.0:1784290428.073196:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 765 00000100:00100000:3.0:1784290428.073209:0:26262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901177216:12345-0@lo:400:kworker.0 Request processed in 102us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290428.073210:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1870961901175936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290428.073237:0:26262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1630 00000100:00100000:0.0:1784290428.073267:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3617:x1870961901175296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 160us (1421us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.073272:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3620:x1870961901176448:12345-0@lo:400:kworker.0 Request processed in 115us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290428.073283:0:26262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1631 00000100:00100000:1.0:1784290428.073297:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1870961901175936:12345-0@lo:400:kworker.0 Request processed in 75us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290428.073315:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3906 00000100:00100000:3.0:1784290428.073328:0:26262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901176576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290428.073348:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3907 00000100:00100000:1.0:1784290428.073348:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 765 00000100:00100000:0.0:1784290428.073401:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3908 00000100:00100000:0.0:1784290428.073421:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901175424:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784290428.073463:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3909 00000100:00100000:1.0:1784290428.073465:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290428.073478:0:26262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901176576:12345-0@lo:400:kworker.0 Request processed in 150us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.073480:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901176960:12345-0@lo:400:kworker.0 00000004:00000024:0.0:1784290428.073483:0:23867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445097472 avail 1298857984 00000100:00100000:1.0:1784290428.073506:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961901176832:0@lo:400:kworker.0 00000100:00100000:3.0:1784290428.073522:0:26262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1631 00000100:00100000:0.0:1784290428.073632:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3617:x1870961901175424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 203us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.073637:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3620:x1870961901176960:12345-0@lo:400:kworker.0 Request processed in 145us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290428.073637:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290428.073671:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3909 00000100:00100000:1.0:1784290428.073699:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1870961901177344:0@lo:400:kworker.0 00000100:00100000:0.0:1784290428.073701:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3908 00000100:00100000:1.0:1784290428.073758:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290428.073759:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901176320 00000100:00100000:2.0:1784290428.073770:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901176320 00000100:00080000:0.0:1784290428.073771:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784290428.073788:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784290428.073801:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1784290428.073855:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901175808:0@lo:400:kworker.0 00000100:00100000:2.0:1784290428.073862:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901176832 00000100:00100000:2.0:1784290428.073866:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901176832 00000100:00100000:0.0:1784290428.073897:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1870961901175936:0@lo:400:kworker.0 00000100:00100000:2.0:1784290428.073910:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901177344 00000100:00100000:2.0:1784290428.073916:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901177344 00000100:00100000:1.0:1784290428.073967:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:0.0:1784290428.073979:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901176448:0@lo:400:kworker.0 00000100:00100000:2.0:1784290428.073981:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:1.0:1784290428.073995:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901176320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290428.074017:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1870961901176832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290428.074060:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901176960:0@lo:400:kworker.0 00000100:00100000:3.0:1784290428.074080:0:26262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1632 00000100:00100000:2.0:1784290428.074116:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1870961901176832:12345-0@lo:400:kworker.0 Request processed in 113us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290428.074120:0:26262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3617:x1870961901177088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290428.074132:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:1.0:1784290428.074149:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901176320:12345-0@lo:400:kworker.0 Request processed in 164us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.074174:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:2.0:1784290428.074193:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1870961901177344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290428.074194:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:3.0:1784290428.074222:0:26262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3617:x1870961901177088:12345-0@lo:400:kworker.0 Request processed in 108us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290428.074230:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901176320:0@lo:400:kworker.0 00000100:00100000:3.0:1784290428.074240:0:26262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1632 00000100:00100000:0.0:1784290428.074271:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961901176832:0@lo:400:kworker.0 00000100:00100000:2.0:1784290428.074272:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1870961901177344:12345-0@lo:400:kworker.0 Request processed in 85us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.074299:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000100:00100000:0.0:1784290428.074332:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1870961901177344:0@lo:400:kworker.0 00000100:00100000:1.0:1784290428.074360:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1870961901176064:0@lo:400:kworker.0 00000100:00100000:1.0:1784290428.074417:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901176576:0@lo:400:kworker.0 00000100:00100000:2.0:1784290428.074431:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1870961901176192:0@lo:400:kworker.0 00000100:00100000:1.0:1784290428.074445:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901177088:0@lo:400:kworker.0 00000100:00100000:2.0:1784290428.074453:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901176704:0@lo:400:kworker.0 00000100:00100000:1.0:1784290428.074475:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901175296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290428.074477:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901177216:0@lo:400:kworker.0 00000100:00100000:1.0:1784290428.074511:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2475818e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901175424:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1784290428.583568:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290428.677661:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290428.677880:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896283776 00000100:00100000:2.0:1784290428.677922:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896283776 00000100:00100000:2.0:1784290428.678096:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 122 00000100:00100000:2.0:1784290428.678112:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+8:70750:x1870961896283776:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290428.678139:0:94059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290428.678168:0:94059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236d200/0x5953bbf6b30757bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2607 expref: -99 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290428.678236:0:94059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236d200/0x5953bbf6b30757bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2607 expref: 9 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290428.678249:0:94059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236d200/0x5953bbf6b30757bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2607 expref: 9 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290428.678262:0:94059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236d200, rc 0) 00000100:00100000:2.0:1784290428.678406:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896283776:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 298us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.678414:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 122 00000100:00100000:3.0:1784290428.679765:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290428.679893:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896283904 00000100:00100000:1.0:1784290428.679907:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896283904 00000100:00100000:1.0:1784290428.680042:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 123 00000100:00100000:1.0:1784290428.680057:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896283904:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.680241:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896283904:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 185us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290428.680255:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 123 00000100:00100000:3.0:1784290428.681610:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290428.681714:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896284032 00000100:00100000:2.0:1784290428.681726:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896284032 00000100:00100000:2.0:1784290428.681789:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 124 00000100:00100000:2.0:1784290428.681801:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896284032:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290428.681946:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896284032:12345-192.168.202.6@tcp:503:ll_cfg_requeue.0 Request processed in 146us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.681959:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 124 00000100:00100000:0.0:1784290428.683947:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290428.684037:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896284160 00000100:00100000:2.0:1784290428.684043:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896284160 00000100:00100000:2.0:1784290428.684085:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 125 00000100:00100000:2.0:1784290428.684093:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:73131:x1870961896284160:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784290428.684198:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:73131:x1870961896284160:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 105us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.684205:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 125 00000100:00100000:3.0:1784290428.685399:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290428.685475:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896284288 00000100:00100000:0.0:1784290428.685484:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896284288 00000100:00100000:0.0:1784290428.685527:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 126 00000100:00100000:0.0:1784290428.685535:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:73131:x1870961896284288:12345-192.168.202.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784290428.685631:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:73131:x1870961896284288:12345-192.168.202.6@tcp:502:llog_process_th.0 Request processed in 96us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290428.685640:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 126 00000100:00100000:3.0:1784290428.687061:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290428.687146:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896284416 00000100:00100000:1.0:1784290428.687157:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896284416 00000100:00100000:1.0:1784290428.687231:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 127 00000100:00100000:1.0:1784290428.687248:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896284416:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290428.687267:0:94058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290428.687294:0:94058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c24414b8200/0x5953bbf6b30757c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b260e expref: -99 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.687401:0:94058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c24414b8200/0x5953bbf6b30757c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b260e expref: 10 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.687427:0:94058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c24414b8200/0x5953bbf6b30757c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b260e expref: 10 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.687438:0:94058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24414b8200, rc 0) 00000100:00100000:1.0:1784290428.687488:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70750:x1870961896284416:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 246us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290428.687497:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 127 00000100:00100000:2.0:1784290428.688601:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290428.688675:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896284544 00000100:00100000:3.0:1784290428.688685:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896284544 00000100:00100000:3.0:1784290428.688730:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 128 00000100:00100000:3.0:1784290428.688740:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70750:x1870961896284544:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290428.688834:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70750:x1870961896284544:12345-192.168.202.6@tcp:501:ll_cfg_requeue.0 Request processed in 94us (234us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784290428.688845:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 128 10000000:01000000:1.0:1784290428.711426:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784290428.711444:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c247e403000 from 61 10000000:01000000:1.0:1784290428.711449:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784290428.711493:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b9e00/0x5953bbf6b30757cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.711505:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24414b9e00/0x5953bbf6b30757cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.711516:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24414b9e00/0x5953bbf6b30757cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290428.711544:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901177472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.711605:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.711662:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290428.711725:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901177472 00000100:00100000:2.0:1784290428.711740:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901177472 00000100:00100000:2.0:1784290428.711817:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1784290428.711837:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+15:6485:x1870961901177472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290428.711858:0:94060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290428.711882:0:94060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236d600/0x5953bbf6b30757d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30757cd expref: -99 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290428.711916:0:94060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236d600/0x5953bbf6b30757d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30757cd expref: 16 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290428.711932:0:94060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236d600/0x5953bbf6b30757d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30757cd expref: 16 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290428.711945:0:94060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236d600, rc 0) 00000100:00100000:2.0:1784290428.712048:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901177472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.712059:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1784290428.712122:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901177472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290428.712146:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24414b9e00/0x5953bbf6b30757cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30757d4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.712170:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24414b9e00/0x5953bbf6b30757cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30757d4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290428.712294:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901177600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.712336:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.712408:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290428.712458:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901177600 00000100:00100000:0.0:1784290428.712467:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901177600 00000100:00100000:0.0:1784290428.712533:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1784290428.712547:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901177600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290428.712755:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901177600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 211us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290428.712764:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1784290428.712829:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901177600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.712863:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901177728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.712913:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.712945:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290428.712987:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901177728 00000100:00100000:2.0:1784290428.713009:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901177728 00000100:00100000:2.0:1784290428.713054:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1784290428.713064:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901177728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290428.713194:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901177728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.713206:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1784290428.713214:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901177728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290428.713883:0:95088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95088:1870961901177856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290428.713938:0:95088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290428.713973:0:95088:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344a79780 going to sleep for 11 seconds 00000100:00100000:3.0:1784290428.714019:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901177856 00000100:00100000:3.0:1784290428.714031:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901177856 00000100:00100000:3.0:1784290428.714090:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784290428.714100:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:95088:x1870961901177856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290428.714283:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:95088:x1870961901177856:12345-0@lo:502:llog_process_th.0 Request processed in 183us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290428.714307:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1784290428.714394:0:95088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95088:1870961901177856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290428.714474:0:95088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95088:1870961901177984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290428.714523:0:95088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290428.714555:0:95088:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344a79780 going to sleep for 11 seconds 00000100:00100000:1.0:1784290428.714592:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901177984 00000100:00100000:1.0:1784290428.714601:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901177984 00000100:00100000:1.0:1784290428.714662:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1784290428.714683:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:95088:x1870961901177984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290428.714781:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:95088:x1870961901177984:12345-0@lo:502:llog_process_th.0 Request processed in 99us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290428.714790:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1784290428.714816:0:95088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95088:1870961901177984:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784290428.714843:0:95088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:1.0:1784290428.714944:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:1.0:1784290428.714986:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784290428.715009:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b9e00/0x5953bbf6b30757cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30757d4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.715020:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24414b9e00/0x5953bbf6b30757cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30757d4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290428.715049:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784290428.715052:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 56 10000000:01000000:1.0:1784290428.715054:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784290428.715073:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b8c00/0x5953bbf6b30757db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.715081:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24414b8c00/0x5953bbf6b30757db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.715089:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24414b8c00/0x5953bbf6b30757db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290428.715101:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901178112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.715127:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.715145:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784290428.715181:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901178112 00000100:00100000:0.0:1784290428.715202:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901178112 00000100:00100000:0.0:1784290428.715257:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1784290428.715272:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+16:6485:x1870961901178112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290428.715279:0:94059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290428.715290:0:94059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246dd26800/0x5953bbf6b30757e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30757db expref: -99 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290428.715307:0:94059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd26800/0x5953bbf6b30757e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30757db expref: 17 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290428.715320:0:94059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246dd26800/0x5953bbf6b30757e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30757db expref: 17 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290428.715329:0:94059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26800, rc 0) 00000100:00100000:0.0:1784290428.715410:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901178112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290428.715416:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1784290428.715445:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901178112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290428.715458:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24414b8c00/0x5953bbf6b30757db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30757e2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.715466:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24414b8c00/0x5953bbf6b30757db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30757e2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290428.715504:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901178240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.715529:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.715555:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784290428.715568:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901178240 00000100:00100000:2.0:1784290428.715573:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901178240 00000100:00100000:2.0:1784290428.715606:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1784290428.715614:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901178240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290428.715705:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901178240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.715718:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1784290428.715725:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901178240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.715763:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901178368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.715802:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.715820:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784290428.715866:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901178368 00000100:00100000:3.0:1784290428.715875:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901178368 00000100:00100000:3.0:1784290428.715916:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1784290428.715927:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901178368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290428.716064:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901178368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290428.716074:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784290428.716111:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901178368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290428.716542:0:95089:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475819500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95089:1870961901178496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290428.716596:0:95089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290428.716634:0:95089:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2474e0fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784290428.716657:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901178496 00000100:00100000:1.0:1784290428.716666:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901178496 00000100:00100000:1.0:1784290428.716709:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1784290428.716721:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c248207f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:95089:x1870961901178496:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290428.716830:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c248207f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:95089:x1870961901178496:12345-0@lo:502:llog_process_th.0 Request processed in 112us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290428.716838:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784290428.716888:0:95089:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2475819500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95089:1870961901178496:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784290428.716920:0:95089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784290428.716935:0:95089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290428.716939:0:95089:0:(obd_config.c:1561:class_process_config()) marker 48 (0x1) lustre-MDT0000-m del lustre.pool_134 00000020:00000080:3.0:1784290428.716947:0:95089:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1784290428.718122:0:95089:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475819500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95089:1870961901178624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290428.718183:0:95089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290428.718223:0:95089:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24527abc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784290428.718274:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901178624 00000100:00100000:0.0:1784290428.718281:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901178624 00000100:00100000:0.0:1784290428.718323:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784290428.718333:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c248207f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:95089:x1870961901178624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290428.718530:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c248207f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:95089:x1870961901178624:12345-0@lo:502:llog_process_th.0 Request processed in 196us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290428.718541:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784290428.718597:0:95089:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2475819500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95089:1870961901178624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784290428.718628:0:95089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290428.718635:0:95089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290428.718638:0:95089:0:(obd_config.c:1561:class_process_config()) marker 48 (0x2) lustre-MDT0000-m del lustre.pool_134 00000040:00080000:3.0:1784290428.718643:0:95089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000020:01000000:1.0:1784290428.718727:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 56-58 (rc=0) 10000000:01000000:1.0:1784290428.718752:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784290428.718758:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b8c00/0x5953bbf6b30757db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30757e2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.718777:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24414b8c00/0x5953bbf6b30757db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30757e2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290428.718785:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784290428.718787:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c23452c5000 from 61 10000000:01000000:1.0:1784290428.718790:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784290428.718806:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b9000/0x5953bbf6b30757e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.718813:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24414b9000/0x5953bbf6b30757e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.718820:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24414b9000/0x5953bbf6b30757e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290428.718851:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901178752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.718880:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.718905:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c900 going to sleep for 11 seconds 00000100:00100000:2.0:1784290428.718920:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901178752 00000100:00100000:2.0:1784290428.718928:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901178752 00000100:00100000:2.0:1784290428.718968:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784290428.718980:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+17:6485:x1870961901178752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290428.718992:0:94058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290428.719019:0:94058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236dc00/0x5953bbf6b30757f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30757e9 expref: -99 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290428.719037:0:94058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236dc00/0x5953bbf6b30757f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30757e9 expref: 18 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290428.719045:0:94058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236dc00/0x5953bbf6b30757f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30757e9 expref: 18 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290428.719064:0:94058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236dc00, rc 0) 00000100:00100000:2.0:1784290428.719102:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901178752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.719110:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784290428.719136:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901178752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290428.719149:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24414b9000/0x5953bbf6b30757e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30757f0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.719157:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24414b9000/0x5953bbf6b30757e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30757f0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290428.719195:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901178880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.719221:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.719238:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c900 going to sleep for 11 seconds 00000100:00100000:3.0:1784290428.719270:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901178880 00000100:00100000:3.0:1784290428.719276:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901178880 00000100:00100000:3.0:1784290428.719316:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1784290428.719322:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901178880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784290428.719427:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901178880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290428.719436:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1784290428.719469:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901178880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.719503:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901179008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.719553:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.719585:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c900 going to sleep for 11 seconds 00000100:00100000:2.0:1784290428.719595:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901179008 00000100:00100000:2.0:1784290428.719601:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901179008 00000100:00100000:2.0:1784290428.719632:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1784290428.719639:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901179008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290428.719736:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901179008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.719747:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1784290428.719783:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901179008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290428.720146:0:95090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95090:1870961901179136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290428.720184:0:95090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290428.720203:0:95090:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344a796c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290428.720246:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901179136 00000100:00100000:0.0:1784290428.720253:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901179136 00000100:00100000:0.0:1784290428.720295:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1784290428.720306:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:95090:x1870961901179136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784290428.720460:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:95090:x1870961901179136:12345-0@lo:502:llog_process_th.0 Request processed in 155us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290428.720492:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1784290428.720510:0:95090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95090:1870961901179136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290428.720558:0:95090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95090:1870961901179264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290428.720595:0:95090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290428.720630:0:95090:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24457dc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290428.720696:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901179264 00000100:00100000:1.0:1784290428.720702:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901179264 00000100:00100000:1.0:1784290428.720736:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784290428.720742:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:95090:x1870961901179264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290428.720822:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:95090:x1870961901179264:12345-0@lo:502:llog_process_th.0 Request processed in 78us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.720833:0:95090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95090:1870961901179264:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290428.720855:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000040:00080000:2.0:1784290428.720862:0:95090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:1.0:1784290428.720926:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:1.0:1784290428.720953:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784290428.720962:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b9000/0x5953bbf6b30757e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30757f0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.720974:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24414b9000/0x5953bbf6b30757e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30757f0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290428.720983:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1784290428.720985:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 56 10000000:01000000:1.0:1784290428.720987:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1784290428.721021:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b9800/0x5953bbf6b30757f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.721029:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24414b9800/0x5953bbf6b30757f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.721036:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24414b9800/0x5953bbf6b30757f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290428.721048:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901179392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.721074:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.721092:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290428.721117:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901179392 00000100:00100000:3.0:1784290428.721124:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901179392 00000100:00100000:3.0:1784290428.721158:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1784290428.721165:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+18:6485:x1870961901179392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290428.721174:0:94062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290428.721185:0:94062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c23450ab200/0x5953bbf6b30757fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30757f7 expref: -99 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290428.721201:0:94062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c23450ab200/0x5953bbf6b30757fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30757f7 expref: 19 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290428.721210:0:94062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c23450ab200/0x5953bbf6b30757fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30757f7 expref: 19 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290428.721217:0:94062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450ab200, rc 0) 00000100:00100000:3.0:1784290428.721256:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901179392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290428.721262:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1784290428.721322:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901179392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290428.721364:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24414b9800/0x5953bbf6b30757f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30757fe expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.721395:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24414b9800/0x5953bbf6b30757f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30757fe expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290428.721458:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901179520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.721495:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290428.721537:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901179520 00000100:00100000:1.0:1784290428.721539:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784290428.721543:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901179520 00000100:00100000:2.0:1784290428.721572:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1784290428.721579:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901179520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290428.721684:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901179520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.721695:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1784290428.721718:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901179520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.721755:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901179648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.721804:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.721830:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784290428.721869:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901179648 00000100:00100000:0.0:1784290428.721877:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901179648 00000100:00100000:0.0:1784290428.721917:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1784290428.721929:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901179648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784290428.722050:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901179648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290428.722061:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1784290428.722103:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901179648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290428.722538:0:95091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475819500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95091:1870961901179776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290428.722587:0:95091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290428.722623:0:95091:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246d46a600 going to sleep for 11 seconds 00000100:00100000:1.0:1784290428.722660:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901179776 00000100:00100000:1.0:1784290428.722668:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901179776 00000100:00100000:1.0:1784290428.722706:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784290428.722717:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474b7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:95091:x1870961901179776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290428.722839:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474b7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:95091:x1870961901179776:12345-0@lo:502:llog_process_th.0 Request processed in 123us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290428.722850:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1784290428.722861:0:95091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2475819500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95091:1870961901179776:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784290428.722899:0:95091:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784290428.722908:0:95091:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290428.722911:0:95091:0:(obd_config.c:1561:class_process_config()) marker 49 (0x1) lustre-MDT0001-m del lustre.pool_134 00000020:00000080:3.0:1784290428.722918:0:95091:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1784290428.723038:0:95091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475819500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95091:1870961901179904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290428.723071:0:95091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290428.723090:0:95091:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246d46a240 going to sleep for 11 seconds 00000100:00100000:2.0:1784290428.723109:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901179904 00000100:00100000:2.0:1784290428.723115:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901179904 00000100:00100000:2.0:1784290428.723144:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1784290428.723150:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:95091:x1870961901179904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290428.723228:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:95091:x1870961901179904:12345-0@lo:502:llog_process_th.0 Request processed in 76us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.723234:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1784290428.723291:0:95091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2475819500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95091:1870961901179904:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784290428.723339:0:95091:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784290428.723345:0:95091:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784290428.723348:0:95091:0:(obd_config.c:1561:class_process_config()) marker 49 (0x2) lustre-MDT0001-m del lustre.pool_134 00000040:00080000:3.0:1784290428.723352:0:95091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 59 count 58 00000020:01000000:1.0:1784290428.723508:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 56-58 (rc=0) 10000000:01000000:1.0:1784290428.723537:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1784290428.723548:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b9800/0x5953bbf6b30757f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30757fe expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.723564:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24414b9800/0x5953bbf6b30757f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30757fe expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290428.723592:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784290428.723596:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c246ff27800 from 61 10000000:01000000:1.0:1784290428.723601:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784290428.723627:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b8e00/0x5953bbf6b3075805 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.723656:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24414b8e00/0x5953bbf6b3075805 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.723667:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24414b8e00/0x5953bbf6b3075805 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290428.723685:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901180032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.723722:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.723758:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c480 going to sleep for 11 seconds 00000100:00100000:2.0:1784290428.723764:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901180032 00000100:00100000:2.0:1784290428.723769:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901180032 00000100:00100000:2.0:1784290428.723794:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784290428.723800:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+19:6485:x1870961901180032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290428.723808:0:94060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290428.723817:0:94060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236d400/0x5953bbf6b307580c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3075805 expref: -99 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290428.723832:0:94060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236d400/0x5953bbf6b307580c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3075805 expref: 20 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290428.723840:0:94060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236d400/0x5953bbf6b307580c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075805 expref: 20 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290428.723846:0:94060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236d400, rc 0) 00000100:00100000:2.0:1784290428.723879:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901180032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.723896:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784290428.723913:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901180032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290428.723931:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24414b8e00/0x5953bbf6b3075805 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307580c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.723944:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24414b8e00/0x5953bbf6b3075805 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307580c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290428.724014:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901180160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.724052:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.724078:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c480 going to sleep for 11 seconds 00000100:00100000:0.0:1784290428.724118:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901180160 00000100:00100000:0.0:1784290428.724125:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901180160 00000100:00100000:0.0:1784290428.724167:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1784290428.724177:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901180160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290428.724324:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901180160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290428.724339:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784290428.724448:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901180160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.724491:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901180288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.724556:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290428.724609:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901180288 00000100:00100000:1.0:1784290428.724613:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c480 going to sleep for 11 seconds 00000100:00100000:2.0:1784290428.724616:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901180288 00000100:00100000:2.0:1784290428.724665:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784290428.724671:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901180288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290428.724753:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901180288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.724760:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784290428.724784:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901180288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290428.725091:0:95092:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95092:1870961901180416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290428.725128:0:95092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290428.725148:0:95092:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290428.725175:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901180416 00000100:00100000:3.0:1784290428.725181:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901180416 00000100:00100000:3.0:1784290428.725221:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784290428.725228:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:95092:x1870961901180416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290428.725317:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:95092:x1870961901180416:12345-0@lo:502:llog_process_th.0 Request processed in 88us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290428.725325:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1784290428.725416:0:95092:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95092:1870961901180416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290428.725467:0:95092:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95092:1870961901180544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290428.725514:0:95092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290428.725548:0:95092:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344dd43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290428.725570:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901180544 00000100:00100000:1.0:1784290428.725576:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901180544 00000100:00100000:1.0:1784290428.725602:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784290428.725609:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:95092:x1870961901180544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290428.725703:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:95092:x1870961901180544:12345-0@lo:502:llog_process_th.0 Request processed in 91us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290428.725715:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1784290428.725723:0:95092:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95092:1870961901180544:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784290428.725760:0:95092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:1.0:1784290428.725816:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:1.0:1784290428.725839:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784290428.725846:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b8e00/0x5953bbf6b3075805 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307580c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.725855:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24414b8e00/0x5953bbf6b3075805 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307580c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290428.725861:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1784290428.725863:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1784290428.725865:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784290428.725883:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b9a00/0x5953bbf6b3075813 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.725894:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24414b9a00/0x5953bbf6b3075813 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.725905:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24414b9a00/0x5953bbf6b3075813 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290428.725931:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901180672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.725967:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.725993:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1784290428.726039:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901180672 00000100:00100000:0.0:1784290428.726047:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901180672 00000100:00100000:0.0:1784290428.726083:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784290428.726093:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+20:6485:x1870961901180672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290428.726104:0:94059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290428.726117:0:94059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b307581a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3075813 expref: -99 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290428.726138:0:94059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b307581a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3075813 expref: 21 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290428.726152:0:94059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b307581a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075813 expref: 21 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290428.726171:0:94059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26e00, rc 0) 00000100:00100000:0.0:1784290428.726222:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901180672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290428.726231:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1784290428.726275:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901180672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290428.726291:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24414b9a00/0x5953bbf6b3075813 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307581a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.726303:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24414b9a00/0x5953bbf6b3075813 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307581a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290428.726388:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901180800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.726415:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.726435:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1784290428.726442:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901180800 00000100:00100000:2.0:1784290428.726449:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901180800 00000100:00100000:2.0:1784290428.726485:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784290428.726497:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901180800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290428.726587:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901180800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290428.726592:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901180800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290428.726599:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784290428.726617:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901180928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.726661:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.726683:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1784290428.726768:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901180928 00000100:00100000:3.0:1784290428.726775:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901180928 00000100:00100000:3.0:1784290428.726820:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784290428.726826:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901180928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290428.726897:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901180928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290428.726904:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1784290428.726931:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901180928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784290428.727585:0:95093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1784290428.727650:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1784290428.727667:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784290428.727673:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b9a00/0x5953bbf6b3075813 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307581a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.727683:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24414b9a00/0x5953bbf6b3075813 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307581a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290428.727702:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784290428.727705:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c247d3d2000 from 61 10000000:01000000:1.0:1784290428.727707:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784290428.727723:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b9c00/0x5953bbf6b3075821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.727733:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24414b9c00/0x5953bbf6b3075821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.727742:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24414b9c00/0x5953bbf6b3075821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290428.727757:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901181056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.727791:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.727818:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1784290428.727835:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901181056 00000100:00100000:2.0:1784290428.727842:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901181056 00000100:00100000:2.0:1784290428.727877:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1784290428.727887:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:6485:x1870961901181056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290428.727897:0:94060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290428.727907:0:94060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236d000/0x5953bbf6b3075828 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3075821 expref: -99 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290428.727925:0:94060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236d000/0x5953bbf6b3075828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3075821 expref: 22 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290428.727936:0:94060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236d000/0x5953bbf6b3075828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075821 expref: 22 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290428.727944:0:94060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236d000, rc 0) 00000100:00100000:2.0:1784290428.727983:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901181056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.727993:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784290428.728015:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901181056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290428.728026:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24414b9c00/0x5953bbf6b3075821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075828 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.728033:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24414b9c00/0x5953bbf6b3075821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075828 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290428.728061:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901181184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.728080:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.728098:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1784290428.728127:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901181184 00000100:00100000:0.0:1784290428.728135:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901181184 00000100:00100000:0.0:1784290428.728162:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784290428.728168:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901181184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290428.728254:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901181184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290428.728265:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784290428.728284:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901181184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.728307:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901181312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.728355:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.728376:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1784290428.728404:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901181312 00000100:00100000:2.0:1784290428.728411:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901181312 00000100:00100000:2.0:1784290428.728445:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784290428.728456:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901181312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290428.728537:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901181312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290428.728542:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901181312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784290428.728550:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784290428.728771:0:95094:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95094:1870961901181440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290428.728814:0:95094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290428.728836:0:95094:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c247b38ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784290428.728860:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901181440 00000100:00100000:3.0:1784290428.728867:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901181440 00000100:00100000:3.0:1784290428.728901:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784290428.728910:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:95094:x1870961901181440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784290428.729026:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:95094:x1870961901181440:12345-0@lo:502:llog_process_th.0 Request processed in 116us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290428.729036:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784290428.729065:0:95094:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95094:1870961901181440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290428.729108:0:95094:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95094:1870961901181568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784290428.729145:0:95094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290428.729165:0:95094:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2342c0a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290428.729181:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901181568 00000100:00100000:1.0:1784290428.729185:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901181568 00000100:00100000:1.0:1784290428.729206:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784290428.729212:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fde6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:95094:x1870961901181568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784290428.729271:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fde6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:95094:x1870961901181568:12345-0@lo:502:llog_process_th.0 Request processed in 57us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290428.729278:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784290428.729283:0:95094:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483d2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2e54cd1c-9dbd-4e31-b60e-998135d46053:95094:1870961901181568:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784290428.729312:0:95094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:1.0:1784290428.729374:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:1.0:1784290428.729430:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784290428.729440:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b9c00/0x5953bbf6b3075821 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075828 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.729452:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24414b9c00/0x5953bbf6b3075821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075828 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290428.729463:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1784290428.729466:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1784290428.729469:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784290428.729499:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b8000/0x5953bbf6b307582f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.729510:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24414b8000/0x5953bbf6b307582f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.729521:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24414b8000/0x5953bbf6b307582f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290428.729551:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901181696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.729615:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.729680:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c300 going to sleep for 11 seconds 00000100:00100000:0.0:1784290428.729685:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901181696 00000100:00100000:0.0:1784290428.729693:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901181696 00000100:00100000:0.0:1784290428.729731:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1784290428.729738:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901181696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784290428.729747:0:94059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290428.729757:0:94059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c246dd27200/0x5953bbf6b3075836 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307582f expref: -99 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290428.729774:0:94059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c246dd27200/0x5953bbf6b3075836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307582f expref: 23 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290428.729783:0:94059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c246dd27200/0x5953bbf6b3075836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307582f expref: 23 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290428.729807:0:94059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27200, rc 0) 00000100:00100000:0.0:1784290428.729846:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901181696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290428.729852:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1784290428.729889:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901181696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290428.729903:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24414b8000/0x5953bbf6b307582f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075836 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.729913:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24414b8000/0x5953bbf6b307582f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075836 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290428.729963:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901181824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.730008:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.730029:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c300 going to sleep for 11 seconds 00000100:00100000:2.0:1784290428.730062:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901181824 00000100:00100000:2.0:1784290428.730068:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901181824 00000100:00100000:2.0:1784290428.730109:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1784290428.730119:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901181824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784290428.730208:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901181824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.730219:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1784290428.730231:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901181824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.730283:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901181952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.730330:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.730369:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c300 going to sleep for 11 seconds 00000100:00100000:3.0:1784290428.730420:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901181952 00000100:00100000:3.0:1784290428.730428:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901181952 00000100:00100000:3.0:1784290428.730463:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1784290428.730475:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901181952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784290428.730588:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901181952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290428.730601:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1784290428.730612:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901181952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784290428.731543:0:95095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1784290428.731616:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1784290428.731633:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784290428.731640:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b8000/0x5953bbf6b307582f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075836 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.731650:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24414b8000/0x5953bbf6b307582f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075836 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290428.731666:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784290428.731668:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9c2480260000 from 1 10000000:01000000:1.0:1784290428.731671:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784290428.731686:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b9400/0x5953bbf6b307583d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.731694:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c24414b9400/0x5953bbf6b307583d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.731703:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c24414b9400/0x5953bbf6b307583d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290428.731717:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901182080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.731757:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.731784:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c300 going to sleep for 11 seconds 00000100:00100000:2.0:1784290428.731802:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901182080 00000100:00100000:2.0:1784290428.731808:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901182080 00000100:00100000:2.0:1784290428.731840:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1784290428.731850:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901182080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290428.731859:0:94060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290428.731869:0:94060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c234236ca00/0x5953bbf6b3075844 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b307583d expref: -99 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290428.731884:0:94060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c234236ca00/0x5953bbf6b3075844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b307583d expref: 24 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290428.731894:0:94060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c234236ca00/0x5953bbf6b3075844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307583d expref: 24 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290428.731913:0:94060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236ca00, rc 0) 00000100:00100000:2.0:1784290428.731952:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901182080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290428.731959:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1784290428.731967:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901182080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784290428.731982:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c24414b9400/0x5953bbf6b307583d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075844 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.731993:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c24414b9400/0x5953bbf6b307583d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075844 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290428.732059:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901182208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784290428.732087:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290428.732106:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c234537c300 going to sleep for 11 seconds 00000100:00100000:0.0:1784290428.732132:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901182208 00000100:00100000:0.0:1784290428.732138:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901182208 00000100:00100000:0.0:1784290428.732165:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1784290428.732171:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901182208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784290428.732223:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901182208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 52us (136us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784290428.732231:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1784290428.732247:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23433dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901182208:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1784290428.732273:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784290428.732285:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b9400/0x5953bbf6b307583d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075844 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290428.732294:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24414b9400/0x5953bbf6b307583d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075844 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290429.608551:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784290430.489470:0:95193:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 135: Server failure in lock replay phase ========================================================== 08:13:50 (1784290430) 00000100:00100000:0.0:1784290430.516616:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290430.516666:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896284800 00000100:00100000:1.0:1784290430.516680:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896284800 00000100:00080000:0.0:1784290430.516728:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784290430.516762:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1308 00000100:00100000:1.0:1784290430.516773:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:73308:x1870961896284800:12345-192.168.202.6@tcp:36:mkdir.0 00010000:00010000:1.0:1784290430.516846:0:65990:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290430.516880:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075668 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25b3 expref: 10 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.516900:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:1.0:1784290430.516905:0:65990:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290430.516992:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b307584b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.517007:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b307584b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.517017:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b307584b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.517032:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8600/0x5953bbf6b3075852 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.517037:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8600/0x5953bbf6b3075852 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.517048:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8600/0x5953bbf6b3075852 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.517840:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d400/0x5953bbf6b3075859 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.517851:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d400/0x5953bbf6b3075859 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.517872:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d400/0x5953bbf6b3075859 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784290430.517892:0:65990:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000079b044f2 reply state 00000000f0b24885 transno 120259084289 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d400/0x5953bbf6b3075859 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.517907:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d400/0x5953bbf6b3075859 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.517915:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62200) 00010000:00010000:1.0:1784290430.517919:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784290430.517922:0:65990:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784290430.517930:0:65990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00010000:00010000:1.0:1784290430.517941:0:65990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b307584b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.517950:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b307584b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.517959:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b307584b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.517967:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b307584b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.518004:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b8a00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290430.518011:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b307584b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.518031:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b307584b lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.518042:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:1.0:1784290430.518045:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290430.518050:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b307584b lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.518058:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b307584b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784290430.518071:0:65990:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000079b044f2 reply state 00000000f0b24885 transno 120259084289 ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8600/0x5953bbf6b3075852 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.518080:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8600/0x5953bbf6b3075852 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.518089:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9c246de62700) 00010000:00010000:1.0:1784290430.518092:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784290430.518095:0:65990:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1784290430.518228:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:73308:x1870961896284800:12345-192.168.202.6@tcp:36:mkdir.0 Request processed in 1455us (1619us total) trans 120259084289 rc 0/0 00000100:00100000:1.0:1784290430.518238:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1308 00000001:00080000:0.0:1784290430.518913:0:94053:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084289 is committed 00010000:00010000:1.0:1784290430.518948:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8600/0x5953bbf6b3075852 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.518973:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8600/0x5953bbf6b3075852 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.518998:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8600/0x5953bbf6b3075852 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.519005:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b8600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290430.519009:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8600/0x5953bbf6b3075852 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.519016:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8600/0x5953bbf6b3075852 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.519027:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9c246de62700) 00010000:00010000:1.0:1784290430.519031:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290430.519035:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8600/0x5953bbf6b3075852 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.519042:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8600/0x5953bbf6b3075852 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.519062:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d400/0x5953bbf6b3075859 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.519069:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d400/0x5953bbf6b3075859 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.519075:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d400/0x5953bbf6b3075859 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.519082:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7d400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290430.519094:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d400/0x5953bbf6b3075859 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.519102:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d400/0x5953bbf6b3075859 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.519112:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62200) 00010000:00010000:1.0:1784290430.519115:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290430.519118:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d400/0x5953bbf6b3075859 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.519125:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d400/0x5953bbf6b3075859 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290430.526294:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290430.526336:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896284928 00000100:00100000:1.0:1784290430.526405:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896284928 00000100:00100000:1.0:1784290430.526446:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1309 00000100:00100000:1.0:1784290430.526454:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:73311:x1870961896284928:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1784290430.526475:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290430.526487:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d400/0x5953bbf6b3075860 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2615 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.526547:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075867 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.526560:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075867 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.526571:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075867 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290430.526609:0:74876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784290430.526621:0:74876:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784290430.526640:0:74876:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075867 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.526661:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d400/0x5953bbf6b3075860 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2615 expref: 11 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.526675:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075867 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2615 expref: 10 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.526681:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:1.0:1784290430.526683:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784290430.526686:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2469a7dc00, rc 0) 00000100:00100000:1.0:1784290430.526720:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:73311:x1870961896284928:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 268us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290430.526726:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1309 00000100:00100000:0.0:1784290430.527954:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290430.528011:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896285184 00000100:00100000:1.0:1784290430.528017:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896285184 00000100:00100000:1.0:1784290430.528065:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1310 00000100:00100000:1.0:1784290430.528076:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:73311:x1870961896285184:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1784290430.528085:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290430.528087:0:65989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784290430.528101:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075867 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2615 expref: 10 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528117:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:1.0:1784290430.528120:0:65989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290430.528129:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b307586e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b261c expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528218:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075875 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528231:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075875 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528241:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075875 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528257:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b307587c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528265:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b307587c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528273:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b307587c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528321:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b3075883 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528331:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b3075883 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528369:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b3075883 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290430.528379:0:65989:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00010000:00010000:1.0:1784290430.528393:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b3075883 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528412:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b3075883 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528420:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b3075883 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528427:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7d800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290430.528432:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b3075883 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528440:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b3075883 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528451:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:1.0:1784290430.528454:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290430.528457:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b3075883 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528465:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b3075883 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528486:0:65989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075875 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528494:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075875 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528500:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075875 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528505:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075875 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528518:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7ca00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290430.528523:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075875 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528529:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075875 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528537:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:1.0:1784290430.528545:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290430.528548:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075875 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528556:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075875 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528568:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b307587c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528575:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b307587c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528582:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b307587c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528588:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7d200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290430.528592:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b307587c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528599:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b307587c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528619:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9c246de62200) 00010000:00010000:1.0:1784290430.528622:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290430.528626:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b307587c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528632:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b307587c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528659:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b307586e lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b261c expref: 10 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528669:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:1.0:1784290430.528673:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290430.528677:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b307586e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b261c expref: 10 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.528687:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2469a7ce00, rc 0) 00000100:00100000:1.0:1784290430.528724:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:73311:x1870961896285184:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 651us (771us total) trans 0 rc 301/301 00000100:00100000:1.0:1784290430.528732:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1310 00000100:00100000:0.0:1784290430.529572:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290430.529615:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896285312 00000100:00100000:1.0:1784290430.529621:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896285312 00000100:00100000:1.0:1784290430.529660:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1311 00000100:00100000:1.0:1784290430.529669:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2469c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:73311:x1870961896285312:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1784290430.529679:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290430.529691:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b307588a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2623 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.529743:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b3075891 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.529754:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b3075891 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.529764:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b3075891 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290430.529792:0:66008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1784290430.529796:0:66008:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1784290430.529807:0:66008:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b3075891 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.529825:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b307588a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2623 expref: 11 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.529838:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b3075891 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2623 expref: 10 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.529846:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:1.0:1784290430.529849:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784290430.529852:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2469a7cc00, rc 0) 00000100:00100000:1.0:1784290430.529888:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2469c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:73311:x1870961896285312:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 221us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290430.529898:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1311 00000100:00100000:3.0:1784290430.535931:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290430.535990:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896285568 00000100:00100000:1.0:1784290430.535998:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896285568 00000100:00100000:1.0:1784290430.536054:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1312 00000100:00100000:1.0:1784290430.536066:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:73311:x1870961896285568:12345-192.168.202.6@tcp:101:lfs.0 00010000:00010000:1.0:1784290430.536082:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290430.536095:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b3075898 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b262a expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536148:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b307589f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536162:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b307589f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536174:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b307589f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536189:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b30758a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536200:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b30758a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536209:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b30758a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290430.536284:0:66004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00010000:00010000:1.0:1784290430.536421:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b307589f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536432:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b307589f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536440:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b307589f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536455:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b307589f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536463:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7d200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290430.536468:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b307589f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536479:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b307589f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536493:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:1.0:1784290430.536497:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290430.536502:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b307589f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536511:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b307589f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536530:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b30758a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536538:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b30758a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536545:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b30758a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536552:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7ca00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290430.536557:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b30758a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536578:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b30758a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536597:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9c246de62200) 00010000:00010000:1.0:1784290430.536601:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290430.536605:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b30758a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536612:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b30758a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536659:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b3075898 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b262a expref: 12 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536673:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:1.0:1784290430.536677:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784290430.536682:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b3075898 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b262a expref: 12 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.536697:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2469a7ce00, rc 0) 00000100:00100000:1.0:1784290430.536745:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:73311:x1870961896285568:12345-192.168.202.6@tcp:101:lfs.0 Request processed in 682us (818us total) trans 120259084290 rc 301/301 00000100:00100000:1.0:1784290430.536755:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1312 00000100:00100000:0.0:1784290430.537677:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290430.537739:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896285824 00000100:00100000:1.0:1784290430.537746:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896285824 00000100:00100000:1.0:1784290430.537781:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1313 00000100:00100000:1.0:1784290430.537790:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:73311:x1870961896285824:12345-192.168.202.6@tcp:36:lfs.0 00010000:00010000:1.0:1784290430.537855:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b30758b4 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.537867:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b30758b4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.537876:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b30758b4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784290430.538020:0:65988:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000058d66fa9 reply state 0000000057152eb8 transno 120259084291 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b30758b4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.538034:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b30758b4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.538042:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:1.0:1784290430.538045:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1784290430.538048:0:65988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784290430.538054:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00000100:00100000:1.0:1784290430.538104:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+13:73311:x1870961896285824:12345-192.168.202.6@tcp:36:lfs.0 Request processed in 313us (427us total) trans 120259084291 rc 0/0 00000100:00100000:1.0:1784290430.538112:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1313 00000100:00100000:1.0:1784290430.539421:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.539470:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896286080 00000100:00100000:3.0:1784290430.539476:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896286080 00000100:00100000:3.0:1784290430.539511:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 240 00000100:00100000:3.0:1784290430.539522:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+13:73311:x1870961896286080:12345-192.168.202.6@tcp:35:lfs.0 00000100:00100000:3.0:1784290430.539658:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+14:73311:x1870961896286080:12345-192.168.202.6@tcp:35:lfs.0 Request processed in 138us (241us total) trans 120259084292 rc 0/0 00000100:00100000:3.0:1784290430.539667:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 240 00000100:00100000:1.0:1784290430.545420:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.545466:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896286208 00000100:00100000:0.0:1784290430.545484:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896286208 00000100:00100000:0.0:1784290430.545528:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1314 00000100:00100000:0.0:1784290430.545539:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+14:73314:x1870961896286208:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.545556:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.545583:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b30758bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2631 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.545638:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b30758c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.545669:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b30758c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.545680:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b30758c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.545696:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b30758c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.545706:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b30758c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.545714:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b30758c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.545781:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b30758d0 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.545791:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b30758d0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.545799:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b30758d0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290430.545825:0:65990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00000004:00200000:0.0:1784290430.545829:0:65990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784290430.545862:0:65990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b30758d0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.545874:0:65990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b30758c2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.545893:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b30758c2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.545900:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b30758c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.545907:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b30758c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.545914:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290430.545919:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b30758c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.545927:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b30758c2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.545939:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:0.0:1784290430.545942:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290430.545946:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b30758c2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.545954:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b30758c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.545967:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b30758c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.545976:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b30758c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.546000:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b30758c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.546012:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26c00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290430.546016:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b30758c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.546024:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b30758c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.546034:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9c2474f5fa00) 00010000:00010000:0.0:1784290430.546037:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290430.546041:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b30758c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.546049:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b30758c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.546085:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b30758bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2631 expref: 16 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.546101:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27600/0x5953bbf6b30758d0 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2631 expref: 15 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.546110:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:0.0:1784290430.546113:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784290430.546116:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27600, rc 0) 00000100:00100000:0.0:1784290430.546156:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+15:73314:x1870961896286208:12345-192.168.202.6@tcp:101:touch.0 Request processed in 620us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290430.546165:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1314 00000100:00100000:1.0:1784290430.547127:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.547163:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896286464 00000100:00100000:3.0:1784290430.547168:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896286464 00000100:00100000:3.0:1784290430.547198:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1315 00000100:00100000:3.0:1784290430.547205:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+15:73314:x1870961896286464:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:3.0:1784290430.547219:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290430.547230:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30758d7 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2638 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.547280:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30758de lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.547294:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30758de lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.547306:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30758de lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.547324:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30758e5 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.547333:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30758e5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.547367:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30758e5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784290430.547761:0:74876:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x704:0x0], count =94 00000004:00080000:3.0:1784290430.547771:0:74876:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x704:0x0]+94 in llog 00000004:00080000:3.0:1784290430.547792:0:74876:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x762:0x0], index 0: 0 00010000:00010000:3.0:1784290430.547936:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30758ec lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.547947:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30758ec lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.547958:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30758ec lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.548021:0:74876:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30758de lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.548031:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30758de lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.548039:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30758de lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.548047:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30758de lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.548054:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290430.548059:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30758de lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.548067:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30758de lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.548079:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:3.0:1784290430.548083:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290430.548088:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30758de lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.548096:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b30758de lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.548110:0:74876:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008aa500ed reply state 00000000375a5cf7 transno 120259084293 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30758e5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.548122:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30758e5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.548138:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x9beb5ca3 (ffff9c24821d9600) 00010000:00010000:3.0:1784290430.548142:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.548144:0:74876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784290430.548171:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30758d7 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2638 expref: 18 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.548190:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30758ec lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2638 expref: 17 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.548200:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9c24821d9f00) 00010000:00010000:3.0:1784290430.548204:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784290430.548207:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450abc00, rc 0) 00000100:00100000:3.0:1784290430.548248:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+18:73314:x1870961896286464:12345-192.168.202.6@tcp:101:touch.0 Request processed in 1042us (1121us total) trans 120259084293 rc 0/0 00000100:00100000:3.0:1784290430.548257:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1315 00000100:00100000:1.0:1784290430.549816:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.549851:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896286720 00000100:00100000:3.0:1784290430.549856:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896286720 00000100:00100000:3.0:1784290430.549887:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1316 00000100:00100000:3.0:1784290430.549897:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+18:73314:x1870961896286720:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:3.0:1784290430.549922:0:65989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290430.549935:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30758ec lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2638 expref: 18 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.549949:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9c24821d9f00) 00010000:00010000:3.0:1784290430.549958:0:65989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290430.549997:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa400/0x5953bbf6b30758fa lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.550011:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa400/0x5953bbf6b30758fa lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.550018:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa400/0x5953bbf6b30758fa lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.550070:0:65989:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dffc0100 reply state 00000000d4fd9b35 transno 120259084294 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa400/0x5953bbf6b30758fa lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.550078:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa400/0x5953bbf6b30758fa lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.550083:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9c24821d9400) 00010000:00010000:3.0:1784290430.550086:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.550088:0:65989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290430.550137:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+19:73314:x1870961896286720:12345-192.168.202.6@tcp:36:touch.0 Request processed in 243us (322us total) trans 120259084294 rc 0/0 00000100:00100000:3.0:1784290430.550144:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1316 00000100:00100000:1.0:1784290430.550793:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.550823:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896286848 00000100:00100000:0.0:1784290430.550833:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896286848 00000100:00100000:0.0:1784290430.550862:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1317 00000100:00100000:0.0:1784290430.550870:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+19:73314:x1870961896286848:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.550878:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.550887:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27400/0x5953bbf6b3075901 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b263f expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.550912:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27400/0x5953bbf6b3075901 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b263f expref: 20 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.550920:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27400/0x5953bbf6b3075901 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b263f expref: 20 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.550934:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9c24821d9400) 00010000:00010000:0.0:1784290430.550937:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784290430.550939:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27400, rc 0) 00000100:00100000:0.0:1784290430.550965:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+20:73314:x1870961896286848:12345-192.168.202.6@tcp:101:touch.0 Request processed in 97us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290430.550972:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1317 00000100:00100000:1.0:1784290430.551894:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.551941:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896286976 00000100:00100000:3.0:1784290430.551946:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896286976 00000100:00080000:0.0:1784290430.552019:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784290430.552022:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4979 00000100:00100000:3.0:1784290430.552034:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2399:x1870961896286976:12345-192.168.202.6@tcp:2:touch.0 00000100:00100000:3.0:1784290430.552197:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2399:x1870961896286976:12345-192.168.202.6@tcp:2:touch.0 Request processed in 164us (302us total) trans 4294968633 rc 0/0 00000100:00100000:3.0:1784290430.552206:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4979 00000100:00100000:1.0:1784290430.553048:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290430.553103:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896287232 00000100:00100000:2.0:1784290430.553109:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896287232 00000100:00100000:2.0:1784290430.553140:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 241 00000100:00100000:2.0:1784290430.553147:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+20:73314:x1870961896287232:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:2.0:1784290430.553277:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+21:73314:x1870961896287232:12345-192.168.202.6@tcp:35:touch.0 Request processed in 130us (229us total) trans 120259084295 rc 0/0 00000100:00100000:2.0:1784290430.553283:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 241 00000100:00100000:1.0:1784290430.554145:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.554195:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896287488 00000100:00100000:0.0:1784290430.554201:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896287488 00000100:00100000:0.0:1784290430.554232:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1318 00000100:00100000:0.0:1784290430.554240:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+21:73314:x1870961896287488:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.554248:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.554256:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b3075908 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2646 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.554307:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b307590f lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.554315:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b307590f lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.554320:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b307590f lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.554328:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3075916 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.554333:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3075916 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.554338:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3075916 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784290430.554508:0:66004:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x763:0x0], index 0: 0 00010000:00010000:0.0:1784290430.554572:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b307591d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.554579:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b307591d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.554585:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b307591d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.554608:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b307590f lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.554622:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b307590f lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.554626:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b307590f lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.554630:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b307590f lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.554633:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26c00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290430.554636:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b307590f lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.554639:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b307590f lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.554645:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:0.0:1784290430.554648:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290430.554650:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b307590f lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.554655:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b307590f lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290430.554662:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fe50bbc4 reply state 000000003eadaf0d transno 120259084296 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3075916 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.554668:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3075916 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.554672:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe44515a3 (ffff9c2474f5fa00) 00010000:00010000:0.0:1784290430.554678:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290430.554680:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784290430.554696:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b3075908 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2646 expref: 24 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.554705:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b307591d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2646 expref: 23 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.554710:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9c2474f5f300) 00010000:00010000:0.0:1784290430.554712:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784290430.554714:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27000, rc 0) 00000100:00100000:0.0:1784290430.554743:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+24:73314:x1870961896287488:12345-192.168.202.6@tcp:101:touch.0 Request processed in 504us (600us total) trans 120259084296 rc 0/0 00000100:00100000:0.0:1784290430.554748:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1318 00000100:00100000:1.0:1784290430.555871:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.555909:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896287744 00000100:00100000:3.0:1784290430.555915:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896287744 00000100:00100000:3.0:1784290430.555951:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1319 00000100:00100000:3.0:1784290430.555969:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+24:73314:x1870961896287744:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:3.0:1784290430.556011:0:65988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290430.556024:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b307591d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2646 expref: 24 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.556038:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9c2474f5f300) 00010000:00010000:3.0:1784290430.556046:0:65988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290430.556069:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b307592b lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.556080:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b307592b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.556089:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b307592b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.556135:0:65988:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a4ee14c2 reply state 000000005a79af33 transno 120259084297 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b307592b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.556148:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b307592b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.556155:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9c24821d9000) 00010000:00010000:3.0:1784290430.556158:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.556161:0:65988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290430.556211:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+25:73314:x1870961896287744:12345-192.168.202.6@tcp:36:touch.0 Request processed in 244us (339us total) trans 120259084297 rc 0/0 00000100:00100000:3.0:1784290430.556222:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1319 00000100:00100000:1.0:1784290430.556935:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.557013:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896287872 00000100:00100000:0.0:1784290430.557018:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896287872 00000100:00100000:0.0:1784290430.557049:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1320 00000100:00100000:0.0:1784290430.557055:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+25:73314:x1870961896287872:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.557065:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.557074:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3075932 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b264d expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.557097:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3075932 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b264d expref: 26 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.557106:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27c00/0x5953bbf6b3075932 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b264d expref: 26 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.557128:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9c24821d9000) 00010000:00010000:0.0:1784290430.557131:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784290430.557133:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27c00, rc 0) 00000100:00100000:0.0:1784290430.557161:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+26:73314:x1870961896287872:12345-192.168.202.6@tcp:101:touch.0 Request processed in 106us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290430.557167:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1320 00000100:00100000:1.0:1784290430.558084:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.558117:0:26253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896288000 00000100:00100000:3.0:1784290430.558122:0:26253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896288000 00000100:00100000:3.0:1784290430.558155:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4980 00000100:00100000:3.0:1784290430.558160:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2400:x1870961896288000:12345-192.168.202.6@tcp:2:touch.0 00000100:00100000:3.0:1784290430.558232:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2400:x1870961896288000:12345-192.168.202.6@tcp:2:touch.0 Request processed in 72us (150us total) trans 4294968634 rc 0/0 00000100:00100000:3.0:1784290430.558238:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4980 00000100:00100000:1.0:1784290430.559007:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.559041:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896288256 00000100:00100000:3.0:1784290430.559047:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896288256 00000100:00100000:3.0:1784290430.559073:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 242 00000100:00100000:3.0:1784290430.559080:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c20b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+26:73314:x1870961896288256:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:3.0:1784290430.559183:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c20b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+27:73314:x1870961896288256:12345-192.168.202.6@tcp:35:touch.0 Request processed in 103us (177us total) trans 120259084298 rc 0/0 00000100:00100000:3.0:1784290430.559190:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 242 00000100:00100000:1.0:1784290430.560016:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.560046:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896288512 00000100:00100000:3.0:1784290430.560050:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896288512 00000100:00100000:3.0:1784290430.560074:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1321 00000100:00100000:3.0:1784290430.560079:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+27:73314:x1870961896288512:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:3.0:1784290430.560087:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290430.560095:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075939 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2654 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.560131:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3075940 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.560139:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3075940 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.560145:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3075940 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.560159:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075947 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.560165:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075947 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.560170:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075947 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784290430.560272:0:74876:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x764:0x0], index 0: 0 00010000:00010000:3.0:1784290430.560332:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b307594e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.560361:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b307594e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.560368:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b307594e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.560388:0:74876:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3075940 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.560393:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3075940 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.560398:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3075940 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.560402:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3075940 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.560405:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290430.560425:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3075940 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.560431:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3075940 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.560438:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:3.0:1784290430.560440:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290430.560442:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3075940 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.560447:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3075940 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.560454:0:74876:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049e798ea reply state 000000000c747d61 transno 120259084299 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075947 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.560460:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075947 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.560464:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2c9ecea3 (ffff9c24821d9f00) 00010000:00010000:3.0:1784290430.560466:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.560468:0:74876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784290430.560482:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075939 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2654 expref: 30 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.560491:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b307594e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2654 expref: 29 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.560496:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9c24821d9100) 00010000:00010000:3.0:1784290430.560498:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784290430.560504:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aba00, rc 0) 00000100:00100000:3.0:1784290430.560530:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+30:73314:x1870961896288512:12345-192.168.202.6@tcp:101:touch.0 Request processed in 451us (517us total) trans 120259084299 rc 0/0 00000100:00100000:3.0:1784290430.560536:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1321 00000100:00100000:1.0:1784290430.561541:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.561564:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896288768 00000100:00100000:3.0:1784290430.561568:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896288768 00000100:00100000:3.0:1784290430.561594:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1322 00000100:00100000:3.0:1784290430.561601:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+30:73314:x1870961896288768:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:3.0:1784290430.561620:0:65989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290430.561628:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b307594e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2654 expref: 30 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.561637:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9c24821d9100) 00010000:00010000:3.0:1784290430.561642:0:65989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290430.561657:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b307595c lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.561663:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b307595c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.561669:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b307595c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.561707:0:65989:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d2768fcc reply state 000000003d8111ce transno 120259084300 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b307595c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.561718:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b307595c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.561726:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9c24821d9a00) 00010000:00010000:3.0:1784290430.561735:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.561738:0:65989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290430.561781:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+31:73314:x1870961896288768:12345-192.168.202.6@tcp:36:touch.0 Request processed in 181us (242us total) trans 120259084300 rc 0/0 00000100:00100000:3.0:1784290430.561787:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1322 00000100:00100000:1.0:1784290430.562519:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.562550:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896288896 00000100:00100000:0.0:1784290430.562556:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896288896 00000100:00100000:0.0:1784290430.562586:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1323 00000100:00100000:0.0:1784290430.562593:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+31:73314:x1870961896288896:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.562604:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.562612:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3075963 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b265b expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.562635:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3075963 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b265b expref: 32 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.562644:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27800/0x5953bbf6b3075963 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b265b expref: 32 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.562654:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9c24821d9a00) 00010000:00010000:0.0:1784290430.562656:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784290430.562658:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27800, rc 0) 00000100:00100000:0.0:1784290430.562685:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+32:73314:x1870961896288896:12345-192.168.202.6@tcp:101:touch.0 Request processed in 93us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290430.562691:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1323 00000100:00100000:1.0:1784290430.563472:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.563507:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896289024 00000100:00100000:3.0:1784290430.563511:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896289024 00000100:00100000:3.0:1784290430.563536:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4981 00000100:00100000:3.0:1784290430.563543:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2399:x1870961896289024:12345-192.168.202.6@tcp:2:touch.0 00000100:00100000:3.0:1784290430.563615:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:2399:x1870961896289024:12345-192.168.202.6@tcp:2:touch.0 Request processed in 72us (144us total) trans 4294968635 rc 0/0 00000100:00100000:3.0:1784290430.563620:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4981 00000100:00100000:1.0:1784290430.564469:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290430.564507:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896289280 00000100:00100000:2.0:1784290430.564513:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896289280 00000100:00100000:2.0:1784290430.564541:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 243 00000100:00100000:2.0:1784290430.564547:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+32:73314:x1870961896289280:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:2.0:1784290430.564650:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+33:73314:x1870961896289280:12345-192.168.202.6@tcp:35:touch.0 Request processed in 102us (182us total) trans 120259084301 rc 0/0 00000100:00100000:2.0:1784290430.564657:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 243 00000100:00100000:1.0:1784290430.565539:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.565570:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896289536 00000100:00100000:0.0:1784290430.565576:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896289536 00000100:00100000:0.0:1784290430.565605:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1324 00000100:00100000:0.0:1784290430.565611:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+33:73314:x1870961896289536:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.565621:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.565629:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b307596a lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2662 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.565665:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3075971 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.565673:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3075971 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.565680:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3075971 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.565689:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b3075978 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.565694:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b3075978 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.565699:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b3075978 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784290430.565843:0:66004:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x765:0x0], index 0: 0 00010000:00010000:0.0:1784290430.565906:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b307597f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.565912:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b307597f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.565923:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b307597f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.565942:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3075971 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.565947:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3075971 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.565951:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3075971 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.565955:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3075971 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.565958:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26c00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290430.565960:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3075971 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.565964:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3075971 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.565970:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:0.0:1784290430.565971:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290430.565974:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3075971 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.565995:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3075971 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290430.566003:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000322f9da0 reply state 00000000d5f5d956 transno 120259084302 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b3075978 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.566015:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b3075978 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.566020:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x74f887a3 (ffff9c2474f5fe00) 00010000:00010000:0.0:1784290430.566022:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290430.566024:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784290430.566040:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b307596a lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2662 expref: 36 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.566049:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b307597f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2662 expref: 35 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.566054:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9c2474f5f200) 00010000:00010000:0.0:1784290430.566056:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784290430.566058:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26200, rc 0) 00000100:00100000:0.0:1784290430.566086:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+36:73314:x1870961896289536:12345-192.168.202.6@tcp:101:touch.0 Request processed in 475us (549us total) trans 120259084302 rc 0/0 00000100:00100000:0.0:1784290430.566091:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1324 00000100:00100000:1.0:1784290430.567096:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.567134:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896289792 00000100:00100000:3.0:1784290430.567141:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896289792 00000100:00100000:3.0:1784290430.567176:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1325 00000100:00100000:3.0:1784290430.567186:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+36:73314:x1870961896289792:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:3.0:1784290430.567210:0:65988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290430.567223:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b307597f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2662 expref: 36 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.567237:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9c2474f5f200) 00010000:00010000:3.0:1784290430.567245:0:65988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290430.567267:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b307598d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.567277:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b307598d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.567299:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b307598d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.567376:0:65988:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000cfee68d reply state 0000000073a8442f transno 120259084303 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b307598d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.567389:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b307598d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.567397:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9c24821d9e00) 00010000:00010000:3.0:1784290430.567401:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.567403:0:65988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290430.567456:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+37:73314:x1870961896289792:12345-192.168.202.6@tcp:36:touch.0 Request processed in 270us (358us total) trans 120259084303 rc 0/0 00000100:00100000:3.0:1784290430.567466:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1325 00000100:00100000:1.0:1784290430.568066:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.568098:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896289920 00000100:00100000:0.0:1784290430.568104:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896289920 00000100:00100000:0.0:1784290430.568133:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1326 00000100:00100000:0.0:1784290430.568141:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ded8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+37:73314:x1870961896289920:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.568150:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.568158:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3075994 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2669 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.568181:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3075994 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2669 expref: 38 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.568197:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26a00/0x5953bbf6b3075994 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2669 expref: 38 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.568208:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9c24821d9e00) 00010000:00010000:0.0:1784290430.568210:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784290430.568212:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26a00, rc 0) 00000100:00100000:0.0:1784290430.568240:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ded8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+38:73314:x1870961896289920:12345-192.168.202.6@tcp:101:touch.0 Request processed in 101us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290430.568246:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1326 00000100:00100000:1.0:1784290430.568999:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.569043:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896290048 00000100:00100000:0.0:1784290430.569049:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896290048 00000100:00100000:0.0:1784290430.569086:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4982 00000100:00100000:0.0:1784290430.569095:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ded8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:2400:x1870961896290048:12345-192.168.202.6@tcp:2:touch.0 00000100:00100000:0.0:1784290430.569189:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ded8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:2400:x1870961896290048:12345-192.168.202.6@tcp:2:touch.0 Request processed in 96us (190us total) trans 4294968636 rc 0/0 00000100:00100000:0.0:1784290430.569196:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4982 00000100:00100000:1.0:1784290430.570142:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.570172:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896290304 00000100:00100000:3.0:1784290430.570177:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896290304 00000100:00100000:3.0:1784290430.570201:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 244 00000100:00100000:3.0:1784290430.570209:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+38:73314:x1870961896290304:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:3.0:1784290430.570301:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+39:73314:x1870961896290304:12345-192.168.202.6@tcp:35:touch.0 Request processed in 93us (161us total) trans 120259084304 rc 0/0 00000100:00100000:3.0:1784290430.570308:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 244 00000100:00100000:1.0:1784290430.571338:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.571389:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896290560 00000100:00100000:3.0:1784290430.571396:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896290560 00000100:00100000:3.0:1784290430.571433:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1327 00000100:00100000:3.0:1784290430.571443:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+39:73314:x1870961896290560:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:3.0:1784290430.571455:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290430.571472:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b307599b lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2670 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.571520:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30759a2 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.571531:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30759a2 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.571541:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30759a2 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.571554:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30759a9 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.571563:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30759a9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.571571:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30759a9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784290430.571737:0:74876:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x766:0x0], index 0: 0 00010000:00010000:3.0:1784290430.571828:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b30759b0 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.571839:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b30759b0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.571850:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b30759b0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.571881:0:74876:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30759a2 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.571902:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30759a2 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.571910:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30759a2 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.571918:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30759a2 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.571924:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450abc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290430.571929:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30759a2 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.571937:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30759a2 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.571947:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:3.0:1784290430.571951:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290430.571955:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30759a2 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.571963:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30759a2 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.571974:0:74876:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a2fa08a8 reply state 00000000f448afb3 transno 120259084305 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30759a9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.572001:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30759a9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.572020:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xbd5240a3 (ffff9c24821d9100) 00010000:00010000:3.0:1784290430.572029:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.572032:0:74876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784290430.572052:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b307599b lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2670 expref: 42 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.572066:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b30759b0 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2670 expref: 41 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.572075:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9c2446227c00) 00010000:00010000:3.0:1784290430.572078:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784290430.572081:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aa600, rc 0) 00000100:00100000:3.0:1784290430.572116:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+42:73314:x1870961896290560:12345-192.168.202.6@tcp:101:touch.0 Request processed in 674us (778us total) trans 120259084305 rc 0/0 00000100:00100000:3.0:1784290430.572124:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1327 00000100:00100000:1.0:1784290430.573522:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.573552:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896290816 00000100:00100000:3.0:1784290430.573557:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896290816 00000100:00100000:3.0:1784290430.573582:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1328 00000100:00100000:3.0:1784290430.573588:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+42:73314:x1870961896290816:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:3.0:1784290430.573607:0:65989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290430.573616:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b30759b0 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2670 expref: 42 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.573624:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9c2446227c00) 00010000:00010000:3.0:1784290430.573630:0:65989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290430.573645:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b30759be lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.573652:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b30759be lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.573663:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b30759be lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.573703:0:65989:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ef6018e reply state 00000000eb9347bc transno 120259084306 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b30759be lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.573714:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b30759be lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.573720:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9c2446227300) 00010000:00010000:3.0:1784290430.573723:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.573726:0:65989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290430.573769:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+43:73314:x1870961896290816:12345-192.168.202.6@tcp:36:touch.0 Request processed in 181us (248us total) trans 120259084306 rc 0/0 00000100:00100000:3.0:1784290430.573776:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1328 00000100:00100000:1.0:1784290430.574542:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.574573:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896290944 00000100:00100000:0.0:1784290430.574579:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896290944 00000100:00100000:0.0:1784290430.574609:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1329 00000100:00100000:0.0:1784290430.574617:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+43:73314:x1870961896290944:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.574626:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.574634:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b30759c5 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2677 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.574657:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b30759c5 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2677 expref: 44 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.574673:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27a00/0x5953bbf6b30759c5 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2677 expref: 44 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.574684:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9c2446227300) 00010000:00010000:0.0:1784290430.574686:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784290430.574688:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27a00, rc 0) 00000100:00100000:0.0:1784290430.574715:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+44:73314:x1870961896290944:12345-192.168.202.6@tcp:101:touch.0 Request processed in 100us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290430.574721:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1329 00000100:00100000:1.0:1784290430.575772:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.575817:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896291072 00000100:00100000:3.0:1784290430.575823:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896291072 00000100:00100000:3.0:1784290430.575860:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4983 00000100:00100000:3.0:1784290430.575870:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:2398:x1870961896291072:12345-192.168.202.6@tcp:2:touch.0 00000100:00100000:3.0:1784290430.575967:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:2398:x1870961896291072:12345-192.168.202.6@tcp:2:touch.0 Request processed in 98us (194us total) trans 4294968637 rc 0/0 00000100:00100000:3.0:1784290430.575989:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4983 00000100:00100000:1.0:1784290430.576801:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290430.576865:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896291328 00000100:00100000:2.0:1784290430.576871:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896291328 00000100:00100000:2.0:1784290430.576900:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 245 00000100:00100000:2.0:1784290430.576906:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+44:73314:x1870961896291328:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:2.0:1784290430.577030:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+45:73314:x1870961896291328:12345-192.168.202.6@tcp:35:touch.0 Request processed in 123us (229us total) trans 120259084307 rc 0/0 00000100:00100000:2.0:1784290430.577045:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 245 00000100:00100000:1.0:1784290430.577885:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.577954:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896291584 00000100:00100000:0.0:1784290430.577960:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896291584 00000100:00100000:0.0:1784290430.578003:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1330 00000100:00100000:0.0:1784290430.578010:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+45:73314:x1870961896291584:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.578019:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.578026:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b30759cc lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b267e expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.578063:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30759d3 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.578071:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30759d3 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.578078:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30759d3 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.578087:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b30759da lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.578099:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b30759da lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.578104:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b30759da lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784290430.578208:0:66004:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x767:0x0], index 0: 0 00010000:00010000:0.0:1784290430.578269:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b30759e1 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.578277:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b30759e1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.578283:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b30759e1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.578298:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30759d3 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.578303:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30759d3 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.578308:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30759d3 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.578311:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30759d3 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.578315:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27e00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290430.578317:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30759d3 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.578330:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30759d3 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.578336:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:0.0:1784290430.578361:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290430.578364:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30759d3 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.578370:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b30759d3 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290430.578378:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000043e5519b reply state 00000000bde4d8d7 transno 120259084308 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b30759da lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.578385:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b30759da lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.578390:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x5abf9a3 (ffff9c2474f5f700) 00010000:00010000:0.0:1784290430.578392:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290430.578393:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784290430.578410:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b30759cc lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b267e expref: 48 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.578426:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b30759e1 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b267e expref: 47 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.578432:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9c2474f5f900) 00010000:00010000:0.0:1784290430.578433:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784290430.578435:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27000, rc 0) 00000100:00100000:0.0:1784290430.578468:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+48:73314:x1870961896291584:12345-192.168.202.6@tcp:101:touch.0 Request processed in 459us (584us total) trans 120259084308 rc 0/0 00000100:00100000:0.0:1784290430.578474:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1330 00000100:00100000:1.0:1784290430.579542:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.579572:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896291840 00000100:00100000:3.0:1784290430.579577:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896291840 00000100:00100000:3.0:1784290430.579603:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1331 00000100:00100000:3.0:1784290430.579610:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+48:73314:x1870961896291840:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:3.0:1784290430.579637:0:65988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290430.579650:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b30759e1 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b267e expref: 48 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.579658:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9c2474f5f900) 00010000:00010000:3.0:1784290430.579663:0:65988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290430.579681:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b30759ef lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.579690:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b30759ef lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.579699:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b30759ef lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.579744:0:65988:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000010b1c053 reply state 00000000e409f7e3 transno 120259084309 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b30759ef lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.579755:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b30759ef lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.579762:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9c2446227a00) 00010000:00010000:3.0:1784290430.579764:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.579766:0:65988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290430.579812:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+49:73314:x1870961896291840:12345-192.168.202.6@tcp:36:touch.0 Request processed in 203us (271us total) trans 120259084309 rc 0/0 00000100:00100000:3.0:1784290430.579818:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1331 00000100:00100000:1.0:1784290430.580564:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.580599:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896291968 00000100:00100000:0.0:1784290430.580604:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896291968 00000100:00100000:0.0:1784290430.580635:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1332 00000100:00100000:0.0:1784290430.580642:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+49:73314:x1870961896291968:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.580651:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.580660:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de600/0x5953bbf6b30759f6 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2685 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.580682:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de600/0x5953bbf6b30759f6 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2685 expref: 50 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.580691:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de600/0x5953bbf6b30759f6 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2685 expref: 50 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.580700:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9c2446227a00) 00010000:00010000:0.0:1784290430.580703:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784290430.580705:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24429de600, rc 0) 00000100:00100000:0.0:1784290430.580733:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+50:73314:x1870961896291968:12345-192.168.202.6@tcp:101:touch.0 Request processed in 92us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290430.580738:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1332 00000100:00100000:1.0:1784290430.581563:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.581595:0:26257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896292096 00000100:00100000:0.0:1784290430.581599:0:26257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896292096 00000100:00100000:0.0:1784290430.581624:0:26257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4984 00000100:00100000:0.0:1784290430.581630:0:26257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:2400:x1870961896292096:12345-192.168.202.6@tcp:2:touch.0 00000100:00100000:0.0:1784290430.581720:0:26257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:2400:x1870961896292096:12345-192.168.202.6@tcp:2:touch.0 Request processed in 90us (159us total) trans 4294968638 rc 0/0 00000100:00100000:0.0:1784290430.581726:0:26257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4984 00000100:00100000:1.0:1784290430.582411:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.582441:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896292352 00000100:00100000:3.0:1784290430.582446:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896292352 00000100:00100000:3.0:1784290430.582470:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 246 00000100:00100000:3.0:1784290430.582475:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+50:73314:x1870961896292352:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:3.0:1784290430.582572:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+51:73314:x1870961896292352:12345-192.168.202.6@tcp:35:touch.0 Request processed in 96us (162us total) trans 120259084310 rc 0/0 00000100:00100000:3.0:1784290430.582577:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 246 00000100:00100000:1.0:1784290430.583288:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.583318:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896292608 00000100:00100000:3.0:1784290430.583322:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896292608 00000100:00100000:3.0:1784290430.583362:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1333 00000100:00100000:3.0:1784290430.583368:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+51:73314:x1870961896292608:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:3.0:1784290430.583376:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290430.583383:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30759fd lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b268c expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.583415:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075a04 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.583422:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075a04 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.583427:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075a04 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.583435:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b3075a0b lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.583439:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b3075a0b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.583444:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b3075a0b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784290430.583538:0:74876:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x768:0x0], index 0: 0 00010000:00010000:3.0:1784290430.583604:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff200/0x5953bbf6b3075a12 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.583611:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff200/0x5953bbf6b3075a12 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.583616:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff200/0x5953bbf6b3075a12 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.583630:0:74876:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075a04 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.583635:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075a04 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.583639:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075a04 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.583643:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075a04 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.583646:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450abc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290430.583648:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075a04 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.583652:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075a04 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.583657:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:3.0:1784290430.583659:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290430.583661:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075a04 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.583673:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075a04 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.583680:0:74876:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000362b04ff reply state 0000000008ad58f5 transno 120259084311 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b3075a0b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.583690:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b3075a0b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.583697:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x4e05b2a3 (ffff9c2446227400) 00010000:00010000:3.0:1784290430.583700:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.583702:0:74876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784290430.583723:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30759fd lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b268c expref: 54 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.583736:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff200/0x5953bbf6b3075a12 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b268c expref: 53 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.583742:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9c2446227f00) 00010000:00010000:3.0:1784290430.583743:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784290430.583745:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2ff200, rc 0) 00000100:00100000:3.0:1784290430.583771:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+54:73314:x1870961896292608:12345-192.168.202.6@tcp:101:touch.0 Request processed in 403us (484us total) trans 120259084311 rc 0/0 00000100:00100000:3.0:1784290430.583776:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1333 00000100:00100000:1.0:1784290430.584853:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.584883:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896292864 00000100:00100000:3.0:1784290430.584888:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896292864 00000100:00100000:3.0:1784290430.584912:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1334 00000100:00100000:3.0:1784290430.584917:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+54:73314:x1870961896292864:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:3.0:1784290430.584940:0:65989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290430.584949:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff200/0x5953bbf6b3075a12 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b268c expref: 54 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.584957:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9c2446227f00) 00010000:00010000:3.0:1784290430.584962:0:65989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290430.584992:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3075a20 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.584998:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3075a20 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.585004:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3075a20 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.585036:0:65989:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009bad8dad reply state 000000003f0e5a91 transno 120259084312 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3075a20 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.585043:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3075a20 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.585047:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9c2446227e00) 00010000:00010000:3.0:1784290430.585049:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.585050:0:65989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290430.585087:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+55:73314:x1870961896292864:12345-192.168.202.6@tcp:36:touch.0 Request processed in 169us (235us total) trans 120259084312 rc 0/0 00000100:00100000:3.0:1784290430.585092:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1334 00000100:00100000:1.0:1784290430.585822:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.585891:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896292992 00000100:00100000:0.0:1784290430.585897:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896292992 00000100:00100000:0.0:1784290430.585928:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1335 00000100:00100000:0.0:1784290430.585934:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+55:73314:x1870961896292992:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.585944:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.585953:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de400/0x5953bbf6b3075a27 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2693 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.585975:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de400/0x5953bbf6b3075a27 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2693 expref: 56 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.585999:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de400/0x5953bbf6b3075a27 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2693 expref: 56 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.586010:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9c2446227e00) 00010000:00010000:0.0:1784290430.586012:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784290430.586015:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24429de400, rc 0) 00000100:00100000:0.0:1784290430.586041:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+56:73314:x1870961896292992:12345-192.168.202.6@tcp:101:touch.0 Request processed in 107us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290430.586047:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1335 00000100:00100000:1.0:1784290430.586968:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290430.587048:0:26261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896293120 00000100:00100000:2.0:1784290430.587053:0:26261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896293120 00000100:00100000:2.0:1784290430.587085:0:26261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4985 00000100:00100000:2.0:1784290430.587092:0:26261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:2400:x1870961896293120:12345-192.168.202.6@tcp:2:touch.0 00000100:00100000:2.0:1784290430.587178:0:26261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+12:2400:x1870961896293120:12345-192.168.202.6@tcp:2:touch.0 Request processed in 86us (211us total) trans 4294968639 rc 0/0 00000100:00100000:2.0:1784290430.587184:0:26261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4985 00000100:00100000:1.0:1784290430.588031:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290430.588082:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896293376 00000100:00100000:2.0:1784290430.588088:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896293376 00000100:00100000:2.0:1784290430.588116:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 247 00000100:00100000:2.0:1784290430.588122:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+56:73314:x1870961896293376:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:2.0:1784290430.588225:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+57:73314:x1870961896293376:12345-192.168.202.6@tcp:35:touch.0 Request processed in 103us (194us total) trans 120259084313 rc 0/0 00000100:00100000:2.0:1784290430.588232:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 247 00000100:00100000:1.0:1784290430.589149:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.589192:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896293632 00000100:00100000:0.0:1784290430.589197:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896293632 00000100:00100000:0.0:1784290430.589228:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1336 00000100:00100000:0.0:1784290430.589234:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+57:73314:x1870961896293632:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.589250:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.589259:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dec00/0x5953bbf6b3075a2e lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b269a expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.589296:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075a35 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.589304:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075a35 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.589311:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075a35 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.589319:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3075a3c lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.589324:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3075a3c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.589329:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3075a3c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784290430.589466:0:66004:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x769:0x0], index 0: 0 00010000:00010000:0.0:1784290430.589538:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df400/0x5953bbf6b3075a43 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.589544:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df400/0x5953bbf6b3075a43 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.589550:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df400/0x5953bbf6b3075a43 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.589576:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075a35 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.589581:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075a35 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.589586:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075a35 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.589590:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075a35 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.589593:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429dfe00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290430.589595:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075a35 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.589599:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075a35 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.589605:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:0.0:1784290430.589607:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290430.589609:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075a35 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.589613:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075a35 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290430.589622:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003c9bfba3 reply state 000000000d670c11 transno 120259084314 ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3075a3c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.589629:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3075a3c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.589639:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x965f6ba3 (ffff9c2474f5f100) 00010000:00010000:0.0:1784290430.589641:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290430.589642:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784290430.589658:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dec00/0x5953bbf6b3075a2e lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b269a expref: 60 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.589668:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df400/0x5953bbf6b3075a43 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b269a expref: 59 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.589674:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9c2474f5ff00) 00010000:00010000:0.0:1784290430.589676:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784290430.589677:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24429df400, rc 0) 00000100:00100000:0.0:1784290430.589706:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+60:73314:x1870961896293632:12345-192.168.202.6@tcp:101:touch.0 Request processed in 473us (559us total) trans 120259084314 rc 0/0 00000100:00100000:0.0:1784290430.589711:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1336 00000100:00100000:1.0:1784290430.590894:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.590930:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896293888 00000100:00100000:3.0:1784290430.590935:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896293888 00000100:00100000:3.0:1784290430.590967:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1337 00000100:00100000:3.0:1784290430.590997:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+60:73314:x1870961896293888:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:3.0:1784290430.591020:0:65988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290430.591032:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df400/0x5953bbf6b3075a43 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b269a expref: 60 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.591044:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9c2474f5ff00) 00010000:00010000:3.0:1784290430.591051:0:65988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290430.591074:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3075a51 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.591083:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3075a51 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.591090:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3075a51 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.591133:0:65988:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cff1e5e0 reply state 0000000045bf9255 transno 120259084315 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3075a51 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.591144:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3075a51 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.591151:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9c2446227c00) 00010000:00010000:3.0:1784290430.591154:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.591156:0:65988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290430.591205:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+61:73314:x1870961896293888:12345-192.168.202.6@tcp:36:touch.0 Request processed in 210us (311us total) trans 120259084315 rc 0/0 00000100:00100000:3.0:1784290430.591214:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1337 00000100:00100000:1.0:1784290430.592020:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.592063:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896294016 00000100:00100000:0.0:1784290430.592069:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896294016 00000100:00100000:0.0:1784290430.592100:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1338 00000100:00100000:0.0:1784290430.592106:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+61:73314:x1870961896294016:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.592116:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.592125:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3075a58 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b26a1 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.592148:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3075a58 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26a1 expref: 62 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.592156:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dee00/0x5953bbf6b3075a58 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26a1 expref: 62 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.592174:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9c2446227c00) 00010000:00010000:0.0:1784290430.592176:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784290430.592178:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24429dee00, rc 0) 00000100:00100000:0.0:1784290430.592206:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+62:73314:x1870961896294016:12345-192.168.202.6@tcp:101:touch.0 Request processed in 101us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290430.592213:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1338 00000100:00100000:1.0:1784290430.593112:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.593154:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896294144 00000100:00100000:3.0:1784290430.593160:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896294144 00000100:00100000:3.0:1784290430.593201:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4986 00000100:00100000:3.0:1784290430.593211:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+12:2399:x1870961896294144:12345-192.168.202.6@tcp:2:touch.0 00000100:00100000:3.0:1784290430.593312:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+13:2399:x1870961896294144:12345-192.168.202.6@tcp:2:touch.0 Request processed in 101us (199us total) trans 4294968640 rc 0/0 00000100:00100000:3.0:1784290430.593321:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4986 00000100:00100000:1.0:1784290430.594410:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.594441:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896294400 00000100:00100000:3.0:1784290430.594445:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896294400 00000100:00100000:3.0:1784290430.594469:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 248 00000100:00100000:3.0:1784290430.594475:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c209c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+62:73314:x1870961896294400:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:3.0:1784290430.594569:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c209c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+63:73314:x1870961896294400:12345-192.168.202.6@tcp:35:touch.0 Request processed in 94us (161us total) trans 120259084316 rc 0/0 00000100:00100000:3.0:1784290430.594575:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 248 00000100:00100000:1.0:1784290430.595681:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.595714:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896294656 00000100:00100000:3.0:1784290430.595720:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896294656 00000100:00100000:3.0:1784290430.595750:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1339 00000100:00100000:3.0:1784290430.595756:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+63:73314:x1870961896294656:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:3.0:1784290430.595764:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290430.595771:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff200/0x5953bbf6b3075a5f lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b26a8 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.595806:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075a66 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.595814:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075a66 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.595819:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075a66 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.595833:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075a6d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.595838:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075a6d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.595843:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075a6d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784290430.595964:0:74876:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76a:0x0], index 0: 0 00010000:00010000:3.0:1784290430.596045:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3075a74 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.596052:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3075a74 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.596057:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3075a74 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.596071:0:74876:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075a66 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.596076:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075a66 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.596080:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075a66 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.596084:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075a66 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.596087:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2ffe00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290430.596095:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075a66 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.596099:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075a66 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.596106:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:3.0:1784290430.596108:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290430.596110:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075a66 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.596115:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075a66 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.596121:0:74876:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fc4c3849 reply state 0000000078de3cc3 transno 120259084317 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075a6d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.596127:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075a6d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.596131:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xdeb924a3 (ffff9c2446227f00) 00010000:00010000:3.0:1784290430.596133:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.596134:0:74876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784290430.596148:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff200/0x5953bbf6b3075a5f lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26a8 expref: 66 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.596156:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3075a74 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26a8 expref: 65 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.596161:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9c2446227100) 00010000:00010000:3.0:1784290430.596162:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784290430.596168:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2ffc00, rc 0) 00000100:00100000:3.0:1784290430.596195:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+66:73314:x1870961896294656:12345-192.168.202.6@tcp:101:touch.0 Request processed in 439us (515us total) trans 120259084317 rc 0/0 00000100:00100000:3.0:1784290430.596200:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1339 00000100:00100000:1.0:1784290430.597736:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.597775:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896294912 00000100:00100000:3.0:1784290430.597791:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896294912 00000100:00100000:3.0:1784290430.597826:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1340 00000100:00100000:3.0:1784290430.597836:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+66:73314:x1870961896294912:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:3.0:1784290430.597860:0:65989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290430.597873:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3075a74 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26a8 expref: 66 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.597887:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9c2446227100) 00010000:00010000:3.0:1784290430.597900:0:65989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290430.597921:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3075a82 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.597932:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3075a82 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.597941:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3075a82 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.598014:0:65989:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000021249081 reply state 000000002796749a transno 120259084318 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3075a82 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.598036:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3075a82 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.598044:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9c2446227800) 00010000:00010000:3.0:1784290430.598053:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.598056:0:65989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290430.598104:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+67:73314:x1870961896294912:12345-192.168.202.6@tcp:36:touch.0 Request processed in 269us (367us total) trans 120259084318 rc 0/0 00000100:00100000:3.0:1784290430.598112:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1340 00000100:00100000:1.0:1784290430.599036:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.599087:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896295040 00000100:00100000:0.0:1784290430.599092:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896295040 00000100:00100000:0.0:1784290430.599122:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1341 00000100:00100000:0.0:1784290430.599128:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+67:73314:x1870961896295040:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.599138:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.599146:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dec00/0x5953bbf6b3075a89 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b26af expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.599169:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dec00/0x5953bbf6b3075a89 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26af expref: 68 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.599178:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dec00/0x5953bbf6b3075a89 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26af expref: 68 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.599188:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9c2446227800) 00010000:00010000:0.0:1784290430.599190:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784290430.599192:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24429dec00, rc 0) 00000100:00100000:0.0:1784290430.599219:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+68:73314:x1870961896295040:12345-192.168.202.6@tcp:101:touch.0 Request processed in 91us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290430.599226:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1341 00000100:00100000:1.0:1784290430.600416:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.600460:0:26251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896295168 00000100:00100000:3.0:1784290430.600465:0:26251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896295168 00000100:00100000:3.0:1784290430.600492:0:26251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4987 00000100:00100000:3.0:1784290430.600497:0:26251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+13:2398:x1870961896295168:12345-192.168.202.6@tcp:2:touch.0 00000100:00100000:3.0:1784290430.600570:0:26251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+14:2398:x1870961896295168:12345-192.168.202.6@tcp:2:touch.0 Request processed in 72us (154us total) trans 4294968641 rc 0/0 00000100:00100000:3.0:1784290430.600574:0:26251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4987 00000100:00100000:1.0:1784290430.601519:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290430.601551:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896295424 00000100:00100000:2.0:1784290430.601557:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896295424 00000100:00100000:2.0:1784290430.601585:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 249 00000100:00100000:2.0:1784290430.601592:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+68:73314:x1870961896295424:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:2.0:1784290430.601698:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+69:73314:x1870961896295424:12345-192.168.202.6@tcp:35:touch.0 Request processed in 106us (179us total) trans 120259084319 rc 0/0 00000100:00100000:2.0:1784290430.601705:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 249 00000100:00100000:1.0:1784290430.602801:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.602886:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896295680 00000100:00100000:0.0:1784290430.602891:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896295680 00000100:00100000:0.0:1784290430.602921:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1342 00000100:00100000:0.0:1784290430.602927:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+69:73314:x1870961896295680:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.602937:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.602945:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075a90 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b26b6 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.603003:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3075a97 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.603011:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3075a97 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.603017:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3075a97 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.603026:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3075a9e lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.603031:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3075a9e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.603036:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3075a9e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784290430.603139:0:66004:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76b:0x0], index 0: 0 00010000:00010000:0.0:1784290430.603199:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075aa5 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.603206:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075aa5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.603218:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075aa5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.603236:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3075a97 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.603241:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3075a97 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.603246:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3075a97 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.603249:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3075a97 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.603253:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429dfc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290430.603255:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3075a97 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.603259:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3075a97 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.603264:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:0.0:1784290430.603266:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290430.603268:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3075a97 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.603273:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3075a97 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290430.603281:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000020d89a02 reply state 000000007924946e transno 120259084320 ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3075a9e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.603292:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3075a9e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.603297:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x6e9b5ca3 (ffff9c2474f5f800) 00010000:00010000:0.0:1784290430.603299:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290430.603301:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784290430.603316:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075a90 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26b6 expref: 72 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.603325:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075aa5 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26b6 expref: 71 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.603330:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9c2474f5f000) 00010000:00010000:0.0:1784290430.603332:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784290430.603334:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24429df200, rc 0) 00000100:00100000:0.0:1784290430.603391:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+72:73314:x1870961896295680:12345-192.168.202.6@tcp:101:touch.0 Request processed in 463us (590us total) trans 120259084320 rc 0/0 00000100:00100000:0.0:1784290430.603397:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1342 00000100:00100000:1.0:1784290430.604500:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.604531:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896295936 00000100:00100000:3.0:1784290430.604536:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896295936 00000100:00100000:3.0:1784290430.604561:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1343 00000100:00100000:3.0:1784290430.604566:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+72:73314:x1870961896295936:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:3.0:1784290430.604586:0:65988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290430.604595:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075aa5 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26b6 expref: 72 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.604605:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9c2474f5f000) 00010000:00010000:3.0:1784290430.604610:0:65988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290430.604626:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b3075ab3 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.604633:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b3075ab3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.604647:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b3075ab3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.604682:0:65988:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001abb2479 reply state 00000000a7ba2991 transno 120259084321 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b3075ab3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.604694:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b3075ab3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.604701:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9c2446227500) 00010000:00010000:3.0:1784290430.604704:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.604706:0:65988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290430.604763:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+73:73314:x1870961896295936:12345-192.168.202.6@tcp:36:touch.0 Request processed in 195us (263us total) trans 120259084321 rc 0/0 00000100:00100000:3.0:1784290430.604772:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1343 00000100:00100000:1.0:1784290430.605531:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.605564:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896296064 00000100:00100000:0.0:1784290430.605570:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896296064 00000100:00100000:0.0:1784290430.605601:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1344 00000100:00100000:0.0:1784290430.605607:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+73:73314:x1870961896296064:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.605616:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.605625:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df400/0x5953bbf6b3075aba lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b26bd expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.605650:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df400/0x5953bbf6b3075aba lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26bd expref: 74 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.605666:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df400/0x5953bbf6b3075aba lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26bd expref: 74 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.605677:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9c2446227500) 00010000:00010000:0.0:1784290430.605680:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784290430.605682:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24429df400, rc 0) 00000100:00100000:0.0:1784290430.605710:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+74:73314:x1870961896296064:12345-192.168.202.6@tcp:101:touch.0 Request processed in 103us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290430.605716:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1344 00000100:00100000:1.0:1784290430.606705:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.606739:0:26263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896296192 00000100:00100000:3.0:1784290430.606743:0:26263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896296192 00000100:00100000:3.0:1784290430.606770:0:26263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4988 00000100:00100000:3.0:1784290430.606775:0:26263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+14:2399:x1870961896296192:12345-192.168.202.6@tcp:2:touch.0 00000100:00100000:3.0:1784290430.606848:0:26263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+15:2399:x1870961896296192:12345-192.168.202.6@tcp:2:touch.0 Request processed in 72us (144us total) trans 4294968642 rc 0/0 00000100:00100000:3.0:1784290430.606853:0:26263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4988 00000100:00100000:1.0:1784290430.607642:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.607672:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896296448 00000100:00100000:3.0:1784290430.607677:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896296448 00000100:00100000:3.0:1784290430.607709:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 250 00000100:00100000:3.0:1784290430.607718:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+74:73314:x1870961896296448:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:3.0:1784290430.607817:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+75:73314:x1870961896296448:12345-192.168.202.6@tcp:35:touch.0 Request processed in 101us (176us total) trans 120259084322 rc 0/0 00000100:00100000:3.0:1784290430.607830:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 250 00000100:00100000:1.0:1784290430.608764:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.608802:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896296704 00000100:00100000:3.0:1784290430.608806:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896296704 00000100:00100000:3.0:1784290430.608830:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1345 00000100:00100000:3.0:1784290430.608835:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+75:73314:x1870961896296704:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:3.0:1784290430.608842:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290430.608849:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075ac1 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b26c4 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.608882:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075ac8 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.608889:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075ac8 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.608895:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075ac8 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.608905:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075acf lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.608909:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075acf lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.608914:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075acf lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784290430.609032:0:74876:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76c:0x0], index 0: 0 00010000:00010000:3.0:1784290430.609093:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075ad6 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.609107:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075ad6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.609112:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075ad6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.609130:0:74876:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075ac8 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.609135:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075ac8 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.609139:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075ac8 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.609143:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075ac8 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.609146:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290430.609148:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075ac8 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.609152:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075ac8 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.609157:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:3.0:1784290430.609159:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290430.609161:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075ac8 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.609164:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075ac8 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.609175:0:74876:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e1abb1a8 reply state 00000000839f48b0 transno 120259084323 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075acf lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.609181:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075acf lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.609185:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8545ca3 (ffff9c2446227d00) 00010000:00010000:3.0:1784290430.609187:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.609188:0:74876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784290430.609201:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075ac1 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26c4 expref: 78 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.609209:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075ad6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26c4 expref: 77 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.609213:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9c2446227900) 00010000:00010000:3.0:1784290430.609215:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784290430.609217:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2482045000, rc 0) 00000100:00100000:3.0:1784290430.609242:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+78:73314:x1870961896296704:12345-192.168.202.6@tcp:101:touch.0 Request processed in 407us (480us total) trans 120259084323 rc 0/0 00000100:00100000:3.0:1784290430.609246:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1345 00000100:00100000:1.0:1784290430.610473:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.610505:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896296960 00000100:00100000:3.0:1784290430.610509:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896296960 00000100:00100000:3.0:1784290430.610533:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1346 00000100:00100000:3.0:1784290430.610538:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+78:73314:x1870961896296960:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:3.0:1784290430.610566:0:65989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290430.610575:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075ad6 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26c4 expref: 78 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.610587:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9c2446227900) 00010000:00010000:3.0:1784290430.610591:0:65989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290430.610607:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3075ae4 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.610613:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3075ae4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.610619:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3075ae4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.610649:0:65989:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000775c4193 reply state 0000000087ef969d transno 120259084324 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3075ae4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.610656:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3075ae4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.610661:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9c2446227100) 00010000:00010000:3.0:1784290430.610662:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.610664:0:65989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290430.610705:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+79:73314:x1870961896296960:12345-192.168.202.6@tcp:36:touch.0 Request processed in 165us (231us total) trans 120259084324 rc 0/0 00000100:00100000:3.0:1784290430.610713:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1346 00000100:00100000:1.0:1784290430.611487:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.611519:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896297088 00000100:00100000:0.0:1784290430.611525:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896297088 00000100:00100000:0.0:1784290430.611555:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1347 00000100:00100000:0.0:1784290430.611562:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+79:73314:x1870961896297088:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.611572:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.611580:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b3075aeb lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b26cb expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.611604:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b3075aeb lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26cb expref: 80 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.611613:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27000/0x5953bbf6b3075aeb lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26cb expref: 80 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.611622:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9c2446227100) 00010000:00010000:0.0:1784290430.611625:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784290430.611633:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27000, rc 0) 00000100:00100000:0.0:1784290430.611662:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+80:73314:x1870961896297088:12345-192.168.202.6@tcp:101:touch.0 Request processed in 101us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290430.611668:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1347 00000100:00100000:1.0:1784290430.612558:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.612597:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896297216 00000100:00100000:3.0:1784290430.612603:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896297216 00000100:00100000:3.0:1784290430.612638:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4989 00000100:00100000:3.0:1784290430.612648:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+15:2399:x1870961896297216:12345-192.168.202.6@tcp:2:touch.0 00000100:00100000:3.0:1784290430.612749:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+16:2399:x1870961896297216:12345-192.168.202.6@tcp:2:touch.0 Request processed in 102us (190us total) trans 4294968643 rc 0/0 00000100:00100000:3.0:1784290430.612766:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4989 00000100:00100000:1.0:1784290430.613629:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290430.613705:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896297472 00000100:00100000:2.0:1784290430.613711:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896297472 00000100:00100000:2.0:1784290430.613739:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 251 00000100:00100000:2.0:1784290430.613753:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+80:73314:x1870961896297472:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:2.0:1784290430.613857:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+81:73314:x1870961896297472:12345-192.168.202.6@tcp:35:touch.0 Request processed in 105us (228us total) trans 120259084325 rc 0/0 00000100:00100000:2.0:1784290430.613863:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 251 00000100:00100000:1.0:1784290430.614774:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.614850:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896297728 00000100:00100000:0.0:1784290430.614855:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896297728 00000100:00100000:0.0:1784290430.614884:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1348 00000100:00100000:0.0:1784290430.614890:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+81:73314:x1870961896297728:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.614899:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.614907:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3075af2 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b26d2 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.614945:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075af9 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.614953:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075af9 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.614959:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075af9 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.614968:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4600/0x5953bbf6b3075b00 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.614973:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4600/0x5953bbf6b3075b00 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.614994:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4600/0x5953bbf6b3075b00 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784290430.615096:0:66004:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76d:0x0], index 0: 0 00010000:00010000:0.0:1784290430.615167:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5e00/0x5953bbf6b3075b07 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.615174:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5e00/0x5953bbf6b3075b07 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.615179:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5e00/0x5953bbf6b3075b07 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.615195:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075af9 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.615200:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075af9 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.615205:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075af9 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.615209:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075af9 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.615212:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27e00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290430.615214:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075af9 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.615218:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075af9 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.615223:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:0.0:1784290430.615225:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290430.615228:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075af9 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.615240:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075af9 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290430.615248:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb313400 reply state 00000000b39311f6 transno 120259084326 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4600/0x5953bbf6b3075b00 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.615254:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4600/0x5953bbf6b3075b00 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.615259:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x220d5ca3 (ffff9c2474f5f400) 00010000:00010000:0.0:1784290430.615261:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290430.615263:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784290430.615278:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3075af2 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26d2 expref: 84 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.615287:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5e00/0x5953bbf6b3075b07 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26d2 expref: 83 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.615292:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9c2474f5fc00) 00010000:00010000:0.0:1784290430.615294:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784290430.615295:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2f5e00, rc 0) 00000100:00100000:0.0:1784290430.615324:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+84:73314:x1870961896297728:12345-192.168.202.6@tcp:101:touch.0 Request processed in 434us (552us total) trans 120259084326 rc 0/0 00000100:00100000:0.0:1784290430.615329:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1348 00000100:00100000:1.0:1784290430.616474:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.616511:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896297984 00000100:00100000:3.0:1784290430.616517:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896297984 00000100:00100000:3.0:1784290430.616549:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1349 00000100:00100000:3.0:1784290430.616559:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+84:73314:x1870961896297984:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:3.0:1784290430.616584:0:65988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290430.616596:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5e00/0x5953bbf6b3075b07 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26d2 expref: 84 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.616611:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9c2474f5fc00) 00010000:00010000:3.0:1784290430.616618:0:65988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290430.616641:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3075b15 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.616651:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3075b15 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.616660:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3075b15 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.616708:0:65988:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c5979f70 reply state 00000000b5ea9925 transno 120259084327 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3075b15 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.616721:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3075b15 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.616729:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9c2446227b00) 00010000:00010000:3.0:1784290430.616732:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.616741:0:65988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290430.616801:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+85:73314:x1870961896297984:12345-192.168.202.6@tcp:36:touch.0 Request processed in 242us (326us total) trans 120259084327 rc 0/0 00000100:00100000:3.0:1784290430.616809:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1349 00000100:00100000:1.0:1784290430.617621:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.617686:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896298112 00000100:00100000:0.0:1784290430.617691:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896298112 00000100:00100000:0.0:1784290430.617723:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1350 00000100:00100000:0.0:1784290430.617731:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+85:73314:x1870961896298112:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.617747:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.617755:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4a00/0x5953bbf6b3075b1c lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b26d9 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.617781:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4a00/0x5953bbf6b3075b1c lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26d9 expref: 86 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.617800:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4a00/0x5953bbf6b3075b1c lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26d9 expref: 86 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.617814:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9c2446227b00) 00010000:00010000:0.0:1784290430.617817:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784290430.617820:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2f4a00, rc 0) 00000100:00100000:0.0:1784290430.617857:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+86:73314:x1870961896298112:12345-192.168.202.6@tcp:101:touch.0 Request processed in 126us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290430.617867:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1350 00000100:00100000:1.0:1784290430.618802:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.618835:0:26253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896298240 00000100:00100000:3.0:1784290430.618840:0:26253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896298240 00000100:00100000:3.0:1784290430.618867:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4990 00000100:00100000:3.0:1784290430.618872:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+16:2399:x1870961896298240:12345-192.168.202.6@tcp:2:touch.0 00000100:00100000:3.0:1784290430.618954:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+17:2399:x1870961896298240:12345-192.168.202.6@tcp:2:touch.0 Request processed in 81us (154us total) trans 4294968644 rc 0/0 00000100:00100000:3.0:1784290430.618960:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4990 00000100:00100000:1.0:1784290430.619747:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.619787:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896298496 00000100:00100000:3.0:1784290430.619793:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896298496 00000100:00100000:3.0:1784290430.619826:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 252 00000100:00100000:3.0:1784290430.619836:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+86:73314:x1870961896298496:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:3.0:1784290430.619961:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+87:73314:x1870961896298496:12345-192.168.202.6@tcp:35:touch.0 Request processed in 126us (213us total) trans 120259084328 rc 0/0 00000100:00100000:3.0:1784290430.619971:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 252 00000100:00100000:1.0:1784290430.620910:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.620947:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896298752 00000100:00100000:3.0:1784290430.620953:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896298752 00000100:00100000:3.0:1784290430.620999:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1351 00000100:00100000:3.0:1784290430.621009:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+87:73314:x1870961896298752:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:3.0:1784290430.621020:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290430.621030:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075b23 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b26e0 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.621073:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075b2a lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.621089:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075b2a lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.621098:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075b2a lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.621111:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075b31 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.621118:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075b31 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.621126:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075b31 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784290430.621284:0:74876:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76e:0x0], index 0: 0 00010000:00010000:3.0:1784290430.621394:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075b38 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.621407:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075b38 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.621416:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075b38 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.621438:0:74876:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075b2a lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.621446:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075b2a lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.621454:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075b2a lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.621472:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075b2a lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.621478:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482044c00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290430.621482:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075b2a lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.621490:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075b2a lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.621500:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:3.0:1784290430.621503:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290430.621507:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075b2a lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.621514:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075b2a lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.621527:0:74876:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004fcf7081 reply state 00000000f08b8746 transno 120259084329 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075b31 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.621537:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075b31 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.621544:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x7bc65ca3 (ffff9c2446227900) 00010000:00010000:3.0:1784290430.621547:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.621549:0:74876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784290430.621568:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075b23 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26e0 expref: 90 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.621583:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075b38 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26e0 expref: 89 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.621600:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9c2446227000) 00010000:00010000:3.0:1784290430.621603:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784290430.621607:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450abc00, rc 0) 00000100:00100000:3.0:1784290430.621642:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+90:73314:x1870961896298752:12345-192.168.202.6@tcp:101:touch.0 Request processed in 634us (731us total) trans 120259084329 rc 0/0 00000100:00100000:3.0:1784290430.621652:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1351 00000100:00100000:1.0:1784290430.622715:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.622753:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896299008 00000100:00100000:3.0:1784290430.622757:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896299008 00000100:00100000:3.0:1784290430.622783:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1352 00000100:00100000:3.0:1784290430.622792:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+90:73314:x1870961896299008:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:3.0:1784290430.622810:0:65989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290430.622820:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075b38 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26e0 expref: 90 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.622829:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9c2446227000) 00010000:00010000:3.0:1784290430.622834:0:65989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290430.622849:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075b46 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.622856:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075b46 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.622861:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075b46 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.622901:0:65989:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000003cd8f53 reply state 000000002f39d5d9 transno 120259084330 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075b46 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.622918:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075b46 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.622923:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9c2446227200) 00010000:00010000:3.0:1784290430.622926:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.622927:0:65989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290430.622966:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+91:73314:x1870961896299008:12345-192.168.202.6@tcp:36:touch.0 Request processed in 173us (251us total) trans 120259084330 rc 0/0 00000100:00100000:3.0:1784290430.622972:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1352 00000100:00100000:1.0:1784290430.623738:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.623816:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896299136 00000100:00100000:0.0:1784290430.623821:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896299136 00000100:00100000:0.0:1784290430.623851:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1353 00000100:00100000:0.0:1784290430.623858:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+91:73314:x1870961896299136:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.623868:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.623876:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5000/0x5953bbf6b3075b4d lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b26e7 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.623900:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5000/0x5953bbf6b3075b4d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26e7 expref: 92 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.623920:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5000/0x5953bbf6b3075b4d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26e7 expref: 92 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.623931:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9c2446227200) 00010000:00010000:0.0:1784290430.623933:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784290430.623935:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2f5000, rc 0) 00000100:00100000:0.0:1784290430.623962:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+92:73314:x1870961896299136:12345-192.168.202.6@tcp:101:touch.0 Request processed in 105us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290430.623969:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1353 00000100:00100000:1.0:1784290430.624813:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.624844:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896299264 00000100:00100000:3.0:1784290430.624849:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896299264 00000100:00100000:3.0:1784290430.624873:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4991 00000100:00100000:3.0:1784290430.624878:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+17:2400:x1870961896299264:12345-192.168.202.6@tcp:2:touch.0 00000100:00100000:3.0:1784290430.624956:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+18:2400:x1870961896299264:12345-192.168.202.6@tcp:2:touch.0 Request processed in 76us (144us total) trans 4294968645 rc 0/0 00000100:00100000:3.0:1784290430.624961:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4991 00000100:00100000:1.0:1784290430.625691:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290430.625756:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896299520 00000100:00100000:2.0:1784290430.625762:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896299520 00000100:00100000:2.0:1784290430.625791:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 253 00000100:00100000:2.0:1784290430.625798:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+92:73314:x1870961896299520:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:2.0:1784290430.625906:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+93:73314:x1870961896299520:12345-192.168.202.6@tcp:35:touch.0 Request processed in 108us (215us total) trans 120259084331 rc 0/0 00000100:00100000:2.0:1784290430.625912:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 253 00000100:00100000:1.0:1784290430.626730:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.626803:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896299776 00000100:00100000:0.0:1784290430.626809:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896299776 00000100:00100000:0.0:1784290430.626837:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1354 00000100:00100000:0.0:1784290430.626844:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+93:73314:x1870961896299776:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.626853:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.626861:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4e00/0x5953bbf6b3075b54 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b26ee expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.626899:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5200/0x5953bbf6b3075b5b lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.626908:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5200/0x5953bbf6b3075b5b lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.626914:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5200/0x5953bbf6b3075b5b lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.626922:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5800/0x5953bbf6b3075b62 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.626934:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5800/0x5953bbf6b3075b62 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.626939:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5800/0x5953bbf6b3075b62 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784290430.627061:0:66004:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x76f:0x0], index 0: 0 00010000:00010000:0.0:1784290430.627123:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5c00/0x5953bbf6b3075b69 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.627131:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5c00/0x5953bbf6b3075b69 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.627136:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5c00/0x5953bbf6b3075b69 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.627150:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5200/0x5953bbf6b3075b5b lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.627155:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5200/0x5953bbf6b3075b5b lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.627160:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5200/0x5953bbf6b3075b5b lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.627164:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5200/0x5953bbf6b3075b5b lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.627167:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f5200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290430.627169:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5200/0x5953bbf6b3075b5b lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.627182:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5200/0x5953bbf6b3075b5b lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.627189:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:0.0:1784290430.627191:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290430.627193:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5200/0x5953bbf6b3075b5b lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.627198:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5200/0x5953bbf6b3075b5b lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290430.627206:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000483a8e13 reply state 00000000433950b9 transno 120259084332 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5800/0x5953bbf6b3075b62 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.627212:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5800/0x5953bbf6b3075b62 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.627217:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xd57f5ca3 (ffff9c2474f5f600) 00010000:00010000:0.0:1784290430.627218:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290430.627220:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784290430.627234:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4e00/0x5953bbf6b3075b54 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26ee expref: 96 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.627242:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5c00/0x5953bbf6b3075b69 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26ee expref: 95 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.627247:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9c2474f5fd00) 00010000:00010000:0.0:1784290430.627249:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784290430.627250:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2f5c00, rc 0) 00000100:00100000:0.0:1784290430.627284:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+96:73314:x1870961896299776:12345-192.168.202.6@tcp:101:touch.0 Request processed in 440us (554us total) trans 120259084332 rc 0/0 00000100:00100000:0.0:1784290430.627289:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1354 00000100:00100000:1.0:1784290430.628379:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.628420:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896300032 00000100:00100000:3.0:1784290430.628425:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896300032 00000100:00100000:3.0:1784290430.628452:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1355 00000100:00100000:3.0:1784290430.628458:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+96:73314:x1870961896300032:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:3.0:1784290430.628478:0:65988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290430.628487:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5c00/0x5953bbf6b3075b69 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26ee expref: 96 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.628496:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9c2474f5fd00) 00010000:00010000:3.0:1784290430.628501:0:65988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290430.628525:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075b77 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.628533:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075b77 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.628539:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075b77 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.628571:0:65988:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aeb5ebb7 reply state 00000000f7dc355c transno 120259084333 ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075b77 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.628578:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075b77 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.628583:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9c244c870d00) 00010000:00010000:3.0:1784290430.628585:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.628587:0:65988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290430.628623:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+97:73314:x1870961896300032:12345-192.168.202.6@tcp:36:touch.0 Request processed in 165us (247us total) trans 120259084333 rc 0/0 00000100:00100000:3.0:1784290430.628637:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1355 00000100:00100000:1.0:1784290430.629423:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.629457:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896300160 00000100:00100000:0.0:1784290430.629463:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896300160 00000100:00100000:0.0:1784290430.629497:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1356 00000100:00100000:0.0:1784290430.629505:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+97:73314:x1870961896300160:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.629514:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.629523:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4800/0x5953bbf6b3075b7e lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b26f5 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.629545:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4800/0x5953bbf6b3075b7e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26f5 expref: 98 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.629554:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4800/0x5953bbf6b3075b7e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26f5 expref: 98 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.629563:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9c244c870d00) 00010000:00010000:0.0:1784290430.629565:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784290430.629567:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2f4800, rc 0) 00000100:00100000:0.0:1784290430.629595:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+98:73314:x1870961896300160:12345-192.168.202.6@tcp:101:touch.0 Request processed in 92us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290430.629601:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1356 00000100:00100000:1.0:1784290430.630458:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.630490:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896300288 00000100:00100000:0.0:1784290430.630496:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896300288 00000100:00100000:0.0:1784290430.630527:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4992 00000100:00100000:0.0:1784290430.630533:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+18:2399:x1870961896300288:12345-192.168.202.6@tcp:2:touch.0 00000100:00100000:0.0:1784290430.630637:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+19:2399:x1870961896300288:12345-192.168.202.6@tcp:2:touch.0 Request processed in 104us (180us total) trans 4294968646 rc 0/0 00000100:00100000:0.0:1784290430.630644:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4992 00010000:00010000:0.0:1784290430.631440:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290430.631451:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.631484:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896300544 00000100:00100000:3.0:1784290430.631490:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896300544 00000100:00100000:3.0:1784290430.631515:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 254 00000100:00100000:3.0:1784290430.631522:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c208450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+98:73314:x1870961896300544:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:3.0:1784290430.631633:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c208450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+99:73314:x1870961896300544:12345-192.168.202.6@tcp:35:touch.0 Request processed in 111us (183us total) trans 120259084334 rc 0/0 00000100:00100000:3.0:1784290430.631639:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 254 00000100:00100000:1.0:1784290430.632474:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.632504:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896300800 00000100:00100000:3.0:1784290430.632509:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896300800 00000100:00100000:3.0:1784290430.632540:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1357 00000100:00100000:3.0:1784290430.632546:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+99:73314:x1870961896300800:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:3.0:1784290430.632555:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290430.632562:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3075b85 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b26fc expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.632597:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075b8c lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.632606:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075b8c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.632612:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075b8c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.632632:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075b93 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.632638:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075b93 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.632643:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075b93 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784290430.632764:0:74876:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x770:0x0], index 0: 0 00010000:00010000:3.0:1784290430.632833:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075b9a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.632840:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075b9a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.632846:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075b9a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.632878:0:74876:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075b8c lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.632883:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075b8c lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.632888:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075b8c lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.632892:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075b8c lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.632895:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429df200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290430.632897:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075b8c lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.632901:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075b8c lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.632907:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:3.0:1784290430.632909:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290430.632911:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075b8c lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.632915:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075b8c lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.632923:0:74876:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001b83680b reply state 00000000e9734d89 transno 120259084335 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075b93 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.632930:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075b93 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.632939:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2f385ca3 (ffff9c244c870200) 00010000:00010000:3.0:1784290430.632941:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.632943:0:74876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784290430.632957:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3075b85 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26fc expref: 102 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.632967:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075b9a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26fc expref: 101 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.632973:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9c244c870100) 00010000:00010000:3.0:1784290430.632975:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784290430.632993:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2482044c00, rc 0) 00000100:00100000:3.0:1784290430.633019:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+102:73314:x1870961896300800:12345-192.168.202.6@tcp:101:touch.0 Request processed in 474us (547us total) trans 120259084335 rc 0/0 00000100:00100000:3.0:1784290430.633026:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1357 00000100:00100000:1.0:1784290430.634044:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.634074:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896301056 00000100:00100000:3.0:1784290430.634079:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896301056 00000100:00100000:3.0:1784290430.634104:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1358 00000100:00100000:3.0:1784290430.634109:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+102:73314:x1870961896301056:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:3.0:1784290430.634128:0:65989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290430.634137:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075b9a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b26fc expref: 102 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.634146:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9c244c870100) 00010000:00010000:3.0:1784290430.634151:0:65989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290430.634169:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075ba8 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.634187:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075ba8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.634196:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075ba8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.634242:0:65989:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000093888e2d reply state 00000000dd049cab transno 120259084336 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075ba8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.634255:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075ba8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.634263:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9c244c870500) 00010000:00010000:3.0:1784290430.634266:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.634268:0:65989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290430.634319:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+103:73314:x1870961896301056:12345-192.168.202.6@tcp:36:touch.0 Request processed in 207us (274us total) trans 120259084336 rc 0/0 00000100:00100000:3.0:1784290430.634329:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1358 00000100:00100000:1.0:1784290430.635137:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.635209:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896301184 00000100:00100000:0.0:1784290430.635214:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896301184 00000100:00100000:0.0:1784290430.635244:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1359 00000100:00100000:0.0:1784290430.635251:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+103:73314:x1870961896301184:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.635261:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.635269:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4e00/0x5953bbf6b3075baf lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2703 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.635293:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4e00/0x5953bbf6b3075baf lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2703 expref: 104 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.635302:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4e00/0x5953bbf6b3075baf lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2703 expref: 104 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.635312:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9c244c870500) 00010000:00010000:0.0:1784290430.635314:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784290430.635316:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2f4e00, rc 0) 00000100:00100000:0.0:1784290430.635371:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+104:73314:x1870961896301184:12345-192.168.202.6@tcp:101:touch.0 Request processed in 118us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290430.635379:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1359 00000100:00100000:1.0:1784290430.636198:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.636234:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896301312 00000100:00100000:3.0:1784290430.636239:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896301312 00000100:00100000:3.0:1784290430.636272:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4993 00000100:00100000:3.0:1784290430.636281:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+19:2400:x1870961896301312:12345-192.168.202.6@tcp:2:touch.0 00000100:00100000:3.0:1784290430.636394:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+20:2400:x1870961896301312:12345-192.168.202.6@tcp:2:touch.0 Request processed in 113us (195us total) trans 4294968647 rc 0/0 00000100:00100000:3.0:1784290430.636403:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4993 00000100:00100000:1.0:1784290430.637151:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290430.637229:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896301568 00000100:00100000:2.0:1784290430.637234:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896301568 00000100:00100000:2.0:1784290430.637262:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 255 00000100:00100000:2.0:1784290430.637268:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+104:73314:x1870961896301568:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:2.0:1784290430.637405:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+105:73314:x1870961896301568:12345-192.168.202.6@tcp:35:touch.0 Request processed in 134us (253us total) trans 120259084337 rc 0/0 00000100:00100000:2.0:1784290430.637414:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 255 00000100:00100000:1.0:1784290430.638183:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.638257:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896301824 00000100:00100000:0.0:1784290430.638263:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896301824 00000100:00100000:0.0:1784290430.638292:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1360 00000100:00100000:0.0:1784290430.638306:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+105:73314:x1870961896301824:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.638316:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.638324:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5200/0x5953bbf6b3075bb6 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b270a expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.638392:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4000/0x5953bbf6b3075bbd lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.638401:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4000/0x5953bbf6b3075bbd lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.638407:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4000/0x5953bbf6b3075bbd lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.638416:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3075bc4 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.638422:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3075bc4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.638427:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3075bc4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784290430.638528:0:66004:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x771:0x0], index 0: 0 00010000:00010000:0.0:1784290430.638588:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4c00/0x5953bbf6b3075bcb lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.638594:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4c00/0x5953bbf6b3075bcb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.638599:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4c00/0x5953bbf6b3075bcb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.638623:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4000/0x5953bbf6b3075bbd lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.638628:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4000/0x5953bbf6b3075bbd lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.638633:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4000/0x5953bbf6b3075bbd lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.638637:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4000/0x5953bbf6b3075bbd lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.638640:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f4000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290430.638642:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4000/0x5953bbf6b3075bbd lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.638646:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4000/0x5953bbf6b3075bbd lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.638652:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:0.0:1784290430.638653:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290430.638656:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4000/0x5953bbf6b3075bbd lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.638659:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4000/0x5953bbf6b3075bbd lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290430.638667:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000be2c808e reply state 000000003d3e764e transno 120259084338 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3075bc4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.638673:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3075bc4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.638683:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x88f15ca3 (ffff9c2474f5f500) 00010000:00010000:0.0:1784290430.638684:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290430.638686:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784290430.638701:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5200/0x5953bbf6b3075bb6 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b270a expref: 108 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.638710:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4c00/0x5953bbf6b3075bcb lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b270a expref: 107 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.638715:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9c2474f5fd00) 00010000:00010000:0.0:1784290430.638717:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784290430.638719:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2f4c00, rc 0) 00000100:00100000:0.0:1784290430.638748:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+108:73314:x1870961896301824:12345-192.168.202.6@tcp:101:touch.0 Request processed in 442us (566us total) trans 120259084338 rc 0/0 00000100:00100000:0.0:1784290430.638752:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1360 00000100:00100000:1.0:1784290430.639898:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.639929:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896302080 00000100:00100000:3.0:1784290430.639933:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896302080 00000100:00100000:3.0:1784290430.639960:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1361 00000100:00100000:3.0:1784290430.639991:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+108:73314:x1870961896302080:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:3.0:1784290430.640012:0:65988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290430.640022:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4c00/0x5953bbf6b3075bcb lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b270a expref: 108 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.640031:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9c2474f5fd00) 00010000:00010000:3.0:1784290430.640036:0:65988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290430.640053:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3075bd9 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.640060:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3075bd9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.640065:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3075bd9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.640099:0:65988:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f2746568 reply state 0000000006b33d78 transno 120259084339 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3075bd9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.640106:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3075bd9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.640111:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9c244c870800) 00010000:00010000:3.0:1784290430.640113:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.640114:0:65988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290430.640150:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+109:73314:x1870961896302080:12345-192.168.202.6@tcp:36:touch.0 Request processed in 176us (253us total) trans 120259084339 rc 0/0 00000100:00100000:3.0:1784290430.640155:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1361 00000100:00100000:1.0:1784290430.640906:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.640970:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896302208 00000100:00100000:0.0:1784290430.640975:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896302208 00000100:00100000:0.0:1784290430.641023:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1362 00000100:00100000:0.0:1784290430.641031:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+109:73314:x1870961896302208:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.641040:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.641049:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5400/0x5953bbf6b3075be0 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2711 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.641073:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5400/0x5953bbf6b3075be0 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2711 expref: 110 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.641081:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5400/0x5953bbf6b3075be0 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2711 expref: 110 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.641100:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9c244c870800) 00010000:00010000:0.0:1784290430.641103:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784290430.641105:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2f5400, rc 0) 00000100:00100000:0.0:1784290430.641133:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+110:73314:x1870961896302208:12345-192.168.202.6@tcp:101:touch.0 Request processed in 104us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290430.641139:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1362 00000100:00100000:1.0:1784290430.642108:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.642151:0:26257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896302336 00000100:00100000:0.0:1784290430.642157:0:26257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896302336 00000100:00100000:0.0:1784290430.642187:0:26257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4994 00000100:00100000:0.0:1784290430.642193:0:26257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a51b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+20:2399:x1870961896302336:12345-192.168.202.6@tcp:2:touch.0 00000100:00100000:0.0:1784290430.642276:0:26257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a51b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+21:2399:x1870961896302336:12345-192.168.202.6@tcp:2:touch.0 Request processed in 83us (168us total) trans 4294968648 rc 0/0 00000100:00100000:0.0:1784290430.642282:0:26257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4994 00000100:00100000:1.0:1784290430.643114:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.643154:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896302592 00000100:00100000:3.0:1784290430.643160:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896302592 00000100:00100000:3.0:1784290430.643206:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 256 00000100:00100000:3.0:1784290430.643215:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+110:73314:x1870961896302592:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:3.0:1784290430.643366:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+111:73314:x1870961896302592:12345-192.168.202.6@tcp:35:touch.0 Request processed in 125us (224us total) trans 120259084340 rc 0/0 00000100:00100000:3.0:1784290430.643377:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 256 00000100:00100000:1.0:1784290430.644180:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.644216:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896302848 00000100:00100000:3.0:1784290430.644221:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896302848 00000100:00100000:3.0:1784290430.644251:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1363 00000100:00100000:3.0:1784290430.644258:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+111:73314:x1870961896302848:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:3.0:1784290430.644268:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290430.644278:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff200/0x5953bbf6b3075be7 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2718 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.644333:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075bee lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.644379:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075bee lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.644391:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075bee lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.644407:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075bf5 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.644416:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075bf5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.644425:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075bf5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290430.644567:0:94071:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247f977480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94071:1870961901182336:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1784290430.644609:0:74876:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x772:0x0], index 0: 0 00000100:00100000:0.0:1784290430.644611:0:94071:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290430.644650:0:94071:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2344a46c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784290430.644660:0:26261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901182336 00000100:00100000:2.0:1784290430.644666:0:26261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901182336 00000100:00080000:0.0:1784290430.644698:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784290430.644712:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3075bfc lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290430.644713:0:26261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4995 00000100:00100000:2.0:1784290430.644726:0:26261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:94071:x1870961901182336:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1784290430.644728:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3075bfc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.644742:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3075bfc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.644769:0:74876:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075bee lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1784290430.644769:0:26261:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 1922 00010000:00010000:3.0:1784290430.644793:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075bee lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.644798:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075bee lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.644805:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075bee lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.644808:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2ffe00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290430.644810:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075bee lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.644815:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075bee lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.644823:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:3.0:1784290430.644827:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290430.644836:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075bee lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.644842:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffe00/0x5953bbf6b3075bee lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.644852:0:74876:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002069c49b reply state 0000000015da2c7d transno 120259084341 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075bf5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.644859:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075bf5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.644877:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe2aa5ca3 (ffff9c244c870100) 00010000:00010000:3.0:1784290430.644879:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.644881:0:74876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784290430.644900:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff200/0x5953bbf6b3075be7 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2718 expref: 114 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.644912:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3075bfc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2718 expref: 113 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.644919:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9c244c870e00) 00010000:00010000:3.0:1784290430.644922:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784290430.644923:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24429dfc00, rc 0) 00000100:00100000:3.0:1784290430.644953:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+114:73314:x1870961896302848:12345-192.168.202.6@tcp:101:touch.0 Request processed in 695us (773us total) trans 120259084341 rc 0/0 00000100:00100000:3.0:1784290430.644959:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1363 00000100:00100000:2.0:1784290430.645967:0:26261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:94071:x1870961901182336:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1243us (1353us total) trans 4294968649 rc 0/0 00000100:00100000:2.0:1784290430.646002:0:26261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4995 00000100:00100000:1.0:1784290430.646009:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.646044:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896303104 00000100:00100000:0.0:1784290430.646049:0:94071:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247f977480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:94071:1870961901182336:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1784290430.646050:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896303104 00000004:00080000:0.0:1784290430.646066:0:94071:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x772:0x0]-[0x280000401:0x7a1:0x0] 00000100:00100000:3.0:1784290430.646082:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1364 00000100:00100000:3.0:1784290430.646091:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a51bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+114:73314:x1870961896303104:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:3.0:1784290430.646118:0:65989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290430.646127:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3075bfc lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2718 expref: 114 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.646136:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9c244c870e00) 00010000:00010000:3.0:1784290430.646140:0:65989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290430.646156:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075c0a lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.646162:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075c0a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.646168:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075c0a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.646198:0:65989:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000051f46654 reply state 00000000ed7fab77 transno 120259084342 ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075c0a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.646205:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075c0a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.646209:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9c244c870600) 00010000:00010000:3.0:1784290430.646211:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.646213:0:65989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290430.646249:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a51bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+115:73314:x1870961896303104:12345-192.168.202.6@tcp:36:touch.0 Request processed in 160us (242us total) trans 120259084342 rc 0/0 00000100:00100000:3.0:1784290430.646255:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1364 00000100:00100000:1.0:1784290430.647042:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.647092:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896303232 00000100:00100000:0.0:1784290430.647098:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896303232 00000100:00100000:0.0:1784290430.647128:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1365 00000100:00100000:0.0:1784290430.647135:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+115:73314:x1870961896303232:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.647146:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.647161:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5200/0x5953bbf6b3075c11 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b271f expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.647185:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5200/0x5953bbf6b3075c11 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b271f expref: 116 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.647194:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5200/0x5953bbf6b3075c11 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b271f expref: 116 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.647204:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9c244c870600) 00010000:00010000:0.0:1784290430.647206:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784290430.647208:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2f5200, rc 0) 00000100:00100000:0.0:1784290430.647234:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+116:73314:x1870961896303232:12345-192.168.202.6@tcp:101:touch.0 Request processed in 100us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290430.647240:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1365 00000100:00100000:1.0:1784290430.648309:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.648356:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896303360 00000100:00100000:3.0:1784290430.648360:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896303360 00000100:00100000:3.0:1784290430.648389:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4996 00000100:00100000:3.0:1784290430.648401:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+21:2400:x1870961896303360:12345-192.168.202.6@tcp:2:touch.0 00000100:00100000:3.0:1784290430.648474:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+22:2400:x1870961896303360:12345-192.168.202.6@tcp:2:touch.0 Request processed in 74us (167us total) trans 4294968650 rc 0/0 00000100:00100000:3.0:1784290430.648480:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4996 00000100:00100000:1.0:1784290430.649245:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290430.649304:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896303616 00000100:00100000:2.0:1784290430.649309:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896303616 00000100:00100000:2.0:1784290430.649360:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 257 00000100:00100000:2.0:1784290430.649371:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+116:73314:x1870961896303616:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:2.0:1784290430.649491:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+117:73314:x1870961896303616:12345-192.168.202.6@tcp:35:touch.0 Request processed in 122us (245us total) trans 120259084343 rc 0/0 00000100:00100000:2.0:1784290430.649499:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 257 00000100:00100000:1.0:1784290430.650365:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.650424:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896303872 00000100:00100000:0.0:1784290430.650431:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896303872 00000100:00100000:0.0:1784290430.650464:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1366 00000100:00100000:0.0:1784290430.650475:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+117:73314:x1870961896303872:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.650487:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.650497:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4000/0x5953bbf6b3075c18 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2726 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.650545:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c1f lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.650557:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c1f lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.650577:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c1f lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.650592:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3075c26 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.650600:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3075c26 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.650608:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3075c26 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784290430.650740:0:66004:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x773:0x0], index 0: 0 00010000:00010000:0.0:1784290430.650839:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4400/0x5953bbf6b3075c2d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.650851:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4400/0x5953bbf6b3075c2d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.650860:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4400/0x5953bbf6b3075c2d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.650884:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c1f lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.650893:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c1f lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.650911:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c1f lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.650918:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c1f lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.650932:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f5a00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290430.650936:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c1f lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.650943:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c1f lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.650953:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:0.0:1784290430.650957:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290430.650961:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c1f lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.650968:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c1f lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290430.650999:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f8064f00 reply state 00000000d0693c87 transno 120259084344 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3075c26 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.651011:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3075c26 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.651029:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x3c635ca3 (ffff9c2474f5fc00) 00010000:00010000:0.0:1784290430.651032:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290430.651035:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784290430.651058:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4000/0x5953bbf6b3075c18 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2726 expref: 120 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.651074:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4400/0x5953bbf6b3075c2d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2726 expref: 119 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.651096:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9c2474f5f000) 00010000:00010000:0.0:1784290430.651099:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784290430.651102:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2f4400, rc 0) 00000100:00100000:0.0:1784290430.651141:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+120:73314:x1870961896303872:12345-192.168.202.6@tcp:101:touch.0 Request processed in 668us (777us total) trans 120259084344 rc 0/0 00000100:00100000:0.0:1784290430.651151:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1366 00000100:00100000:3.0:1784290430.652123:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.652165:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896304128 00000100:00100000:0.0:1784290430.652172:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896304128 00000100:00100000:0.0:1784290430.652200:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1367 00000100:00100000:0.0:1784290430.652206:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+120:73314:x1870961896304128:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:0.0:1784290430.652225:0:65988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290430.652235:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4400/0x5953bbf6b3075c2d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2726 expref: 120 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.652245:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9c2474f5f000) 00010000:00010000:0.0:1784290430.652251:0:65988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290430.652267:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5c00/0x5953bbf6b3075c3b lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.652274:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5c00/0x5953bbf6b3075c3b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.652279:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5c00/0x5953bbf6b3075c3b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290430.652312:0:65988:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004899c7b6 reply state 00000000fbccd135 transno 120259084345 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5c00/0x5953bbf6b3075c3b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.652330:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5c00/0x5953bbf6b3075c3b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.652335:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9c2474f5ff00) 00010000:00010000:0.0:1784290430.652337:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290430.652363:0:65988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784290430.652418:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+121:73314:x1870961896304128:12345-192.168.202.6@tcp:36:touch.0 Request processed in 212us (325us total) trans 120259084345 rc 0/0 00000100:00100000:0.0:1784290430.652425:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1367 00000100:00100000:3.0:1784290430.653048:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290430.653118:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896304256 00000100:00100000:1.0:1784290430.653124:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896304256 00000100:00100000:1.0:1784290430.653156:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1368 00000100:00100000:1.0:1784290430.653162:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+121:73314:x1870961896304256:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:1.0:1784290430.653180:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290430.653189:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c600/0x5953bbf6b3075c42 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b272d expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.653212:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c600/0x5953bbf6b3075c42 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b272d expref: 122 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.653222:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c600/0x5953bbf6b3075c42 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b272d expref: 122 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290430.653231:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9c2474f5ff00) 00010000:00010000:1.0:1784290430.653234:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784290430.653236:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2469a7c600, rc 0) 00000100:00100000:1.0:1784290430.653264:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+122:73314:x1870961896304256:12345-192.168.202.6@tcp:101:touch.0 Request processed in 103us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290430.653270:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1368 00000100:00100000:1.0:1784290430.654129:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.654160:0:26251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896304384 00000100:00100000:3.0:1784290430.654164:0:26251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896304384 00000100:00100000:3.0:1784290430.654189:0:26251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4997 00000100:00100000:3.0:1784290430.654194:0:26251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+22:2399:x1870961896304384:12345-192.168.202.6@tcp:2:touch.0 00000100:00100000:3.0:1784290430.654267:0:26251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+23:2399:x1870961896304384:12345-192.168.202.6@tcp:2:touch.0 Request processed in 72us (138us total) trans 4294968651 rc 0/0 00000100:00100000:3.0:1784290430.654273:0:26251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4997 00000100:00100000:3.0:1784290430.655000:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.655043:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896304640 00000100:00100000:0.0:1784290430.655049:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896304640 00000100:00100000:0.0:1784290430.655078:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 258 00000100:00100000:0.0:1784290430.655084:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+122:73314:x1870961896304640:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:0.0:1784290430.655190:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+123:73314:x1870961896304640:12345-192.168.202.6@tcp:35:touch.0 Request processed in 105us (190us total) trans 120259084346 rc 0/0 00000100:00100000:0.0:1784290430.655196:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 258 00000100:00100000:1.0:1784290430.656087:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.656122:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896304896 00000100:00100000:3.0:1784290430.656127:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896304896 00000100:00100000:3.0:1784290430.656162:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1369 00000100:00100000:3.0:1784290430.656171:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+123:73314:x1870961896304896:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:3.0:1784290430.656180:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290430.656188:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca400/0x5953bbf6b3075c49 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2734 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.656222:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075c50 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.656230:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075c50 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.656242:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075c50 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.656252:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075c57 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.656258:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075c57 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.656263:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075c57 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784290430.656390:0:74876:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x774:0x0], index 0: 0 00010000:00010000:3.0:1784290430.656450:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3075c5e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.656456:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3075c5e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.656462:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3075c5e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.656476:0:74876:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075c50 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.656482:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075c50 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.656486:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075c50 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.656490:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075c50 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.656501:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8ca200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290430.656504:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075c50 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.656508:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075c50 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.656527:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:3.0:1784290430.656529:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290430.656531:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075c50 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.656536:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075c50 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.656543:0:74876:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d753d7e9 reply state 00000000206f281d transno 120259084347 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075c57 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.656549:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075c57 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.656554:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x961c5ca3 (ffff9c244c870c00) 00010000:00010000:3.0:1784290430.656556:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.656557:0:74876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784290430.656571:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca400/0x5953bbf6b3075c49 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2734 expref: 126 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.656579:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3075c5e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2734 expref: 125 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.656593:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9c244c870a00) 00010000:00010000:3.0:1784290430.656594:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784290430.656596:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8cb000, rc 0) 00000100:00100000:3.0:1784290430.656623:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+126:73314:x1870961896304896:12345-192.168.202.6@tcp:101:touch.0 Request processed in 455us (537us total) trans 120259084347 rc 0/0 00000100:00100000:3.0:1784290430.656628:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1369 00000100:00100000:1.0:1784290430.657701:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.657739:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896305152 00000100:00100000:3.0:1784290430.657745:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896305152 00000100:00100000:3.0:1784290430.657780:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1370 00000100:00100000:3.0:1784290430.657789:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+126:73314:x1870961896305152:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:3.0:1784290430.657813:0:65989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290430.657828:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3075c5e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2734 expref: 126 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.657842:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9c244c870a00) 00010000:00010000:3.0:1784290430.657849:0:65989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290430.657872:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb600/0x5953bbf6b3075c6c lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.657883:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb600/0x5953bbf6b3075c6c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.657891:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb600/0x5953bbf6b3075c6c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290430.657942:0:65989:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008c1b23a7 reply state 00000000e3ad303b transno 120259084348 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb600/0x5953bbf6b3075c6c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.657968:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb600/0x5953bbf6b3075c6c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290430.657991:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9c244c870b00) 00010000:00010000:3.0:1784290430.657995:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290430.657998:0:65989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290430.658051:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+127:73314:x1870961896305152:12345-192.168.202.6@tcp:36:touch.0 Request processed in 262us (350us total) trans 120259084348 rc 0/0 00000100:00100000:3.0:1784290430.658060:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1370 00000100:00100000:1.0:1784290430.658866:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.658930:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896305280 00000100:00100000:0.0:1784290430.658936:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896305280 00000100:00100000:0.0:1784290430.658966:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1371 00000100:00100000:0.0:1784290430.658974:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+127:73314:x1870961896305280:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.658999:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.659012:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5e00/0x5953bbf6b3075c73 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b273b expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.659037:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5e00/0x5953bbf6b3075c73 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b273b expref: 128 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.659056:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5e00/0x5953bbf6b3075c73 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b273b expref: 128 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.659068:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9c244c870b00) 00010000:00010000:0.0:1784290430.659070:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784290430.659072:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2f5e00, rc 0) 00000100:00100000:0.0:1784290430.659100:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+128:73314:x1870961896305280:12345-192.168.202.6@tcp:101:touch.0 Request processed in 128us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290430.659106:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1371 00000100:00100000:1.0:1784290430.659868:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.659898:0:26263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896305408 00000100:00100000:3.0:1784290430.659903:0:26263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896305408 00000100:00100000:3.0:1784290430.659927:0:26263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4998 00000100:00100000:3.0:1784290430.659932:0:26263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+23:2400:x1870961896305408:12345-192.168.202.6@tcp:2:touch.0 00000100:00100000:3.0:1784290430.660019:0:26263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+24:2400:x1870961896305408:12345-192.168.202.6@tcp:2:touch.0 Request processed in 86us (152us total) trans 4294968652 rc 0/0 00000100:00100000:3.0:1784290430.660025:0:26263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4998 00000100:00100000:1.0:1784290430.660667:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290430.660731:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896305664 00000100:00100000:2.0:1784290430.660737:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896305664 00000100:00100000:2.0:1784290430.660767:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 259 00000100:00100000:2.0:1784290430.660773:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+128:73314:x1870961896305664:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:2.0:1784290430.660879:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+129:73314:x1870961896305664:12345-192.168.202.6@tcp:35:touch.0 Request processed in 105us (213us total) trans 120259084349 rc 0/0 00000100:00100000:2.0:1784290430.660887:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 259 00000100:00100000:1.0:1784290430.661708:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.661776:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896305920 00000100:00100000:0.0:1784290430.661782:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896305920 00000100:00100000:0.0:1784290430.661812:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1372 00000100:00100000:0.0:1784290430.661818:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+129:73314:x1870961896305920:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.661828:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.661836:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4000/0x5953bbf6b3075c7a lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2742 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.661880:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c81 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.661889:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c81 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.661894:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c81 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.661903:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4c00/0x5953bbf6b3075c88 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.661915:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4c00/0x5953bbf6b3075c88 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.661920:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4c00/0x5953bbf6b3075c88 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784290430.662052:0:66004:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x775:0x0], index 0: 0 00010000:00010000:0.0:1784290430.662113:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3075c8f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.662121:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3075c8f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.662127:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3075c8f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.662142:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c81 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.662148:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c81 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.662152:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c81 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.662156:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c81 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.662159:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f5a00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290430.662161:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c81 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.662176:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c81 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.662183:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:0.0:1784290430.662185:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290430.662187:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c81 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.662191:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b3075c81 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290430.662199:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004a2249fc reply state 000000005373e017 transno 120259084350 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4c00/0x5953bbf6b3075c88 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.662206:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4c00/0x5953bbf6b3075c88 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.662211:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xb6f515a3 (ffff9c2474f5f900) 00010000:00010000:0.0:1784290430.662212:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290430.662213:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784290430.662228:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4000/0x5953bbf6b3075c7a lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2742 expref: 132 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.662236:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3075c8f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2742 expref: 131 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.662241:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9c2474f5f200) 00010000:00010000:0.0:1784290430.662243:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784290430.662245:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26c00, rc 0) 00000100:00100000:0.0:1784290430.662278:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+132:73314:x1870961896305920:12345-192.168.202.6@tcp:101:touch.0 Request processed in 460us (572us total) trans 120259084350 rc 0/0 00000100:00100000:0.0:1784290430.662284:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1372 00000100:00100000:1.0:1784290430.663295:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.663384:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896306176 00000100:00100000:0.0:1784290430.663391:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896306176 00000100:00100000:0.0:1784290430.663420:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1373 00000100:00100000:0.0:1784290430.663428:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+132:73314:x1870961896306176:12345-192.168.202.6@tcp:36:touch.0 00010000:00010000:0.0:1784290430.663448:0:65988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290430.663458:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3075c8f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2742 expref: 132 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.663470:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9c2474f5f200) 00010000:00010000:0.0:1784290430.663475:0:65988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290430.663493:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075c9d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.663501:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075c9d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.663507:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075c9d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784290430.663543:0:65988:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000304add3e reply state 000000006bf24221 transno 120259084351 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075c9d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.663550:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075c9d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.663567:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9c2474f5f300) 00010000:00010000:0.0:1784290430.663569:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290430.663577:0:65988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784290430.663620:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+133:73314:x1870961896306176:12345-192.168.202.6@tcp:36:touch.0 Request processed in 193us (326us total) trans 120259084351 rc 0/0 00000100:00100000:0.0:1784290430.663626:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1373 00000100:00100000:1.0:1784290430.664266:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.664325:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896306304 00000100:00100000:0.0:1784290430.664331:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896306304 00000100:00100000:0.0:1784290430.664386:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1374 00000100:00100000:0.0:1784290430.664397:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+133:73314:x1870961896306304:12345-192.168.202.6@tcp:101:touch.0 00010000:00010000:0.0:1784290430.664407:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290430.664427:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950c00/0x5953bbf6b3075ca4 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2749 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.664452:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950c00/0x5953bbf6b3075ca4 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2749 expref: 134 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.664461:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950c00/0x5953bbf6b3075ca4 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2749 expref: 134 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290430.664471:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9c2474f5f300) 00010000:00010000:0.0:1784290430.664473:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784290430.664475:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246d950c00, rc 0) 00000100:00100000:0.0:1784290430.664503:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+134:73314:x1870961896306304:12345-192.168.202.6@tcp:101:touch.0 Request processed in 109us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290430.664509:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1374 00000100:00100000:1.0:1784290430.665222:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290430.665258:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896306432 00000100:00100000:3.0:1784290430.665264:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896306432 00000100:00100000:3.0:1784290430.665297:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 4999 00000100:00100000:3.0:1784290430.665305:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+24:2399:x1870961896306432:12345-192.168.202.6@tcp:2:touch.0 00000100:00100000:3.0:1784290430.665429:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+25:2399:x1870961896306432:12345-192.168.202.6@tcp:2:touch.0 Request processed in 123us (205us total) trans 4294968653 rc 0/0 00000100:00100000:3.0:1784290430.665439:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 4999 00000100:00100000:1.0:1784290430.666107:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290430.666147:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896306688 00000100:00100000:0.0:1784290430.666153:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896306688 00000100:00100000:0.0:1784290430.666181:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 260 00000100:00100000:0.0:1784290430.666188:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c208c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+134:73314:x1870961896306688:12345-192.168.202.6@tcp:35:touch.0 00000100:00100000:0.0:1784290430.666299:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c208c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+135:73314:x1870961896306688:12345-192.168.202.6@tcp:35:touch.0 Request processed in 111us (192us total) trans 120259084352 rc 0/0 00000100:00100000:0.0:1784290430.666307:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 260 00000100:00100000:1.0:1784290431.494164:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290431.494242:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896306944 00000100:00100000:1.0:1784290431.494252:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290431.494259:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896306944 00000100:00080000:0.0:1784290431.494388:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784290431.494399:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896306816 00000100:00100000:2.0:1784290431.494409:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896306816 00000100:00100000:1.0:1784290431.494427:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290431.494451:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 769 00000100:00100000:3.0:1784290431.494465:0:26253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896307072 00000100:00100000:0.0:1784290431.494473:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:2399:x1870961896306944:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290431.494476:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 167 00000100:00100000:3.0:1784290431.494494:0:26253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896307072 00000100:00100000:2.0:1784290431.494498:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2400:x1870961896306816:12345-192.168.202.6@tcp:400:kworker.0 00000100:00080000:1.0:1784290431.494554:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784290431.494566:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1633 00000100:00100000:3.0:1784290431.494582:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2400:x1870961896307072:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290431.494607:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:2399:x1870961896306944:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 141us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290431.494618:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2400:x1870961896306816:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 118us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290431.494627:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 769 00000100:00100000:3.0:1784290431.494638:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2400:x1870961896307072:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 57us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290431.494659:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 167 00000100:00100000:3.0:1784290431.494660:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1633 00010000:00010000:0.0:1784290431.655496:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290431.928033:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290431.928105:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896307200 00000100:00100000:3.0:1784290431.928120:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896307200 00000100:00100000:3.0:1784290431.928197:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1375 00000100:00100000:3.0:1784290431.928221:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+135:73341:x1870961896307200:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:3.0:1784290431.928296:0:65989:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444581376 avail 1298341888 00000100:00100000:3.0:1784290431.928417:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+135:73341:x1870961896307200:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 210us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290431.928425:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1375 00000100:00100000:1.0:1784290431.929514:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290431.929617:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896307328 00000100:00100000:0.0:1784290431.929625:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896307328 00000100:00100000:0.0:1784290431.929677:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1376 00000100:00100000:0.0:1784290431.929688:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:73341:x1870961896307328:12345-192.168.202.6@tcp:41:lfs.0 00000004:00000024:0.0:1784290431.929715:0:66008:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445097472 avail 1298857984 00000100:00100000:0.0:1784290431.929764:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:73341:x1870961896307328:12345-192.168.202.6@tcp:41:lfs.0 Request processed in 79us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290431.929772:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1376 00000100:00100000:1.0:1784290431.931328:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290431.931428:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896307456 00000100:00100000:0.0:1784290431.931435:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896307456 00000100:00100000:0.0:1784290431.931484:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1246 00000100:00100000:0.0:1784290431.931493:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+25:73341:x1870961896307456:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:0.0:1784290431.931521:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1784290431.931570:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+25:73341:x1870961896307456:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 78us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290431.931604:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1246 00000100:00100000:1.0:1784290431.932481:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290431.932574:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896307584 00000100:00100000:2.0:1784290431.932584:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896307584 00000100:00100000:2.0:1784290431.932634:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1247 00000100:00100000:2.0:1784290431.932653:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:73341:x1870961896307584:12345-192.168.202.6@tcp:13:lfs.0 00002000:00000024:2.0:1784290431.932677:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784290431.932722:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:73341:x1870961896307584:12345-192.168.202.6@tcp:13:lfs.0 Request processed in 71us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290431.932729:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1247 00000100:00100000:3.0:1784290432.167588:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784290432.167618:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2474cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901182592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784290432.167636:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247581b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901182464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290432.167758:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290432.167807:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901182592 00000100:00100000:3.0:1784290432.167817:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290432.167820:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901182592 00000100:00100000:3.0:1784290432.167869:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901182464 00000100:00100000:3.0:1784290432.167875:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901182464 00000100:00080000:1.0:1784290432.167912:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784290432.167921:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784290432.167933:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:3.0:1784290432.167945:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:2.0:1784290432.167952:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901182592:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1784290432.167961:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901182464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1784290432.168017:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00002000:00000024:3.0:1784290432.168018:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1784290432.168104:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901182592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 158us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290432.168116:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901182464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 155us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290432.168116:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:3.0:1784290432.168133:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:1.0:1784290432.168169:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247581b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901182464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1784290432.168215:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2474cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901182592:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1784290432.317013:0:94053:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084352 is committed 00010000:00010000:2.0:1784290432.317079:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b30758b4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317111:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b30758b4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317132:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b30758b4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317148:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7d800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.317161:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b30758b4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317181:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b30758b4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317254:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:2.0:1784290432.317262:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784290432.317274:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b30758b4 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317290:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d800/0x5953bbf6b30758b4 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317333:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30758e5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317436:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30758e5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317445:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30758e5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317454:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aac00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.317459:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30758e5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317469:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30758e5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317487:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x9beb5ca3 (ffff9c24821d9600) 00010000:00010000:2.0:1784290432.317491:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.317497:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30758e5 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317505:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30758e5 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317552:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa400/0x5953bbf6b30758fa lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317561:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa400/0x5953bbf6b30758fa lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317569:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa400/0x5953bbf6b30758fa lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317576:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.317580:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa400/0x5953bbf6b30758fa lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317588:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa400/0x5953bbf6b30758fa lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317599:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9c24821d9400) 00010000:00010000:2.0:1784290432.317601:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.317605:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa400/0x5953bbf6b30758fa lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317612:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa400/0x5953bbf6b30758fa lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317626:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3075916 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317633:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3075916 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317641:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3075916 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317655:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.317659:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3075916 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317666:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3075916 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317677:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe44515a3 (ffff9c2474f5fa00) 00010000:00010000:2.0:1784290432.317681:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.317686:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3075916 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317698:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3075916 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317746:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b307592b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317761:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b307592b lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317775:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b307592b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317787:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.317793:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b307592b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317805:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b307592b lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317834:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9c24821d9000) 00010000:00010000:2.0:1784290432.317837:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.317842:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b307592b lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317850:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa000/0x5953bbf6b307592b lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317873:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075947 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317883:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075947 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317891:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075947 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317897:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.317902:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075947 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317911:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075947 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317925:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2c9ecea3 (ffff9c24821d9f00) 00010000:00010000:2.0:1784290432.317928:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.317933:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075947 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.317940:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075947 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318016:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b307595c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318031:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b307595c lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318044:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b307595c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318056:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aae00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.318064:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b307595c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318078:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b307595c lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784290432.318080:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968653 is committed 00010000:00010000:2.0:1784290432.318094:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9c24821d9a00) 00010000:00010000:2.0:1784290432.318101:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.318105:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b307595c lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318113:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b307595c lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784290432.318116:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968649 is committed 00010000:00010000:2.0:1784290432.318134:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b3075978 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318145:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b3075978 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318153:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b3075978 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318172:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.318177:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b3075978 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318186:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b3075978 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318197:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x74f887a3 (ffff9c2474f5fe00) 00010000:00010000:2.0:1784290432.318200:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.318204:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b3075978 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318212:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b3075978 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318234:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b307598d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318242:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b307598d lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318250:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b307598d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318258:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.318262:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b307598d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318270:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b307598d lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318292:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9c24821d9e00) 00010000:00010000:2.0:1784290432.318295:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.318299:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b307598d lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318307:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b307598d lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318322:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30759a9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318329:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30759a9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318366:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30759a9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318375:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.318379:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30759a9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318389:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30759a9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318403:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xbd5240a3 (ffff9c24821d9100) 00010000:00010000:2.0:1784290432.318407:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.318411:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30759a9 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318419:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b30759a9 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318453:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b30759be lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318462:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b30759be lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318470:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b30759be lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318478:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.318482:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b30759be lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318490:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b30759be lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318501:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9c2446227300) 00010000:00010000:2.0:1784290432.318504:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.318508:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b30759be lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318519:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b30759be lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318540:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b30759da lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318553:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b30759da lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318564:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b30759da lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318589:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.318597:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b30759da lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318612:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b30759da lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318634:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x5abf9a3 (ffff9c2474f5f700) 00010000:00010000:2.0:1784290432.318640:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.318648:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b30759da lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318661:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b30759da lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318703:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b30759ef lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318718:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b30759ef lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318731:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b30759ef lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318743:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.318748:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b30759ef lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318762:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b30759ef lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318803:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9c2446227a00) 00010000:00010000:2.0:1784290432.318810:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.318818:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b30759ef lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318831:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b30759ef lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318858:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b3075a0b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318867:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b3075a0b lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318875:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b3075a0b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318883:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aaa00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.318888:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b3075a0b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318896:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b3075a0b lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318908:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x4e05b2a3 (ffff9c2446227400) 00010000:00010000:2.0:1784290432.318912:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.318916:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b3075a0b lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318924:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b3075a0b lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.318960:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3075a20 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319002:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3075a20 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319014:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3075a20 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319027:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fec00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.319035:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3075a20 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319049:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3075a20 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319070:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9c2446227e00) 00010000:00010000:2.0:1784290432.319076:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.319083:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3075a20 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319097:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b3075a20 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319124:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3075a3c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319137:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3075a3c lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319152:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3075a3c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319176:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429de800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.319183:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3075a3c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319198:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3075a3c lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319220:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x965f6ba3 (ffff9c2474f5f100) 00010000:00010000:2.0:1784290432.319226:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.319234:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3075a3c lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319248:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429de800/0x5953bbf6b3075a3c lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319282:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3075a51 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319291:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3075a51 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319300:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3075a51 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319307:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fea00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.319312:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3075a51 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319320:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3075a51 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319383:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9c2446227c00) 00010000:00010000:2.0:1784290432.319388:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.319393:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3075a51 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319401:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b3075a51 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319419:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075a6d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319427:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075a6d lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319436:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075a6d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319443:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2ff000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.319447:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075a6d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319456:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075a6d lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319469:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xdeb924a3 (ffff9c2446227f00) 00010000:00010000:2.0:1784290432.319473:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.319478:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075a6d lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319486:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b3075a6d lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319524:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3075a82 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319532:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3075a82 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319540:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3075a82 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319546:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fe200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.319549:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3075a82 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319556:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3075a82 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319566:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9c2446227800) 00010000:00010000:2.0:1784290432.319569:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.319572:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3075a82 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319579:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b3075a82 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319590:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3075a9e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319597:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3075a9e lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319604:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3075a9e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319617:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429dfa00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.319621:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3075a9e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319628:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3075a9e lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319638:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x6e9b5ca3 (ffff9c2474f5f800) 00010000:00010000:2.0:1784290432.319640:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.319644:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3075a9e lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319651:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3075a9e lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319672:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b3075ab3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319681:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b3075ab3 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319692:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b3075ab3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319702:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aba00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.319708:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b3075ab3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319719:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b3075ab3 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319755:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9c2446227500) 00010000:00010000:2.0:1784290432.319759:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.319766:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b3075ab3 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319781:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b3075ab3 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319803:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075acf lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319811:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075acf lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319818:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075acf lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319824:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.319828:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075acf lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319835:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075acf lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319845:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8545ca3 (ffff9c2446227d00) 00010000:00010000:2.0:1784290432.319848:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.319851:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075acf lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319858:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075acf lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319892:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3075ae4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319900:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3075ae4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319907:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3075ae4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319913:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045e00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.319917:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3075ae4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319924:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3075ae4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319933:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9c2446227100) 00010000:00010000:2.0:1784290432.319936:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.319940:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3075ae4 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319947:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045e00/0x5953bbf6b3075ae4 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319958:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4600/0x5953bbf6b3075b00 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.319994:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4600/0x5953bbf6b3075b00 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320006:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4600/0x5953bbf6b3075b00 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320026:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f4600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.320033:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4600/0x5953bbf6b3075b00 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320046:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4600/0x5953bbf6b3075b00 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320063:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x220d5ca3 (ffff9c2474f5f400) 00010000:00010000:2.0:1784290432.320066:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.320071:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4600/0x5953bbf6b3075b00 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320078:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4600/0x5953bbf6b3075b00 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320101:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3075b15 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320108:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3075b15 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320115:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3075b15 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320122:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482044200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.320125:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3075b15 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320132:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3075b15 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320156:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9c2446227b00) 00010000:00010000:2.0:1784290432.320159:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.320164:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3075b15 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320172:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3075b15 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320195:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075b31 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320204:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075b31 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320212:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075b31 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320220:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.320225:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075b31 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320234:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075b31 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320245:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x7bc65ca3 (ffff9c2446227900) 00010000:00010000:2.0:1784290432.320249:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.320253:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075b31 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320261:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075b31 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320294:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075b46 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320302:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075b46 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320311:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075b46 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320319:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.320323:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075b46 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320332:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075b46 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320380:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9c2446227200) 00010000:00010000:2.0:1784290432.320385:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.320390:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075b46 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320398:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075b46 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320415:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5800/0x5953bbf6b3075b62 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320423:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5800/0x5953bbf6b3075b62 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320432:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5800/0x5953bbf6b3075b62 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320447:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f5800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.320452:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5800/0x5953bbf6b3075b62 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320460:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5800/0x5953bbf6b3075b62 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320472:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xd57f5ca3 (ffff9c2474f5f600) 00010000:00010000:2.0:1784290432.320476:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.320480:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5800/0x5953bbf6b3075b62 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320488:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5800/0x5953bbf6b3075b62 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320512:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075b77 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320520:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075b77 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320528:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075b77 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320536:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429dfe00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.320540:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075b77 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320548:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075b77 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320574:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9c244c870d00) 00010000:00010000:2.0:1784290432.320578:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.320582:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075b77 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320591:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075b77 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320607:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075b93 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320616:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075b93 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320626:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075b93 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320633:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.320638:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075b93 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320647:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075b93 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320656:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2f385ca3 (ffff9c244c870200) 00010000:00010000:2.0:1784290432.320660:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.320664:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075b93 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320671:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075b93 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320713:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075ba8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320728:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075ba8 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320742:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075ba8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320755:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450abc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.320763:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075ba8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320778:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075ba8 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320799:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9c244c870500) 00010000:00010000:2.0:1784290432.320805:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.320813:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075ba8 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320825:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075ba8 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320844:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3075bc4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320853:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3075bc4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320863:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3075bc4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320882:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f4200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.320888:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3075bc4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320896:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3075bc4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320908:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x88f15ca3 (ffff9c2474f5f500) 00010000:00010000:2.0:1784290432.320912:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.320915:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3075bc4 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320924:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3075bc4 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320949:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3075bd9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320957:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3075bd9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.320999:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3075bd9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321012:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2ffc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.321031:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3075bd9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321046:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3075bd9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321086:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9c244c870800) 00010000:00010000:2.0:1784290432.321101:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.321109:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3075bd9 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321118:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ffc00/0x5953bbf6b3075bd9 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321141:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075bf5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321150:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075bf5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321160:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075bf5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321167:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482044c00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.321171:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075bf5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321179:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075bf5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321190:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe2aa5ca3 (ffff9c244c870100) 00010000:00010000:2.0:1784290432.321194:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.321198:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075bf5 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321205:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075bf5 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321248:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075c0a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321258:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075c0a lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321267:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075c0a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321275:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429df200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.321280:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075c0a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321289:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075c0a lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321302:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9c244c870600) 00010000:00010000:2.0:1784290432.321306:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.321311:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075c0a lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321318:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075c0a lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321338:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3075c26 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321385:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3075c26 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321394:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3075c26 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321413:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f5600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.321419:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3075c26 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321427:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3075c26 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321444:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x3c635ca3 (ffff9c2474f5fc00) 00010000:00010000:2.0:1784290432.321448:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.321453:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3075c26 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321462:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3075c26 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321499:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5c00/0x5953bbf6b3075c3b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321508:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5c00/0x5953bbf6b3075c3b lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321516:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5c00/0x5953bbf6b3075c3b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321525:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f5c00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.321529:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5c00/0x5953bbf6b3075c3b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321541:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5c00/0x5953bbf6b3075c3b lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321566:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9c2474f5ff00) 00010000:00010000:2.0:1784290432.321571:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.321575:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5c00/0x5953bbf6b3075c3b lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321584:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5c00/0x5953bbf6b3075c3b lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321609:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075c57 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321617:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075c57 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321624:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075c57 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321631:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8ca600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.321636:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075c57 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321643:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075c57 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321652:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x961c5ca3 (ffff9c244c870c00) 00010000:00010000:2.0:1784290432.321655:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.321660:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075c57 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321667:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075c57 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321720:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb600/0x5953bbf6b3075c6c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321735:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb600/0x5953bbf6b3075c6c lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321750:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb600/0x5953bbf6b3075c6c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321762:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cb600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.321769:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb600/0x5953bbf6b3075c6c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321784:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb600/0x5953bbf6b3075c6c lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321802:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9c244c870b00) 00010000:00010000:2.0:1784290432.321808:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.321815:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb600/0x5953bbf6b3075c6c lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321826:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb600/0x5953bbf6b3075c6c lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321844:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4c00/0x5953bbf6b3075c88 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321852:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4c00/0x5953bbf6b3075c88 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321861:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4c00/0x5953bbf6b3075c88 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321880:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f4c00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.321884:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4c00/0x5953bbf6b3075c88 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321893:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4c00/0x5953bbf6b3075c88 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321908:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xb6f515a3 (ffff9c2474f5f900) 00010000:00010000:2.0:1784290432.321911:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.321916:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4c00/0x5953bbf6b3075c88 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321925:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4c00/0x5953bbf6b3075c88 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321953:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075c9d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.321984:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075c9d lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.322009:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075c9d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.322020:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd27e00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.322028:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075c9d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.322043:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075c9d lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.322089:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9c2474f5f300) 00010000:00010000:2.0:1784290432.322095:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.322100:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075c9d lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.322109:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b3075c9d lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290432.386110:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290432.386227:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896307840 00000100:00100000:2.0:1784290432.386247:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896307840 00000100:00080000:1.0:1784290432.386402:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784290432.386427:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1377 00000100:00100000:2.0:1784290432.386448:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+31:73382:x1870961896307840:12345-192.168.202.6@tcp:36:mcreate.0 00010000:00010000:2.0:1784290432.386543:0:66004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290432.386602:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b3075891 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2623 expref: 31 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.386644:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:2.0:1784290432.386655:0:66004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290432.386779:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075cab lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.386809:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075cab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.386831:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075cab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.386863:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3075cb2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.386905:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3075cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.386922:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3075cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.387696:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075cab lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.387709:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075cab lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.387717:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075cab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.387725:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075cab lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.387733:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290432.387738:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075cab lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.387747:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075cab lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.387761:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:2.0:1784290432.387764:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290432.387770:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075cab lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.387778:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075cab lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784290432.387809:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000074333331 reply state 00000000536c557f transno 120259084353 ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3075cb2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.387826:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3075cb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.387836:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2461f23000) 00010000:00010000:2.0:1784290432.387839:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290432.387843:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784290432.387990:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+32:73382:x1870961896307840:12345-192.168.202.6@tcp:36:mcreate.0 Request processed in 1524us (1871us total) trans 120259084353 rc 0/0 00000100:00100000:2.0:1784290432.388003:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1377 00000100:00100000:0.0:1784290432.399147:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290432.399257:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896307968 00000100:00100000:2.0:1784290432.399266:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896307968 00000100:00100000:2.0:1784290432.399323:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1378 00000100:00100000:2.0:1784290432.399335:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+32:73385:x1870961896307968:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:2.0:1784290432.399391:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290432.399409:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075cb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2750 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.399480:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3075cc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.399494:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3075cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.399507:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3075cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784290432.399565:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784290432.399573:0:65988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784290432.399606:0:65988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3075cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.399655:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075cb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2750 expref: 34 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.399679:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3075cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2750 expref: 33 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290432.399696:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:2.0:1784290432.399700:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784290432.399705:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236c800, rc 0) 00000100:00100000:2.0:1784290432.399764:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+33:73385:x1870961896307968:12345-192.168.202.6@tcp:101:rm.0 Request processed in 431us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290432.399776:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1378 00000100:00100000:3.0:1784290432.401577:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290432.401635:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896308096 00000100:00100000:0.0:1784290432.401645:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896308096 00000100:00100000:0.0:1784290432.401727:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1379 00000100:00100000:0.0:1784290432.401749:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+33:73385:x1870961896308096:12345-192.168.202.6@tcp:101:rm.0 00010000:00010000:0.0:1784290432.401769:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290432.401791:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951000/0x5953bbf6b3075cc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2757 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.401861:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075cce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.401881:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075cce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.401898:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075cce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.401934:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951400/0x5953bbf6b3075cd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.401947:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951400/0x5953bbf6b3075cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.401957:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951400/0x5953bbf6b3075cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402075:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950000/0x5953bbf6b3075cdc lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402096:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950000/0x5953bbf6b3075cdc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402106:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950000/0x5953bbf6b3075cdc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290432.402148:0:65990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x1a:0x0]: returning size 0 00000004:00200000:0.0:1784290432.402153:0:65990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784290432.402177:0:65990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950000/0x5953bbf6b3075cdc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402190:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950000/0x5953bbf6b3075cdc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402199:0:65990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075cce lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402207:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075cce lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402214:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075cce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402221:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075cce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402227:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246d951600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290432.402232:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075cce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402240:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075cce lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402265:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:0.0:1784290432.402269:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290432.402273:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075cce lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402281:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075cce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402294:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951400/0x5953bbf6b3075cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402301:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951400/0x5953bbf6b3075cd5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402308:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951400/0x5953bbf6b3075cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402313:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246d951400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290432.402318:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951400/0x5953bbf6b3075cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402324:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951400/0x5953bbf6b3075cd5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402332:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2461f23000) 00010000:00010000:0.0:1784290432.402336:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290432.402397:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951400/0x5953bbf6b3075cd5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402405:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951400/0x5953bbf6b3075cd5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402448:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951000/0x5953bbf6b3075cc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2757 expref: 35 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402462:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950000/0x5953bbf6b3075cdc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2757 expref: 34 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290432.402471:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff9c2443b66100) 00010000:00010000:0.0:1784290432.402474:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784290432.402477:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246d950000, rc 0) 00000100:00100000:0.0:1784290432.402531:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+34:73385:x1870961896308096:12345-192.168.202.6@tcp:101:rm.0 Request processed in 792us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290432.402541:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1379 00000100:00100000:1.0:1784290432.404482:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290432.404517:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896308352 00000100:00100000:3.0:1784290432.404527:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896308352 00000100:00100000:3.0:1784290432.404579:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1380 00000100:00100000:3.0:1784290432.404592:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+34:73385:x1870961896308352:12345-192.168.202.6@tcp:36:rm.0 00010000:00010000:3.0:1784290432.404629:0:74876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784290432.404650:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950000/0x5953bbf6b3075cdc lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2757 expref: 34 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.404667:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff9c2443b66100) 00010000:00010000:3.0:1784290432.404688:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3075cc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2750 expref: 33 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.404700:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:3.0:1784290432.404704:0:74876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290432.404719:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3075ce3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.404730:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3075ce3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.404740:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3075ce3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.404750:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca400/0x5953bbf6b3075cea lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.404757:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca400/0x5953bbf6b3075cea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.404781:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca400/0x5953bbf6b3075cea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.404847:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075cf1 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.404857:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075cf1 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.404865:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075cf1 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.405082:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb200/0x5953bbf6b3075cf8 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.405093:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb200/0x5953bbf6b3075cf8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.405102:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb200/0x5953bbf6b3075cf8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.405110:0:74876:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb200/0x5953bbf6b3075cf8 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.405117:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb200/0x5953bbf6b3075cf8 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.405123:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb200/0x5953bbf6b3075cf8 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.405149:0:74876:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784290432.405179:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075cf1 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.405197:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075cf1 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.405205:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075cf1 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290432.405206:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290432.405218:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8ca200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290432.405222:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb200/0x5953bbf6b3075cf8 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.405225:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075cf1 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290432.405250:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cb200 already unused, calling callback (ffffffffc0ec3230) 00010000:00010000:3.0:1784290432.405252:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075cf1 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290432.405260:0:8418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb200/0x5953bbf6b3075cf8 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.405268:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff9c2449f0dd00) 00010000:00010000:3.0:1784290432.405274:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784290432.405278:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075cf1 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290432.405282:0:8418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb200/0x5953bbf6b3075cf8 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.405287:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075cf1 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.405309:0:74876:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3075ce3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.405319:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3075ce3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290432.405323:0:8418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff9c2449f0dd00) 00010000:00010000:3.0:1784290432.405327:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3075ce3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290432.405329:0:8418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784290432.405371:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3075ce3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290432.405374:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb200/0x5953bbf6b3075cf8 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290432.405384:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb200/0x5953bbf6b3075cf8 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.405404:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cb000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290432.405411:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3075ce3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.405421:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3075ce3 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290432.405422:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290432.405427:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290432.405435:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290432.405442:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:3.0:1784290432.405448:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290432.405452:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3075ce3 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.405459:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3075ce3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290432.405472:0:74876:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000475c2461 reply state 000000002ae0c7ad transno 120259084354 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca400/0x5953bbf6b3075cea lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.405483:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca400/0x5953bbf6b3075cea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290432.405490:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2461f23000) 00010000:00010000:3.0:1784290432.405493:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290432.405496:0:74876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290432.405555:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+34:73385:x1870961896308352:12345-192.168.202.6@tcp:36:rm.0 Request processed in 965us (1078us total) trans 120259084354 rc 0/0 00000100:00100000:3.0:1784290432.405564:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1380 00010000:00010000:0.0:1784290432.679581:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290433.191540:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247581ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901182720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784290433.191626:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290433.191680:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901182720 00000100:00100000:3.0:1784290433.191693:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901182720 00000100:00080000:1.0:1784290433.191749:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784290433.191789:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:3.0:1784290433.191816:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901182720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784290433.191850:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8617408 pending 0 free 3923529728 avail 3692007424 00010000:00000080:3.0:1784290433.191882:0:8406:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c246a543800 x1870961901182720/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:454/0 lens 224/368 e 0 to 0 dl 1784290444 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290433.191977:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901182720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290433.191983:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:1.0:1784290433.192038:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247581ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901182720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784290433.192483:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247581ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901182976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784290433.192537:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345cfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901182848:0@lo:400:kworker.0 00000100:00100000:2.0:1784290433.192547:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290433.192599:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901183488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784290433.192600:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290433.192667:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290433.192671:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dfd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1870961901183360:0@lo:400:kworker.0 00000100:00100000:1.0:1784290433.192705:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290433.192710:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901184000:0@lo:400:kworker.0 00000100:00100000:1.0:1784290433.192744:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901183872:0@lo:400:kworker.0 00000100:00100000:2.0:1784290433.192752:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290433.192796:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1870961901184512:0@lo:400:kworker.0 00000100:00100000:1.0:1784290433.192805:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290433.192839:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901184384:0@lo:400:kworker.0 00000100:00100000:2.0:1784290433.192857:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290433.192877:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290433.192934:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901182976 00000100:00100000:2.0:1784290433.192940:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901182976 00000100:00100000:1.0:1784290433.192940:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901182848 00000100:00100000:1.0:1784290433.192950:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901182848 00000100:00100000:2.0:1784290433.193004:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901183488 00000100:00100000:2.0:1784290433.193010:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901183488 00000100:00100000:1.0:1784290433.193022:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1784290433.193036:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901183872 00000100:00100000:2.0:1784290433.193040:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901183872 00000100:00100000:1.0:1784290433.193046:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3619:x1870961901182848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290433.193060:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3910 00000100:00100000:2.0:1784290433.193069:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901182976:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784290433.193104:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3619:x1870961901182848:12345-0@lo:400:kworker.0 Request processed in 59us (505us total) trans 0 rc 0/0 00000004:00000024:2.0:1784290433.193105:0:8413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445097472 avail 1298857984 00000100:00100000:1.0:1784290433.193123:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1784290433.193149:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901184000 00000100:00100000:3.0:1784290433.193156:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901184000 00000100:00100000:2.0:1784290433.193179:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901182976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290433.193191:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3910 00000100:00100000:1.0:1784290433.193195:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901183360 00000100:00100000:1.0:1784290433.193201:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901183360 00000100:00100000:2.0:1784290433.193218:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3911 00000100:00100000:3.0:1784290433.193219:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901184384 00000100:00100000:3.0:1784290433.193225:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901184384 00000100:00100000:2.0:1784290433.193242:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3620:x1870961901183488:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1784290433.193242:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1634 00000100:00100000:1.0:1784290433.193265:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901184512 00000004:00000024:2.0:1784290433.193269:0:8413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444581376 avail 1298341888 00000100:00100000:0.0:1784290433.193272:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901184000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290433.193275:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901184512 00000100:00100000:3.0:1784290433.193281:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1635 00000100:00100000:3.0:1784290433.193299:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901184384:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1784290433.193310:0:26250:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c24483d1f80 x1870961901184000/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:454/0 lens 224/224 e 0 to 0 dl 1784290444 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290433.193317:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3620:x1870961901183488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290433.193335:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:2.0:1784290433.193364:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3911 00000100:00100000:2.0:1784290433.193388:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3912 00000100:00100000:2.0:1784290433.193412:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3619:x1870961901183872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290433.193423:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901184384:12345-0@lo:400:kworker.0 Request processed in 114us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290433.193424:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1870961901183360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290433.193458:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1635 00000100:00100000:0.0:1784290433.193468:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901184000:12345-0@lo:400:kworker.0 Request processed in 209us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290433.193484:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1634 00000100:00100000:2.0:1784290433.193522:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3619:x1870961901183872:12345-0@lo:400:kworker.0 Request processed in 118us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290433.193535:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:1.0:1784290433.193536:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1870961901183360:12345-0@lo:400:kworker.0 Request processed in 124us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290433.193537:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3912 00000100:00100000:3.0:1784290433.193556:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1870961901184512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290433.193564:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:2.0:1784290433.193623:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901183488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784290433.193632:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1870961901184512:12345-0@lo:400:kworker.0 Request processed in 77us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290433.193640:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901183104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784290433.193652:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:2.0:1784290433.193653:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901184000:0@lo:400:kworker.0 00000100:00100000:2.0:1784290433.193692:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247581ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901182976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1784290433.193699:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290433.193705:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a51a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1870961901183232:0@lo:400:kworker.0 00000100:00100000:1.0:1784290433.193747:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1870961901183616:0@lo:400:kworker.0 00000100:00100000:3.0:1784290433.193768:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290433.193786:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1870961901184512:0@lo:400:kworker.0 00000100:00080000:1.0:1784290433.193793:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784290433.193803:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1784290433.193831:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c247d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1870961901183744:0@lo:400:kworker.0 00000100:00100000:2.0:1784290433.193838:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901183104 00000100:00100000:2.0:1784290433.193846:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901183104 00000100:00100000:1.0:1784290433.193851:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290433.193883:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901184128:0@lo:400:kworker.0 00000100:00100000:3.0:1784290433.193892:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290433.193899:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:2.0:1784290433.193913:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1870961901183104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784290433.193929:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1784290433.193937:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1870961901184256:0@lo:400:kworker.0 00000100:00100000:1.0:1784290433.193940:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290433.194005:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901183232 00000100:00100000:3.0:1784290433.194014:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290433.194015:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901183232 00000100:00100000:2.0:1784290433.194029:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1870961901183104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290433.194038:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00100000:1.0:1784290433.194082:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901183616 00000100:00100000:2.0:1784290433.194086:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901183744 00000100:00100000:1.0:1784290433.194090:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901183616 00000100:00100000:2.0:1784290433.194092:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901183744 00000100:00100000:3.0:1784290433.194097:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901183872:0@lo:400:kworker.0 00000100:00100000:3.0:1784290433.194123:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901184384:0@lo:400:kworker.0 00000100:00100000:3.0:1784290433.194140:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345cfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901182848:0@lo:400:kworker.0 00000100:00100000:2.0:1784290433.194150:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901184256 00000100:00100000:2.0:1784290433.194155:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901184256 00000100:00100000:3.0:1784290433.194158:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dfd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1870961901183360:0@lo:400:kworker.0 00000100:00100000:1.0:1784290433.194170:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:1.0:1784290433.194191:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1870961901183232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290433.194199:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:2.0:1784290433.194211:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1870961901183744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290433.194252:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a543b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901183104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784290433.194301:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:2.0:1784290433.194315:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1870961901183744:12345-0@lo:400:kworker.0 Request processed in 102us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290433.194330:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:3.0:1784290433.194331:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1870961901183616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290433.194332:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1870961901183232:12345-0@lo:400:kworker.0 Request processed in 135us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290433.194347:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:2.0:1784290433.194389:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1870961901184256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290433.194439:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1870961901184256:12345-0@lo:400:kworker.0 Request processed in 85us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290433.194444:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00100000:2.0:1784290433.194477:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a51a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1870961901183232:0@lo:400:kworker.0 00000100:00100000:2.0:1784290433.194489:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1870961901183744:0@lo:400:kworker.0 00000100:00100000:2.0:1784290433.194530:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1870961901184256:0@lo:400:kworker.0 00000100:00100000:2.0:1784290433.194585:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901184128 00000100:00100000:2.0:1784290433.194589:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901184128 00000100:00100000:3.0:1784290433.194622:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1870961901183616:12345-0@lo:400:kworker.0 Request processed in 306us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290433.194638:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:3.0:1784290433.194662:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:2.0:1784290433.194667:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1636 00000100:00100000:2.0:1784290433.194686:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901184128:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784290433.194686:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1784290433.194695:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784290433.194728:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c247d29e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1870961901183616:0@lo:400:kworker.0 00000100:00100000:2.0:1784290433.194771:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901184128:12345-0@lo:400:kworker.0 Request processed in 93us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290433.194777:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901184128:0@lo:400:kworker.0 00000100:00100000:2.0:1784290433.194779:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1636 00010000:00010000:1.0:1784290433.703536:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290434.727507:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784290435.035570:0:95587:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: ost1 REPLAY BARRIER on lustre-OST0000 00000100:00100000:2.0:1784290435.117046:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.117097:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.117131:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896308480 00000100:00100000:0.0:1784290435.117146:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896308480 00000100:00080000:2.0:1784290435.117219:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784290435.117230:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896308608 00000100:00100000:1.0:1784290435.117248:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896308608 00000100:00100000:0.0:1784290435.117249:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1381 00000100:00100000:0.0:1784290435.117271:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+35:73462:x1870961896308480:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1784290435.117301:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290435.117333:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950400/0x5953bbf6b3075cff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b275e expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.117390:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1382 00000100:00100000:3.0:1784290435.117406:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+36:73463:x1870961896308608:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:3.0:1784290435.117418:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290435.117430:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075d06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2765 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.117454:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951800/0x5953bbf6b3075d0d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.117467:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3075d14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.117471:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951800/0x5953bbf6b3075d0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.117489:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951800/0x5953bbf6b3075d0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.117494:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3075d14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.117503:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3075d14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290435.117542:0:66004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1784290435.117543:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1784290435.117548:0:66004:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00200000:3.0:1784290435.117550:0:65988:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1784290435.117610:0:66004:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951800/0x5953bbf6b3075d0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290435.117612:0:65988:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3075d14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.117643:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950400/0x5953bbf6b3075cff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b275e expref: 39 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.117651:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075d06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2765 expref: 39 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.117662:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951800/0x5953bbf6b3075d0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b275e expref: 37 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.117668:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb000/0x5953bbf6b3075d14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2765 expref: 37 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.117674:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:0.0:1784290435.117680:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784290435.117695:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246d951800, rc 0) 00010000:00010000:3.0:1784290435.117696:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:3.0:1784290435.117700:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784290435.117703:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8cb000, rc 0) 00000100:00100000:0.0:1784290435.117781:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+37:73462:x1870961896308480:12345-192.168.202.6@tcp:101:dd.0 Request processed in 513us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290435.117788:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+37:73463:x1870961896308608:12345-192.168.202.6@tcp:101:dd.0 Request processed in 379us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290435.117793:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1381 00000100:00100000:3.0:1784290435.117811:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1382 00000100:00100000:1.0:1784290435.118284:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.118406:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896308736 00000100:00100000:2.0:1784290435.118415:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896308736 00000100:00100000:2.0:1784290435.118468:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1383 00000100:00100000:2.0:1784290435.118482:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+36:73464:x1870961896308736:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:2.0:1784290435.118507:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290435.118530:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075d1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b276c expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.118636:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3075d22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.118658:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3075d22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.118675:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3075d22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784290435.118781:0:66008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1784290435.118789:0:66008:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1784290435.118822:0:66008:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3075d22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.118856:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075d1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b276c expref: 38 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.118901:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3075d22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b276c expref: 37 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.118910:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:2.0:1784290435.118914:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784290435.118917:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236c800, rc 0) 00000100:00100000:2.0:1784290435.118998:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+37:73464:x1870961896308736:12345-192.168.202.6@tcp:101:dd.0 Request processed in 519us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290435.119006:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1383 00000100:00100000:1.0:1784290435.120003:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.120054:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896308992 00000100:00100000:3.0:1784290435.120061:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896308992 00000100:00100000:3.0:1784290435.120101:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1384 00000100:00100000:3.0:1784290435.120107:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+37:73463:x1870961896308992:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:3.0:1784290435.120118:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290435.120137:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb400/0x5953bbf6b3075d29 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2773 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120261:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca800/0x5953bbf6b3075d30 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120270:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca800/0x5953bbf6b3075d30 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120276:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca800/0x5953bbf6b3075d30 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120287:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cac00/0x5953bbf6b3075d37 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120292:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cac00/0x5953bbf6b3075d37 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120296:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cac00/0x5953bbf6b3075d37 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120337:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb800/0x5953bbf6b3075d3e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120376:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb800/0x5953bbf6b3075d3e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120386:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb800/0x5953bbf6b3075d3e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290435.120394:0:65990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x7:0x0]: returning size 0 00010000:00010000:3.0:1784290435.120489:0:65990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca800/0x5953bbf6b3075d30 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120506:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca800/0x5953bbf6b3075d30 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120512:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca800/0x5953bbf6b3075d30 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120518:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca800/0x5953bbf6b3075d30 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120524:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8ca800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290435.120528:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca800/0x5953bbf6b3075d30 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120538:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca800/0x5953bbf6b3075d30 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120555:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:3.0:1784290435.120559:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290435.120565:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca800/0x5953bbf6b3075d30 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120574:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca800/0x5953bbf6b3075d30 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120591:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cac00/0x5953bbf6b3075d37 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120609:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cac00/0x5953bbf6b3075d37 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120614:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cac00/0x5953bbf6b3075d37 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120626:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cac00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290435.120629:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cac00/0x5953bbf6b3075d37 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120637:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cac00/0x5953bbf6b3075d37 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120646:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe44515a3 (ffff9c2449f0d500) 00010000:00010000:3.0:1784290435.120648:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290435.120651:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cac00/0x5953bbf6b3075d37 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120656:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cac00/0x5953bbf6b3075d37 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120701:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb400/0x5953bbf6b3075d29 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2773 expref: 40 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120712:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb800/0x5953bbf6b3075d3e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2773 expref: 39 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.120718:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9c24821d9000) 00010000:00010000:3.0:1784290435.120721:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784290435.120725:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8cb800, rc 0) 00000100:00100000:3.0:1784290435.120774:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+39:73463:x1870961896308992:12345-192.168.202.6@tcp:101:dd.0 Request processed in 664us (771us total) trans 120259084355 rc 0/0 00000100:00100000:3.0:1784290435.120783:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1384 00000100:00100000:0.0:1784290435.121307:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.121390:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.121407:0:10356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896309120 00000100:00100000:2.0:1784290435.121418:0:10356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896309120 00000100:00100000:1.0:1784290435.121482:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896309248 00000100:00100000:1.0:1784290435.121495:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896309248 00000100:00100000:2.0:1784290435.121541:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 689 00000100:00100000:2.0:1784290435.121569:0:10356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+40:2398:x1870961896309120:12345-192.168.202.6@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1784290435.121583:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 690 00010000:00010000:2.0:1784290435.121604:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1784290435.121614:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+40:2398:x1870961896309248:12345-192.168.202.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784290435.121630:0:19592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290435.121647:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3075d22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b276c expref: 40 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.121654:0:19592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951800/0x5953bbf6b3075d0d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b275e expref: 40 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.121698:0:19592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:3.0:1784290435.121704:0:19592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290435.121713:0:10356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c2475800300) 00010000:00010000:2.0:1784290435.121731:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784290435.121742:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+38:2398:x1870961896309248:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 139us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290435.121749:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 690 00000100:00100000:2.0:1784290435.121781:0:10356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+37:2398:x1870961896309120:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 223us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290435.121793:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 689 00000100:00100000:1.0:1784290435.122425:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.122485:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896309376 00000100:00100000:0.0:1784290435.122494:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896309376 00000100:00100000:0.0:1784290435.122531:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1385 00000100:00100000:0.0:1784290435.122540:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+37:73463:x1870961896309376:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1784290435.122550:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290435.122558:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950200/0x5953bbf6b3075d4c lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b277a expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.122577:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950000/0x5953bbf6b3075d53 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.122584:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950000/0x5953bbf6b3075d53 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.122591:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950000/0x5953bbf6b3075d53 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.122673:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950200/0x5953bbf6b3075d4c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b277a expref: 39 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.122684:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950000/0x5953bbf6b3075d53 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b277a expref: 38 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.122690:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9c24821d9000) 00010000:00010000:0.0:1784290435.122692:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784290435.122694:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246d950000, rc 0) 00000100:00100000:0.0:1784290435.122730:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+38:73463:x1870961896309376:12345-192.168.202.6@tcp:101:dd.0 Request processed in 193us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290435.122743:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1385 00000100:00100000:1.0:1784290435.123137:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.123187:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896309632 00000100:00100000:2.0:1784290435.123197:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896309632 00000100:00100000:2.0:1784290435.123259:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1386 00000100:00100000:2.0:1784290435.123276:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+38:73464:x1870961896309632:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:2.0:1784290435.123295:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290435.123315:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b3075d5a lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2781 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123501:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075d61 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123515:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075d61 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123524:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075d61 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123538:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b3075d68 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123545:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b3075d68 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123551:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b3075d68 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123600:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075d6f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123620:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075d6f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123628:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075d6f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784290435.123638:0:65989:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x8:0x0]: returning size 0 00010000:00010000:2.0:1784290435.123722:0:65989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075d61 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123731:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075d61 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123738:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075d61 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123745:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075d61 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123751:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290435.123755:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075d61 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123763:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075d61 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123773:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:2.0:1784290435.123776:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290435.123780:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075d61 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123788:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075d61 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123812:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b3075d68 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123819:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b3075d68 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123827:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b3075d68 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123833:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290435.123836:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b3075d68 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123842:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b3075d68 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123850:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2c9ecea3 (ffff9c2475807b00) 00010000:00010000:2.0:1784290435.123853:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290435.123856:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b3075d68 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123863:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b3075d68 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123925:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b3075d5a lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2781 expref: 41 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123966:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075d6f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2781 expref: 40 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.123988:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9c24821d9a00) 00000100:00100000:1.0:1784290435.123991:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:2.0:1784290435.123993:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784290435.123999:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2482044c00, rc 0) 00000100:00100000:2.0:1784290435.124053:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+40:73464:x1870961896309632:12345-192.168.202.6@tcp:101:dd.0 Request processed in 783us (917us total) trans 120259084356 rc 0/0 00000100:00100000:2.0:1784290435.124063:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1386 00000100:00100000:3.0:1784290435.124089:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896309888 00000100:00100000:3.0:1784290435.124096:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896309888 00000100:00100000:3.0:1784290435.124138:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1387 00000100:00100000:3.0:1784290435.124145:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+40:73463:x1870961896309888:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:3.0:1784290435.124174:0:74876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290435.124220:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb800/0x5953bbf6b3075d3e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2773 expref: 40 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.124232:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9c24821d9000) 00010000:00010000:3.0:1784290435.124235:0:74876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290435.124379:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b3075d7d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.124388:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b3075d7d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.124395:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b3075d7d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784290435.124452:0:74876:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084357 00000004:00010000:3.0:1784290435.124478:0:74876:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009348f20b reply state 000000000316fcd6 transno 120259084358 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b3075d7d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.124489:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b3075d7d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.124493:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9c24821d9000) 00010000:00010000:3.0:1784290435.124495:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290435.124497:0:74876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290435.124557:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+42:73463:x1870961896309888:12345-192.168.202.6@tcp:36:dd.0 Request processed in 411us (571us total) trans 120259084358 rc 0/0 00000100:00100000:3.0:1784290435.124565:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1387 00000020:00080000:3.0:1784290435.124570:0:74876:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784290435.125767:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.125848:0:26257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896310016 00000100:00100000:0.0:1784290435.125855:0:26257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896310016 00000100:00100000:0.0:1784290435.125907:0:26257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5000 00000100:00100000:0.0:1784290435.125913:0:26257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:73463:x1870961896310016:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1784290435.125923:0:26257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290435.125958:0:26257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f9d3235/0x5953bbf6b3075d84 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2788 expref: -99 pid: 26257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.125999:0:26257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x763:0x0] initial LVB size: 0, mtime: 0x6a5a1c7e, atime: 0x6a5a1c7e, ctime: 0x6a5a1c7e, blocks: 0x0 00000100:00080000:2.0:1784290435.126001:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784290435.126018:0:26257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x763:0x0].0x0 since=2176s v=(0 0) 00010000:00010000:0.0:1784290435.126024:0:26257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x763:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290435.126033:0:26257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f9d3235/0x5953bbf6b3075d84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2788 expref: 6 pid: 26257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.126046:0:26257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f9d3235/0x5953bbf6b3075d84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2788 expref: 6 pid: 26257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.126056:0:26257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246d951400, rc 0) 00010000:00000080:0.0:1784290435.126063:0:26257:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2445d6f100 x1870961896310016/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 328/400 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.126101:0:26257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:73463:x1870961896310016:12345-192.168.202.6@tcp:101:dd.0 Request processed in 188us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290435.126107:0:26257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5000 00000100:00100000:1.0:1784290435.126610:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.126657:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896310144 00000100:00100000:3.0:1784290435.126664:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896310144 00000100:00100000:1.0:1784290435.126667:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.126721:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896310400 00000100:00100000:3.0:1784290435.126726:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896310400 00000100:00100000:3.0:1784290435.126753:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1388 00000100:00100000:3.0:1784290435.126770:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+43:73464:x1870961896310144:12345-192.168.202.6@tcp:101:dd.0 00000100:00100000:0.0:1784290435.126777:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1389 00010000:00010000:3.0:1784290435.126783:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290435.126801:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb200/0x5953bbf6b3075d8b lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b278f expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290435.126812:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+43:73465:x1870961896310400:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1784290435.126826:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290435.126829:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb600/0x5953bbf6b3075d92 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.126839:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb600/0x5953bbf6b3075d92 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.126840:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950400/0x5953bbf6b3075d99 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2796 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.126866:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb600/0x5953bbf6b3075d92 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.126907:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075da0 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.126917:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075da0 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.126924:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075da0 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.126926:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb200/0x5953bbf6b3075d8b lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b278f expref: 46 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.126967:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cb600/0x5953bbf6b3075d92 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b278f expref: 45 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.126970:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b3075da7 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.126978:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9c24821d9a00) 00010000:00010000:3.0:1784290435.126986:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784290435.126989:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8cb600, rc 0) 00010000:00010000:0.0:1784290435.126989:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b3075da7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.126997:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b3075da7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.127024:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+45:73464:x1870961896310144:12345-192.168.202.6@tcp:101:dd.0 Request processed in 264us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290435.127030:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1388 00010000:00010000:0.0:1784290435.127032:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950800/0x5953bbf6b3075dae lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.127040:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950800/0x5953bbf6b3075dae lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.127047:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950800/0x5953bbf6b3075dae lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290435.127062:0:66004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x9:0x0]: returning size 0 00010000:00010000:0.0:1784290435.127105:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075da0 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.127113:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075da0 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.127118:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075da0 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.127124:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075da0 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.127129:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246d951600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290435.127133:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075da0 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.127139:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075da0 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.127154:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:0.0:1784290435.127156:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290435.127159:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075da0 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.127163:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075da0 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.127172:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b3075da7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.127177:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b3075da7 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.127198:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b3075da7 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.127202:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246d951a00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290435.127204:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b3075da7 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.127208:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b3075da7 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.127214:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x74f887a3 (ffff9c2443b66500) 00010000:00010000:0.0:1784290435.127215:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290435.127217:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b3075da7 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.127221:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b3075da7 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.127248:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950400/0x5953bbf6b3075d99 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2796 expref: 46 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.127256:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950800/0x5953bbf6b3075dae lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2796 expref: 45 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.127261:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9c24821d9e00) 00010000:00010000:0.0:1784290435.127263:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784290435.127265:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246d950800, rc 0) 00000100:00100000:0.0:1784290435.127315:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+45:73465:x1870961896310400:12345-192.168.202.6@tcp:101:dd.0 Request processed in 512us (658us total) trans 120259084359 rc 0/0 00000100:00100000:0.0:1784290435.127330:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1389 00000100:00100000:2.0:1784290435.127506:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.127554:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896310528 00000100:00100000:3.0:1784290435.127564:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896310528 00002000:00010000:3.0:1784290435.127595:0:8407:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1891 (0->18446744073709551615) 00002000:00100000:3.0:1784290435.127600:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c24483d3100 with x1870961896310528 ext(0->18446744073709551615) 00002000:00010000:3.0:1784290435.127608:0:8407:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c24483d3100. 00000100:00100000:0.0:1784290435.127667:0:25104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 358 00000100:00100000:0.0:1784290435.127676:0:25104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2398:x1870961896310528:12345-192.168.202.6@tcp:10:dd.0 00002000:00010000:0.0:1784290435.127784:0:25104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784290435.127787:0:25104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb mtime from disk: 1784290430 -> 1784290435 00002000:00010000:0.0:1784290435.127789:0:25104:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb atime from disk: 1784290430 -> 1784290430 00002000:00010000:0.0:1784290435.127791:0:25104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb ctime from disk: 1784290430 -> 1784290435 00002000:00010000:0.0:1784290435.127793:0:25104:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1784290435.127798:0:25104:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c24483d3100 x1870961896310528/t4294968654(0) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.127833:0:25104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2398:x1870961896310528:12345-192.168.202.6@tcp:10:dd.0 Request processed in 160us (345us total) trans 4294968654 rc 0/0 00000100:00100000:0.0:1784290435.127839:0:25104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 358 00002000:00010000:0.0:1784290435.127842:0:25104:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1891 (0->18446744073709551615) 00002000:00100000:0.0:1784290435.127844:0:25104:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c24483d3100 with x1870961896310528 ext(0->18446744073709551615) 00002000:00010000:0.0:1784290435.127848:0:25104:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c24483d3100. 00000100:00100000:1.0:1784290435.129661:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.129731:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896310784 00000100:00100000:3.0:1784290435.129737:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896310784 00000100:00100000:1.0:1784290435.129745:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.129784:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896310912 00000100:00100000:3.0:1784290435.129789:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896310912 00000100:00100000:1.0:1784290435.129804:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.129826:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1390 00000100:00100000:3.0:1784290435.129837:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+46:73464:x1870961896310784:12345-192.168.202.6@tcp:36:dd.0 00000100:00100000:0.0:1784290435.129857:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896311168 00010000:00010000:3.0:1784290435.129863:0:65990:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784290435.129865:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896311168 00010000:00010000:3.0:1784290435.129893:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075d6f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2781 expref: 47 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.129895:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1391 00010000:00010000:3.0:1784290435.129929:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9c24821d9a00) 00000100:00100000:2.0:1784290435.129931:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+46:73465:x1870961896310912:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:3.0:1784290435.129950:0:65990:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784290435.129963:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1392 00010000:00010000:2.0:1784290435.129972:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1784290435.129991:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+46:73469:x1870961896311168:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:2.0:1784290435.129993:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075dbc lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b279d expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.130010:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290435.130032:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c000/0x5953bbf6b3075dc3 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b27a4 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.130035:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3075dca lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.130043:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075dd1 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.130089:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3075dca lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.130105:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075dd1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.130138:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3075dca lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.130139:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075dd1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.130204:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b3075dd8 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784290435.130214:0:65990:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084360 00010000:00010000:1.0:1784290435.130220:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b3075dd8 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784290435.130232:0:65990:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005f37cb37 reply state 000000000e35a2bb transno 120259084361 ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075dd1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.130234:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b3075dd8 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.130280:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075dbc lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b279d expref: 51 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.130283:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075dd1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.130287:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7de00/0x5953bbf6b3075ddf lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.130403:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7de00/0x5953bbf6b3075ddf lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.130409:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044200/0x5953bbf6b3075dca lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b279d expref: 50 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.130418:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7de00/0x5953bbf6b3075ddf lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.130454:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9c24821d9e00) 00010000:00010000:3.0:1784290435.130456:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9c24821d9a00) 00010000:00010000:2.0:1784290435.130459:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784290435.130463:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290435.130466:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2482044200, rc 0) 00000100:00100000:3.0:1784290435.130468:0:65990:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784290435.130498:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c800/0x5953bbf6b3075de6 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.130509:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c800/0x5953bbf6b3075de6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.130519:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c800/0x5953bbf6b3075de6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290435.130532:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.130547:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+50:73465:x1870961896310912:12345-192.168.202.6@tcp:101:dd.0 Request processed in 623us (793us total) trans 0 rc 0/0 00000004:00200000:1.0:1784290435.130549:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xd:0x0]: returning size 0 00000100:00100000:2.0:1784290435.130563:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1391 00000100:00100000:2.0:1784290435.130629:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896311424 00000100:00100000:3.0:1784290435.130631:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+51:73464:x1870961896310784:12345-192.168.202.6@tcp:36:dd.0 Request processed in 790us (969us total) trans 120259084361 rc 0/0 00010000:00010000:1.0:1784290435.130632:0:65988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b3075dd8 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.130638:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896311424 00010000:00010000:1.0:1784290435.130671:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b3075dd8 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.130697:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 261 00010000:00010000:1.0:1784290435.130704:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b3075dd8 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.130718:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+52:73463:x1870961896311424:12345-192.168.202.6@tcp:35:dd.0 00010000:00010000:1.0:1784290435.130726:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b3075dd8 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.130734:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1390 00000020:00080000:3.0:1784290435.130744:0:65990:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784290435.130755:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7c400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290435.130764:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b3075dd8 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.130774:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b3075dd8 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.130788:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:1.0:1784290435.130791:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290435.130795:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b3075dd8 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.130802:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b3075dd8 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.130815:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7de00/0x5953bbf6b3075ddf lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.130822:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7de00/0x5953bbf6b3075ddf lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.130829:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7de00/0x5953bbf6b3075ddf lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.130834:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7de00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290435.130847:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7de00/0x5953bbf6b3075ddf lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.130854:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7de00/0x5953bbf6b3075ddf lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.130864:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x965f6ba3 (ffff9c2458ba5600) 00010000:00010000:1.0:1784290435.130866:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290435.130870:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7de00/0x5953bbf6b3075ddf lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.130878:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7de00/0x5953bbf6b3075ddf lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.130929:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c000/0x5953bbf6b3075dc3 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27a4 expref: 53 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.130968:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+53:73463:x1870961896311424:12345-192.168.202.6@tcp:35:dd.0 Request processed in 257us (447us total) trans 120259084363 rc 0/0 00000100:00100000:2.0:1784290435.130982:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 261 00010000:00010000:1.0:1784290435.130983:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c800/0x5953bbf6b3075de6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27a4 expref: 52 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.130995:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9c2446227c00) 00010000:00010000:1.0:1784290435.130999:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784290435.131004:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2469a7c800, rc 0) 00000100:00100000:1.0:1784290435.131059:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+51:73469:x1870961896311168:12345-192.168.202.6@tcp:101:dd.0 Request processed in 1084us (1261us total) trans 120259084362 rc 0/0 00000100:00100000:1.0:1784290435.131088:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1392 00000100:00100000:0.0:1784290435.131890:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290435.132018:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896311680 00000100:00100000:1.0:1784290435.132029:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896311680 00000100:00100000:1.0:1784290435.132092:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1393 00000100:00100000:1.0:1784290435.132108:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+51:73465:x1870961896311680:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:1.0:1784290435.132160:0:65989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290435.132181:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950800/0x5953bbf6b3075dae lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2796 expref: 51 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.132220:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9c24821d9e00) 00010000:00010000:1.0:1784290435.132227:0:65989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290435.132424:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7da00/0x5953bbf6b3075df4 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.132436:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7da00/0x5953bbf6b3075df4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.132446:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7da00/0x5953bbf6b3075df4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784290435.132493:0:65989:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084364 00000004:00010000:1.0:1784290435.132516:0:65989:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d5389e6c reply state 00000000e9860daf transno 120259084365 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7da00/0x5953bbf6b3075df4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.132530:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7da00/0x5953bbf6b3075df4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.132537:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9c24821d9e00) 00010000:00010000:1.0:1784290435.132540:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784290435.132542:0:65989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784290435.132610:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+53:73465:x1870961896311680:12345-192.168.202.6@tcp:36:dd.0 Request processed in 506us (720us total) trans 120259084365 rc 0/0 00000100:00100000:1.0:1784290435.132621:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1393 00000020:00080000:1.0:1784290435.132627:0:65989:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784290435.132850:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.133002:0:26261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896311808 00000100:00100000:2.0:1784290435.133011:0:26261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896311808 00000100:00100000:2.0:1784290435.133065:0:26261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5001 00000100:00100000:2.0:1784290435.133076:0:26261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:73464:x1870961896311808:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:2.0:1784290435.133088:0:26261:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290435.133104:0:26261:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b3075dfb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b27ab expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290435.133128:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x764:0x0] initial LVB size: 0, mtime: 0x6a5a1c7e, atime: 0x6a5a1c7e, ctime: 0x6a5a1c7e, blocks: 0x0 00010000:00010000:2.0:1784290435.133146:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x764:0x0].0x0 since=2176s v=(0 0) 00010000:00010000:2.0:1784290435.133151:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x764:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290435.133171:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b3075dfb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27ab expref: 8 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.133189:0:26261:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b3075dfb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27ab expref: 8 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.133213:0:26261:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2482045e00, rc 0) 00010000:00000080:2.0:1784290435.133222:0:26261:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2446e55500 x1870961896311808/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 328/400 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.133269:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.133295:0:26261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:73464:x1870961896311808:12345-192.168.202.6@tcp:101:dd.0 Request processed in 214us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290435.133308:0:26261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5001 00000100:00100000:1.0:1784290435.133406:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896311936 00000100:00100000:1.0:1784290435.133423:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896311936 00000100:00100000:1.0:1784290435.133520:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1394 00000100:00100000:1.0:1784290435.133543:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+53:73469:x1870961896311936:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:1.0:1784290435.133558:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290435.133570:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d000/0x5953bbf6b3075e02 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b27b2 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.133591:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c200/0x5953bbf6b3075e09 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.133601:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c200/0x5953bbf6b3075e09 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.133610:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c200/0x5953bbf6b3075e09 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.133690:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d000/0x5953bbf6b3075e02 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27b2 expref: 55 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.133714:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c200/0x5953bbf6b3075e09 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27b2 expref: 54 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.133726:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9c2446227c00) 00010000:00010000:1.0:1784290435.133730:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784290435.133734:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2469a7c200, rc 0) 00000100:00100000:1.0:1784290435.133780:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+54:73469:x1870961896311936:12345-192.168.202.6@tcp:101:dd.0 Request processed in 248us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290435.133788:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1394 00000100:00100000:0.0:1784290435.134487:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.134512:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.134526:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896312320 00000100:00100000:3.0:1784290435.134533:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896312320 00000100:00100000:1.0:1784290435.134559:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896312192 00000100:00100000:1.0:1784290435.134575:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896312192 00000100:00100000:3.0:1784290435.134600:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5002 00000100:00100000:3.0:1784290435.134611:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:73465:x1870961896312320:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:3.0:1784290435.134628:0:9000:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1784290435.134635:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1395 00010000:00010000:3.0:1784290435.134648:0:9000:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006e71acd/0x5953bbf6b3075e10 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b27c0 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.134649:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+54:73462:x1870961896312192:12345-192.168.202.6@tcp:101:dd.0 00002000:00010000:3.0:1784290435.134686:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x765:0x0] initial LVB size: 0, mtime: 0x6a5a1c7e, atime: 0x6a5a1c7e, ctime: 0x6a5a1c7e, blocks: 0x0 00010000:00010000:1.0:1784290435.134692:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290435.134699:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x765:0x0].0x0 since=2176s v=(0 0) 00010000:00010000:3.0:1784290435.134704:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x765:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290435.134710:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e71acd/0x5953bbf6b3075e10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27c0 expref: 9 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.134714:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b3075e17 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b27b9 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.134728:0:9000:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000006e71acd/0x5953bbf6b3075e10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27c0 expref: 9 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.134754:0:9000:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8cb200, rc 0) 00010000:00000080:3.0:1784290435.134759:0:9000:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2446e57b80 x1870961896312320/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 328/400 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290435.134797:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:73465:x1870961896312320:12345-192.168.202.6@tcp:101:dd.0 Request processed in 189us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290435.134807:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5002 00010000:00010000:1.0:1784290435.134827:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075e1e lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.134841:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075e1e lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.134851:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075e1e lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.134865:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b3075e25 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.134872:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b3075e25 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.134879:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b3075e25 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.134933:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d400/0x5953bbf6b3075e2c lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.134986:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d400/0x5953bbf6b3075e2c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.134994:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d400/0x5953bbf6b3075e2c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290435.135012:0:65990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x6:0x0]: returning size 0 00010000:00010000:1.0:1784290435.135056:0:65990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075e1e lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.135064:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075e1e lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.135071:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075e1e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.135077:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075e1e lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.135082:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7ca00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290435.135085:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075e1e lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.135091:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075e1e lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.135101:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:1.0:1784290435.135104:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290435.135107:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075e1e lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.135114:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075e1e lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.135124:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b3075e25 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.135129:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b3075e25 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.135143:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b3075e25 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.135149:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7ce00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290435.135152:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b3075e25 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.135158:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b3075e25 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.135165:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x9beb5ca3 (ffff9c2458ba5000) 00010000:00010000:1.0:1784290435.135167:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290435.135170:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b3075e25 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.135176:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b3075e25 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.135225:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b3075e17 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27b9 expref: 57 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.135239:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d400/0x5953bbf6b3075e2c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27b9 expref: 56 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.135247:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9c24821d9400) 00010000:00010000:1.0:1784290435.135250:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784290435.135252:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2469a7d400, rc 0) 00000100:00100000:1.0:1784290435.135302:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+56:73462:x1870961896312192:12345-192.168.202.6@tcp:101:dd.0 Request processed in 658us (787us total) trans 120259084366 rc 0/0 00000100:00100000:1.0:1784290435.135323:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1395 00000100:00100000:0.0:1784290435.135544:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290435.135626:0:25097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896312448 00000100:00100000:1.0:1784290435.135637:0:25097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896312448 00002000:00010000:1.0:1784290435.135668:0:25097:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1892 (0->18446744073709551615) 00002000:00100000:1.0:1784290435.135675:0:25097:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2446e55880 with x1870961896312448 ext(0->18446744073709551615) 00002000:00010000:1.0:1784290435.135686:0:25097:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2446e55880. 00000100:00100000:1.0:1784290435.135756:0:25097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 359 00000100:00100000:1.0:1784290435.135774:0:25097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:2399:x1870961896312448:12345-192.168.202.6@tcp:10:dd.0 00002000:00010000:1.0:1784290435.135993:0:25097:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1784290435.136001:0:25097:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb mtime from disk: 1784290430 -> 1784290435 00002000:00010000:1.0:1784290435.136007:0:25097:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb atime from disk: 1784290430 -> 1784290430 00002000:00010000:1.0:1784290435.136011:0:25097:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb ctime from disk: 1784290430 -> 1784290435 00002000:00010000:1.0:1784290435.136016:0:25097:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1784290435.136028:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00000080:1.0:1784290435.136063:0:25097:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2446e55880 x1870961896312448/t4294968655(0) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290435.136144:0:25097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:2399:x1870961896312448:12345-192.168.202.6@tcp:10:dd.0 Request processed in 375us (601us total) trans 4294968655 rc 0/0 00000100:00100000:1.0:1784290435.136162:0:25097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 359 00002000:00010000:1.0:1784290435.136170:0:25097:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1892 (0->18446744073709551615) 00002000:00100000:1.0:1784290435.136176:0:25097:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2446e55880 with x1870961896312448 ext(0->18446744073709551615) 00002000:00010000:1.0:1784290435.136186:0:25097:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2446e55880. 00000100:00100000:0.0:1784290435.136271:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290435.136273:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896312704 00000100:00100000:1.0:1784290435.136285:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896312704 00000100:00100000:3.0:1784290435.136391:0:25100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896312832 00000100:00100000:0.0:1784290435.136394:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1396 00000100:00100000:3.0:1784290435.136402:0:25100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896312832 00000100:00100000:0.0:1784290435.136408:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+56:73469:x1870961896312704:12345-192.168.202.6@tcp:36:dd.0 00002000:00010000:3.0:1784290435.136433:0:25100:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1893 (0->18446744073709551615) 00002000:00100000:3.0:1784290435.136439:0:25100:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2446e57480 with x1870961896312832 ext(0->18446744073709551615) 00010000:00010000:0.0:1784290435.136440:0:65989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1784290435.136451:0:25100:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2446e57480. 00010000:00010000:0.0:1784290435.136460:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c800/0x5953bbf6b3075de6 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27a4 expref: 56 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.136476:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9c2446227c00) 00010000:00010000:0.0:1784290435.136480:0:65989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784290435.136492:0:25100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 360 00000100:00100000:3.0:1784290435.136503:0:25100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:2397:x1870961896312832:12345-192.168.202.6@tcp:10:dd.0 00010000:00010000:0.0:1784290435.136574:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075e3a lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.136584:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075e3a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.136590:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075e3a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290435.136606:0:25100:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1784290435.136610:0:25100:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb mtime from disk: 1784290430 -> 1784290435 00002000:00010000:3.0:1784290435.136612:0:25100:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb atime from disk: 1784290430 -> 1784290430 00002000:00010000:3.0:1784290435.136614:0:25100:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb ctime from disk: 1784290430 -> 1784290435 00002000:00010000:3.0:1784290435.136616:0:25100:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb blocks from disk: 0 -> 0 00000001:00080000:0.0:1784290435.136622:0:65989:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084367 00010000:00000080:3.0:1784290435.136623:0:25100:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2446e57480 x1870961896312832/t4294968656(0) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000004:00010000:0.0:1784290435.136642:0:65989:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000635f3a36 reply state 00000000465d227a transno 120259084368 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075e3a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.136652:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075e3a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.136658:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9c2446227c00) 00010000:00010000:0.0:1784290435.136660:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290435.136662:0:65989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290435.136666:0:25100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:2397:x1870961896312832:12345-192.168.202.6@tcp:10:dd.0 Request processed in 166us (402us total) trans 4294968656 rc 0/0 00000100:00100000:3.0:1784290435.136673:0:25100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 360 00002000:00010000:3.0:1784290435.136676:0:25100:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1893 (0->18446744073709551615) 00002000:00100000:3.0:1784290435.136678:0:25100:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2446e57480 with x1870961896312832 ext(0->18446744073709551615) 00002000:00010000:3.0:1784290435.136682:0:25100:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2446e57480. 00000100:00100000:0.0:1784290435.136713:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+58:73469:x1870961896312704:12345-192.168.202.6@tcp:36:dd.0 Request processed in 306us (683us total) trans 120259084368 rc 0/0 00000100:00100000:0.0:1784290435.136726:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1396 00000020:00080000:0.0:1784290435.136731:0:65989:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784290435.138173:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.138309:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896312960 00000100:00100000:2.0:1784290435.138319:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896312960 00000100:00100000:2.0:1784290435.138426:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1397 00000100:00100000:2.0:1784290435.138437:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+58:73462:x1870961896312960:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:2.0:1784290435.138454:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290435.138466:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075e41 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b27c7 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.138491:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075e48 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.138503:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075e48 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.138513:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075e48 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.138609:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b3075e41 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27c7 expref: 60 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.138636:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045400/0x5953bbf6b3075e48 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27c7 expref: 59 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.138644:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9c24821d9400) 00010000:00010000:2.0:1784290435.138648:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784290435.138650:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2482045400, rc 0) 00000100:00100000:2.0:1784290435.138702:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+59:73462:x1870961896312960:12345-192.168.202.6@tcp:101:dd.0 Request processed in 267us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290435.138712:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1397 00000100:00100000:0.0:1784290435.138813:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.138884:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896313216 00000100:00100000:0.0:1784290435.138885:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.138897:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896313216 00000100:00100000:2.0:1784290435.139002:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1398 00000100:00100000:3.0:1784290435.139026:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896313472 00000100:00100000:2.0:1784290435.139042:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+59:73472:x1870961896313216:12345-192.168.202.6@tcp:101:dd.0 00000100:00100000:3.0:1784290435.139046:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896313472 00010000:00010000:2.0:1784290435.139062:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290435.139077:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075e4f lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b27ce expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290435.139113:0:68995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 262 00000100:00100000:0.0:1784290435.139126:0:68995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+61:73465:x1870961896313472:12345-192.168.202.6@tcp:35:dd.0 00010000:00010000:2.0:1784290435.139164:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075e56 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.139179:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075e56 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.139191:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075e56 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.139212:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:2.0:1784290435.139225:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b3075e5d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.139239:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b3075e5d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.139251:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b3075e5d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290435.139307:0:68995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+62:73465:x1870961896313472:12345-192.168.202.6@tcp:35:dd.0 Request processed in 180us (424us total) trans 120259084369 rc 0/0 00010000:00010000:2.0:1784290435.139308:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b3075e64 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.139321:0:26251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896313600 00000100:00100000:3.0:1784290435.139333:0:26251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896313600 00010000:00010000:2.0:1784290435.139348:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b3075e64 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.139363:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b3075e64 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290435.139365:0:68995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 262 00000004:00200000:2.0:1784290435.139442:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x10:0x0]: returning size 0 00000100:00100000:3.0:1784290435.139444:0:26251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5003 00000100:00100000:3.0:1784290435.139504:0:26251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:73469:x1870961896313600:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:3.0:1784290435.139514:0:26251:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290435.139528:0:26251:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cadb06b/0x5953bbf6b3075e72 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b27d5 expref: -99 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.139542:0:65988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075e56 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290435.139551:0:26251:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x769:0x0] initial LVB size: 0, mtime: 0x6a5a1c7e, atime: 0x6a5a1c7e, ctime: 0x6a5a1c7e, blocks: 0x0 00010000:00010000:2.0:1784290435.139554:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075e56 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.139566:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075e56 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.139574:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075e56 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.139575:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x769:0x0].0x0 since=2176s v=(0 0) 00010000:00010000:2.0:1784290435.139593:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290435.139596:0:26251:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x769:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290435.139609:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075e56 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.139617:0:26251:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cadb06b/0x5953bbf6b3075e72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27d5 expref: 12 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.139629:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075e56 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.139644:0:26251:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001cadb06b/0x5953bbf6b3075e72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27d5 expref: 12 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.139649:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:2.0:1784290435.139667:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290435.139671:0:26251:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8cb800, rc 0) 00010000:00010000:2.0:1784290435.139675:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075e56 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:3.0:1784290435.139681:0:26251:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2445d6c380 x1870961896313600/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 328/400 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1784290435.139704:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3075e56 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.139725:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b3075e5d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.139733:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b3075e5d lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.139740:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b3075e5d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.139752:0:26251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+12:73469:x1870961896313600:12345-192.168.202.6@tcp:101:dd.0 Request processed in 242us (535us total) trans 0 rc 0/0 00010000:00010000:2.0:1784290435.139773:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236ce00 already unused, calling callback (ffffffffc1aba4f0) 00000100:00100000:3.0:1784290435.139782:0:26251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5003 00010000:00010000:2.0:1784290435.139784:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b3075e5d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.139800:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b3075e5d lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.139825:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8545ca3 (ffff9c2475807b00) 00010000:00010000:2.0:1784290435.139829:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290435.139844:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b3075e5d lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.139851:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b3075e5d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.139907:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3075e4f lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27ce expref: 63 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.139926:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b3075e64 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27ce expref: 62 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.139934:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9c2446227100) 00010000:00010000:2.0:1784290435.139962:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784290435.139966:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236c200, rc 0) 00000100:00100000:2.0:1784290435.140016:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+62:73472:x1870961896313216:12345-192.168.202.6@tcp:101:dd.0 Request processed in 1004us (1208us total) trans 120259084370 rc 0/0 00000100:00100000:2.0:1784290435.140025:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1398 00000100:00100000:1.0:1784290435.141554:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290435.141607:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.141625:0:25102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896314240 00000100:00100000:0.0:1784290435.141636:0:25102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896314240 00000100:00100000:1.0:1784290435.141652:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.141661:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896314112 00002000:00010000:0.0:1784290435.141669:0:25102:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1897 (0->18446744073709551615) 00000100:00100000:2.0:1784290435.141673:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896314112 00002000:00100000:0.0:1784290435.141678:0:25102:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2445d6df80 with x1870961896314240 ext(0->18446744073709551615) 00002000:00010000:0.0:1784290435.141692:0:25102:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2445d6df80. 00000100:00100000:3.0:1784290435.141730:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896313856 00000100:00100000:0.0:1784290435.141737:0:25102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 361 00000100:00100000:3.0:1784290435.141740:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896313856 00000100:00100000:2.0:1784290435.141754:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1399 00000100:00100000:0.0:1784290435.141764:0:25102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+12:2399:x1870961896314240:12345-192.168.202.6@tcp:10:dd.0 00000100:00100000:2.0:1784290435.141780:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+63:73462:x1870961896314112:12345-192.168.202.6@tcp:36:dd.0 00000100:00100000:3.0:1784290435.141802:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 263 00000100:00100000:3.0:1784290435.141824:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+63:73464:x1870961896313856:12345-192.168.202.6@tcp:35:dd.0 00010000:00010000:2.0:1784290435.141828:0:66004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290435.141856:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d400/0x5953bbf6b3075e2c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27b9 expref: 63 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.141866:0:25102:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784290435.141871:0:25102:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb mtime from disk: 1784290430 -> 1784290435 00002000:00010000:0.0:1784290435.141875:0:25102:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb atime from disk: 1784290430 -> 1784290430 00002000:00010000:0.0:1784290435.141878:0:25102:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb ctime from disk: 1784290430 -> 1784290435 00010000:00010000:2.0:1784290435.141880:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9c24821d9400) 00002000:00010000:0.0:1784290435.141882:0:25102:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:2.0:1784290435.141890:0:66004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00000080:0.0:1784290435.141897:0:25102:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2445d6df80 x1870961896314240/t4294968657(0) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.141968:0:25102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+13:2399:x1870961896314240:12345-192.168.202.6@tcp:10:dd.0 Request processed in 219us (415us total) trans 4294968657 rc 0/0 00000100:00100000:0.0:1784290435.141992:0:25102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 361 00002000:00010000:0.0:1784290435.141999:0:25102:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1897 (0->18446744073709551615) 00002000:00100000:0.0:1784290435.142002:0:25102:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2445d6df80 with x1870961896314240 ext(0->18446744073709551615) 00000100:00100000:3.0:1784290435.142007:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+63:73464:x1870961896313856:12345-192.168.202.6@tcp:35:dd.0 Request processed in 192us (360us total) trans 120259084371 rc 0/0 00002000:00010000:0.0:1784290435.142008:0:25102:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2445d6df80. 00000100:00100000:3.0:1784290435.142023:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 263 00010000:00010000:2.0:1784290435.142088:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075e79 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.142104:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075e79 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.142115:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075e79 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784290435.142153:0:66004:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084372 00000004:00010000:2.0:1784290435.142175:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001960a47b reply state 00000000cdb849dc transno 120259084373 ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075e79 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.142188:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075e79 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.142196:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9c24821d9400) 00010000:00010000:2.0:1784290435.142199:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290435.142202:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784290435.142283:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345b75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+65:73462:x1870961896314112:12345-192.168.202.6@tcp:36:dd.0 Request processed in 513us (674us total) trans 120259084373 rc 0/0 00000100:00100000:2.0:1784290435.142298:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1399 00000020:00080000:2.0:1784290435.142305:0:66004:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784290435.142451:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.142513:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896314368 00000100:00100000:0.0:1784290435.142519:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896314368 00000100:00100000:0.0:1784290435.142552:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1400 00000100:00100000:0.0:1784290435.142558:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+65:73472:x1870961896314368:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1784290435.142571:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290435.142583:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950800/0x5953bbf6b3075e80 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b27dc expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.142604:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951e00/0x5953bbf6b3075e87 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.142613:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951e00/0x5953bbf6b3075e87 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.142620:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951e00/0x5953bbf6b3075e87 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.142691:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950800/0x5953bbf6b3075e80 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27dc expref: 67 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.142711:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951e00/0x5953bbf6b3075e87 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27dc expref: 66 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.142721:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9c2446227100) 00010000:00010000:0.0:1784290435.142733:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784290435.142737:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246d951e00, rc 0) 00000100:00100000:0.0:1784290435.142787:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345b76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+66:73472:x1870961896314368:12345-192.168.202.6@tcp:101:dd.0 Request processed in 226us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290435.142796:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1400 00000100:00100000:1.0:1784290435.142926:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.143025:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896314624 00000100:00100000:2.0:1784290435.143036:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896314624 00000100:00100000:2.0:1784290435.143091:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1401 00000100:00100000:2.0:1784290435.143102:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+66:73466:x1870961896314624:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:2.0:1784290435.143118:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290435.143131:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3075e8e lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b27e3 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143231:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075e95 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143255:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075e95 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143265:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075e95 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143281:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075e9c lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143289:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075e9c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143296:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075e9c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143401:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075ea3 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143411:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075ea3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143420:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075ea3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784290435.143430:0:65990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xa:0x0]: returning size 0 00010000:00010000:2.0:1784290435.143481:0:65990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075e95 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143490:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075e95 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143505:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075e95 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143512:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075e95 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143518:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290435.143522:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075e95 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143529:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075e95 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143540:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:2.0:1784290435.143543:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290435.143547:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075e95 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143553:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b3075e95 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143566:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075e9c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143572:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075e9c lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143579:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075e9c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143585:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450abc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290435.143593:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075e9c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143600:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075e9c lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143609:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xbd5240a3 (ffff9c2442ffe200) 00010000:00010000:2.0:1784290435.143611:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290435.143614:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075e9c lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143620:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b3075e9c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143657:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b3075e8e lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27e3 expref: 69 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143672:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075ea3 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27e3 expref: 68 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.143680:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9c2446227300) 00010000:00010000:2.0:1784290435.143683:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784290435.143687:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aa600, rc 0) 00000100:00100000:2.0:1784290435.143755:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345b74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+68:73466:x1870961896314624:12345-192.168.202.6@tcp:101:dd.0 Request processed in 653us (828us total) trans 120259084374 rc 0/0 00000100:00100000:2.0:1784290435.143764:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1401 00000100:00100000:3.0:1784290435.144462:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.144496:0:68995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896314880 00000100:00100000:0.0:1784290435.144502:0:68995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896314880 00000100:00100000:0.0:1784290435.144534:0:68995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 264 00000100:00100000:0.0:1784290435.144540:0:68995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+68:73469:x1870961896314880:12345-192.168.202.6@tcp:35:dd.0 00000100:00100000:0.0:1784290435.144692:0:68995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+69:73469:x1870961896314880:12345-192.168.202.6@tcp:35:dd.0 Request processed in 152us (232us total) trans 120259084375 rc 0/0 00000100:00100000:0.0:1784290435.144699:0:68995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 264 00000100:00100000:1.0:1784290435.144771:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.144928:0:26263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896315008 00000100:00100000:3.0:1784290435.144934:0:26263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896315008 00000100:00100000:3.0:1784290435.144998:0:26263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5004 00000100:00100000:3.0:1784290435.145003:0:26263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345b77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+13:73462:x1870961896315008:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:3.0:1784290435.145012:0:26263:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290435.145029:0:26263:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b7dec93/0x5953bbf6b3075eb1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b27ea expref: -99 pid: 26263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290435.145046:0:26263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x762:0x0] initial LVB size: 0, mtime: 0x6a5a1c7e, atime: 0x6a5a1c7e, ctime: 0x6a5a1c7e, blocks: 0x0 00010000:00010000:3.0:1784290435.145056:0:26263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x762:0x0].0x0 since=2176s v=(0 0) 00010000:00010000:3.0:1784290435.145059:0:26263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x762:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290435.145065:0:26263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b7dec93/0x5953bbf6b3075eb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27ea expref: 14 pid: 26263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.145075:0:26263:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007b7dec93/0x5953bbf6b3075eb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27ea expref: 14 pid: 26263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.145083:0:26263:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8cb400, rc 0) 00010000:00000080:3.0:1784290435.145087:0:26263:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2345b77480 x1870961896315008/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 328/400 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290435.145123:0:26263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345b77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+14:73462:x1870961896315008:12345-192.168.202.6@tcp:101:dd.0 Request processed in 120us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290435.145128:0:26263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5004 00000100:00100000:2.0:1784290435.145404:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.145442:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896315264 00000100:00100000:0.0:1784290435.145448:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896315264 00000100:00100000:0.0:1784290435.145479:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1402 00000100:00100000:0.0:1784290435.145486:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+69:73472:x1870961896315264:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:0.0:1784290435.145510:0:65989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290435.145523:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b3075e64 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27ce expref: 69 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.145536:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9c2446227100) 00010000:00010000:0.0:1784290435.145539:0:65989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290435.145601:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950e00/0x5953bbf6b3075eb8 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.145627:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950e00/0x5953bbf6b3075eb8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.145644:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950e00/0x5953bbf6b3075eb8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784290435.145674:0:65989:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084376 00000004:00010000:0.0:1784290435.145698:0:65989:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000052e57c9c reply state 00000000e5555ec9 transno 120259084377 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950e00/0x5953bbf6b3075eb8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.145707:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950e00/0x5953bbf6b3075eb8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.145713:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9c2446227100) 00010000:00010000:0.0:1784290435.145715:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290435.145717:0:65989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784290435.145769:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.145778:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+71:73472:x1870961896315264:12345-192.168.202.6@tcp:36:dd.0 Request processed in 285us (382us total) trans 120259084377 rc 0/0 00000100:00100000:0.0:1784290435.145788:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1402 00000020:00080000:0.0:1784290435.145794:0:65989:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784290435.145816:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896315392 00000100:00100000:0.0:1784290435.145819:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896315392 00000100:00100000:0.0:1784290435.145845:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1403 00000100:00100000:0.0:1784290435.145854:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+71:73466:x1870961896315392:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1784290435.145863:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290435.145877:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951800/0x5953bbf6b3075ebf lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b27f1 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.145895:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950600/0x5953bbf6b3075ec6 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.145903:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950600/0x5953bbf6b3075ec6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.145917:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950600/0x5953bbf6b3075ec6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.145989:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951800/0x5953bbf6b3075ebf lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27f1 expref: 73 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.146001:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950600/0x5953bbf6b3075ec6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27f1 expref: 72 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.146007:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9c2446227300) 00010000:00010000:0.0:1784290435.146009:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784290435.146011:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246d950600, rc 0) 00000100:00100000:0.0:1784290435.146039:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+72:73466:x1870961896315392:12345-192.168.202.6@tcp:101:dd.0 Request processed in 187us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290435.146043:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1403 00000100:00100000:3.0:1784290435.146330:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.146399:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896315776 00000100:00100000:0.0:1784290435.146403:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896315776 00000100:00100000:3.0:1784290435.146414:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00002000:00010000:0.0:1784290435.146426:0:24752:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1890 (0->18446744073709551615) 00002000:00100000:0.0:1784290435.146431:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c246dfd2a00 with x1870961896315776 ext(0->18446744073709551615) 00002000:00010000:0.0:1784290435.146437:0:24752:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c246dfd2a00. 00000100:00100000:0.0:1784290435.146460:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 362 00000100:00100000:0.0:1784290435.146467:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+14:2399:x1870961896315776:12345-192.168.202.6@tcp:10:dd.0 00000100:00100000:1.0:1784290435.146534:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896315648 00002000:00010000:0.0:1784290435.146540:0:24752:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1784290435.146545:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896315648 00002000:00010000:0.0:1784290435.146545:0:24752:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb mtime from disk: 1784290430 -> 1784290435 00002000:00010000:0.0:1784290435.146559:0:24752:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb atime from disk: 1784290430 -> 1784290430 00002000:00010000:0.0:1784290435.146562:0:24752:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb ctime from disk: 1784290430 -> 1784290435 00002000:00010000:0.0:1784290435.146570:0:24752:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1784290435.146579:0:24752:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c246dfd2a00 x1870961896315776/t4294968658(0) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290435.146624:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1404 00000100:00100000:0.0:1784290435.146639:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+15:2399:x1870961896315776:12345-192.168.202.6@tcp:10:dd.0 Request processed in 167us (305us total) trans 4294968658 rc 0/0 00000100:00100000:1.0:1784290435.146641:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+72:73467:x1870961896315648:12345-192.168.202.6@tcp:101:dd.0 00000100:00100000:0.0:1784290435.146666:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 362 00002000:00010000:0.0:1784290435.146670:0:24752:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1890 (0->18446744073709551615) 00002000:00100000:0.0:1784290435.146672:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c246dfd2a00 with x1870961896315776 ext(0->18446744073709551615) 00010000:00010000:1.0:1784290435.146675:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1784290435.146678:0:24752:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c246dfd2a00. 00010000:00010000:1.0:1784290435.146702:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075ecd lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b27f8 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.146803:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075ed4 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.146816:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075ed4 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.146825:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075ed4 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.146838:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3075edb lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.146845:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3075edb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.146852:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3075edb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.146912:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b3075ee2 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.146922:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b3075ee2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.146929:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b3075ee2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290435.146960:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xb:0x0]: returning size 0 00010000:00010000:1.0:1784290435.147026:0:65988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075ed4 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.147034:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075ed4 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.147040:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075ed4 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.147046:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075ed4 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.147052:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7dc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290435.147055:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075ed4 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.147062:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075ed4 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.147073:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:1.0:1784290435.147076:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290435.147089:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075ed4 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.147097:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075ed4 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.147115:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3075edb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.147122:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3075edb lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.147129:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3075edb lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.147135:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7d600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290435.147139:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3075edb lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.147146:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3075edb lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.147157:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x5abf9a3 (ffff9c2458ba5000) 00010000:00010000:1.0:1784290435.147160:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290435.147164:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3075edb lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.147171:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3075edb lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.147184:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:1.0:1784290435.147226:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3075ecd lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27f8 expref: 75 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.147240:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896315904 00000100:00100000:3.0:1784290435.147251:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896315904 00010000:00010000:1.0:1784290435.147265:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b3075ee2 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27f8 expref: 74 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.147274:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9c2446227a00) 00010000:00010000:1.0:1784290435.147277:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784290435.147280:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2469a7cc00, rc 0) 00000100:00100000:3.0:1784290435.147292:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5005 00000100:00100000:3.0:1784290435.147306:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+15:73472:x1870961896315904:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:3.0:1784290435.147316:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290435.147328:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005caf552d/0x5953bbf6b3075ef0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b27ff expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290435.147388:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76c:0x0] initial LVB size: 0, mtime: 0x6a5a1c7e, atime: 0x6a5a1c7e, ctime: 0x6a5a1c7e, blocks: 0x0 00000100:00100000:1.0:1784290435.147399:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+74:73467:x1870961896315648:12345-192.168.202.6@tcp:101:dd.0 Request processed in 705us (932us total) trans 120259084378 rc 0/0 00010000:00010000:3.0:1784290435.147405:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76c:0x0].0x0 since=2176s v=(0 0) 00010000:00010000:3.0:1784290435.147422:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76c:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1784290435.147431:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1404 00010000:00010000:3.0:1784290435.147433:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005caf552d/0x5953bbf6b3075ef0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27ff expref: 16 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.147450:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005caf552d/0x5953bbf6b3075ef0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27ff expref: 16 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.147459:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8cac00, rc 0) 00010000:00000080:3.0:1784290435.147465:0:8403:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c247d29e680 x1870961896315904/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 328/400 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290435.147542:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+16:73472:x1870961896315904:12345-192.168.202.6@tcp:101:dd.0 Request processed in 241us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290435.147552:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5005 00000100:00100000:2.0:1784290435.148052:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290435.148129:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896316160 00000100:00100000:1.0:1784290435.148140:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896316160 00000100:00100000:1.0:1784290435.148202:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1405 00000100:00100000:1.0:1784290435.148216:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+74:73466:x1870961896316160:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:1.0:1784290435.148248:0:66004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290435.148264:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b3075ea3 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27e3 expref: 74 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.148276:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9c2446227300) 00010000:00010000:1.0:1784290435.148280:0:66004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290435.148412:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c800/0x5953bbf6b3075ef7 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.148423:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c800/0x5953bbf6b3075ef7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.148431:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c800/0x5953bbf6b3075ef7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784290435.148478:0:66004:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084379 00000004:00010000:1.0:1784290435.148499:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000137e1539 reply state 00000000a53e3815 transno 120259084380 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c800/0x5953bbf6b3075ef7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.148511:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c800/0x5953bbf6b3075ef7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.148518:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9c2446227300) 00010000:00010000:1.0:1784290435.148520:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784290435.148523:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784290435.148589:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+76:73466:x1870961896316160:12345-192.168.202.6@tcp:36:dd.0 Request processed in 375us (540us total) trans 120259084380 rc 0/0 00000100:00100000:1.0:1784290435.148598:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1405 00000020:00080000:1.0:1784290435.148604:0:66004:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784290435.149285:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.149376:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896316416 00000100:00100000:2.0:1784290435.149387:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.149390:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896316416 00000100:00100000:0.0:1784290435.149435:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896316544 00000100:00100000:3.0:1784290435.149441:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 265 00000100:00100000:0.0:1784290435.149445:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896316544 00000100:00100000:3.0:1784290435.149455:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+77:73462:x1870961896316416:12345-192.168.202.6@tcp:35:dd.0 00000100:00100000:2.0:1784290435.149482:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.149500:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896316800 00000100:00100000:0.0:1784290435.149507:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896316800 00000100:00100000:1.0:1784290435.149535:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1406 00000100:00100000:2.0:1784290435.149549:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1407 00000100:00100000:1.0:1784290435.149558:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+78:73467:x1870961896316544:12345-192.168.202.6@tcp:101:dd.0 00000100:00100000:2.0:1784290435.149575:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+78:73468:x1870961896316800:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:1.0:1784290435.149576:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290435.149593:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b3075efe lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2806 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.149595:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290435.149614:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b3075f05 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b280d expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.149625:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b3075f0c lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.149636:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b3075f0c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.149648:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b3075f0c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290435.149670:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:2.0:1784290435.149706:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b3075f13 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.149720:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b3075f13 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.149731:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b3075f13 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.149745:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3075f1a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.149767:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+81:73462:x1870961896316416:12345-192.168.202.6@tcp:35:dd.0 Request processed in 296us (465us total) trans 120259084381 rc 0/0 00010000:00010000:2.0:1784290435.149773:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3075f1a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.149788:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 265 00010000:00010000:2.0:1784290435.149793:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3075f1a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.149798:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b3075efe lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2806 expref: 82 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.149829:0:26253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896316928 00010000:00010000:1.0:1784290435.149830:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d200/0x5953bbf6b3075f0c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2806 expref: 80 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.149840:0:26253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896316928 00010000:00010000:1.0:1784290435.149847:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9c2446227a00) 00010000:00010000:2.0:1784290435.149850:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3075f21 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.149853:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784290435.149865:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2469a7d200, rc 0) 00010000:00010000:2.0:1784290435.149871:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3075f21 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.149899:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3075f21 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784290435.149911:0:65990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xc:0x0]: returning size 0 00000100:00100000:1.0:1784290435.149922:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+80:73467:x1870961896316544:12345-192.168.202.6@tcp:101:dd.0 Request processed in 373us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290435.149931:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1406 00010000:00010000:2.0:1784290435.149994:0:65990:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b3075f13 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.150007:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5006 00010000:00010000:2.0:1784290435.150020:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b3075f13 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.150033:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+16:73466:x1870961896316928:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:2.0:1784290435.150034:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b3075f13 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.150052:0:26253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290435.150053:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b3075f13 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.150066:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:3.0:1784290435.150071:0:26253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ca690c2/0x5953bbf6b3075f2f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2814 expref: -99 pid: 26253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.150077:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290435.150092:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b3075f13 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290435.150100:0:26253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x766:0x0] initial LVB size: 0, mtime: 0x6a5a1c7e, atime: 0x6a5a1c7e, ctime: 0x6a5a1c7e, blocks: 0x0 00010000:00010000:2.0:1784290435.150105:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b3075f13 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.150121:0:26253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x766:0x0].0x0 since=2176s v=(0 0) 00000100:00100000:0.0:1784290435.150124:0:25104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896317056 00010000:00010000:2.0:1784290435.150126:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:3.0:1784290435.150128:0:26253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x766:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1784290435.150131:0:25104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896317056 00010000:00010000:2.0:1784290435.150147:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290435.150153:0:26253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ca690c2/0x5953bbf6b3075f2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2814 expref: 18 pid: 26253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.150155:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b3075f13 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.150166:0:25104:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1900 (0->18446744073709551615) 00002000:00100000:0.0:1784290435.150185:0:25104:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2474e24380 with x1870961896317056 ext(0->18446744073709551615) 00002000:00010000:0.0:1784290435.150203:0:25104:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2474e24380. 00010000:00010000:2.0:1784290435.150210:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b3075f13 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.150227:0:65990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3075f1a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290435.150235:0:25104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 363 00010000:00010000:2.0:1784290435.150255:0:65990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3075f1a lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.150259:0:26253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007ca690c2/0x5953bbf6b3075f2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2814 expref: 18 pid: 26253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290435.150262:0:25104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+18:2398:x1870961896317056:12345-192.168.202.6@tcp:10:dd.0 00010000:00010000:2.0:1784290435.150315:0:65990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3075f1a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.150319:0:26253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247f8ca800, rc 0) 00010000:00010000:2.0:1784290435.150333:0:65990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00000080:3.0:1784290435.150388:0:26253:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2345c25880 x1870961896316928/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 328/400 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00010000:0.0:1784290435.150391:0:25104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:2.0:1784290435.150394:0:65990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3075f1a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.150402:0:25104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb mtime from disk: 1784290430 -> 1784290435 00002000:00010000:0.0:1784290435.150417:0:25104:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb atime from disk: 1784290430 -> 1784290430 00002000:00010000:0.0:1784290435.150430:0:25104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb ctime from disk: 1784290430 -> 1784290435 00002000:00010000:0.0:1784290435.150447:0:25104:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:2.0:1784290435.150452:0:65990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3075f1a lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:0.0:1784290435.150463:0:25104:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2474e24380 x1870961896317056/t4294968659(0) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1784290435.150472:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x4e05b2a3 (ffff9c2442ffee00) 00010000:00010000:2.0:1784290435.150488:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290435.150500:0:65990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3075f1a lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.150510:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3075f1a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.150559:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+19:73466:x1870961896316928:12345-192.168.202.6@tcp:101:dd.0 Request processed in 527us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290435.150559:0:25104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+19:2398:x1870961896317056:12345-192.168.202.6@tcp:10:dd.0 Request processed in 298us (497us total) trans 4294968659 rc 0/0 00010000:00010000:2.0:1784290435.150562:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b3075f05 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b280d expref: 81 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.150608:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5006 00000100:00100000:0.0:1784290435.150614:0:25104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 363 00010000:00010000:2.0:1784290435.150617:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3075f21 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b280d expref: 80 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.150626:0:25104:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1900 (0->18446744073709551615) 00010000:00010000:2.0:1784290435.150631:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9c2446227e00) 00002000:00100000:0.0:1784290435.150637:0:25104:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2474e24380 with x1870961896317056 ext(0->18446744073709551615) 00010000:00010000:2.0:1784290435.150639:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00002000:00010000:0.0:1784290435.150652:0:25104:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2474e24380. 00010000:00010000:2.0:1784290435.150654:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450ab000, rc 0) 00000100:00100000:2.0:1784290435.150711:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+80:73468:x1870961896316800:12345-192.168.202.6@tcp:101:dd.0 Request processed in 1147us (1230us total) trans 120259084382 rc 0/0 00000100:00100000:2.0:1784290435.150725:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1407 00000100:00100000:1.0:1784290435.153062:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290435.153095:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.153111:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896317440 00000100:00100000:0.0:1784290435.153118:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896317440 00000100:00100000:1.0:1784290435.153140:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.153179:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896317568 00000100:00100000:2.0:1784290435.153182:0:25097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896317184 00000100:00100000:0.0:1784290435.153183:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896317568 00000100:00100000:2.0:1784290435.153199:0:25097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896317184 00000100:00100000:0.0:1784290435.153225:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1408 00000100:00100000:0.0:1784290435.153239:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+81:73467:x1870961896317440:12345-192.168.202.6@tcp:36:dd.0 00002000:00010000:2.0:1784290435.153241:0:25097:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1894 (0->18446744073709551615) 00000100:00100000:1.0:1784290435.153251:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1409 00002000:00100000:2.0:1784290435.153271:0:25097:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2474e26a00 with x1870961896317184 ext(0->18446744073709551615) 00002000:00010000:2.0:1784290435.153287:0:25097:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2474e26a00. 00000100:00100000:1.0:1784290435.153288:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+81:73468:x1870961896317568:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:1.0:1784290435.153305:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290435.153310:0:74876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290435.153319:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d000/0x5953bbf6b3075f36 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b281b expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.153327:0:25097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 364 00010000:00010000:0.0:1784290435.153337:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b3075ee2 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27f8 expref: 81 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.153381:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9c2446227a00) 00010000:00010000:0.0:1784290435.153388:0:74876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290435.153394:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c000/0x5953bbf6b3075f3d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.153397:0:25097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+18:2397:x1870961896317184:12345-192.168.202.6@tcp:10:dd.0 00010000:00010000:1.0:1784290435.153419:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c000/0x5953bbf6b3075f3d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.153440:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c000/0x5953bbf6b3075f3d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.153454:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.153497:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896317824 00010000:00010000:0.0:1784290435.153501:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951000/0x5953bbf6b3075f44 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.153504:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896317824 00010000:00010000:0.0:1784290435.153517:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951000/0x5953bbf6b3075f44 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.153530:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951000/0x5953bbf6b3075f44 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.153544:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d000/0x5953bbf6b3075f36 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b281b expref: 84 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290435.153548:0:25097:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784290435.153561:0:25097:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb mtime from disk: 1784290430 -> 1784290435 00000001:00080000:0.0:1784290435.153565:0:74876:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084383 00000100:00100000:3.0:1784290435.153566:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1410 00002000:00010000:2.0:1784290435.153575:0:25097:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb atime from disk: 1784290430 -> 1784290430 00002000:00010000:2.0:1784290435.153581:0:25097:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb ctime from disk: 1784290430 -> 1784290435 00002000:00010000:2.0:1784290435.153586:0:25097:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1784290435.153593:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c000/0x5953bbf6b3075f3d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b281b expref: 84 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000080:2.0:1784290435.153603:0:25097:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2474e26a00 x1870961896317184/t4294968660(0) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1784290435.153606:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9c2446227e00) 00000004:00010000:0.0:1784290435.153609:0:74876:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000379865e7 reply state 000000009d36faf5 transno 120259084384 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951000/0x5953bbf6b3075f44 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.153625:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784290435.153636:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2469a7c000, rc 0) 00000100:00100000:3.0:1784290435.153655:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+84:73476:x1870961896317824:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1784290435.153662:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951000/0x5953bbf6b3075f44 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.153678:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9c2446227a00) 00010000:00010000:0.0:1784290435.153683:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290435.153686:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1784290435.153688:0:74876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784290435.153704:0:25097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+19:2397:x1870961896317184:12345-192.168.202.6@tcp:10:dd.0 Request processed in 318us (604us total) trans 4294968660 rc 0/0 00010000:00010000:3.0:1784290435.153705:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075f4b lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2822 expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.153741:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+85:73468:x1870961896317568:12345-192.168.202.6@tcp:101:dd.0 Request processed in 451us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290435.153743:0:25097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 364 00002000:00010000:2.0:1784290435.153758:0:25097:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1894 (0->18446744073709551615) 00002000:00100000:2.0:1784290435.153764:0:25097:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2474e26a00 with x1870961896317184 ext(0->18446744073709551615) 00002000:00010000:2.0:1784290435.153775:0:25097:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2474e26a00. 00000100:00100000:1.0:1784290435.153781:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1409 00000100:00100000:0.0:1784290435.153782:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+86:73467:x1870961896317440:12345-192.168.202.6@tcp:36:dd.0 Request processed in 526us (701us total) trans 120259084384 rc 0/0 00000100:00100000:0.0:1784290435.153798:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1408 00000020:00080000:0.0:1784290435.153805:0:74876:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784290435.153839:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075f52 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.153851:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075f52 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.153863:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075f52 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.153878:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075f59 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.153883:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075f59 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.153893:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075f59 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.153926:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:3.0:1784290435.153955:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3075f60 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.153983:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3075f60 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290435.154005:0:68995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896318080 00000100:00100000:0.0:1784290435.154011:0:68995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896318080 00000100:00100000:0.0:1784290435.154044:0:68995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 266 00000100:00100000:0.0:1784290435.154050:0:68995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c208050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+85:73472:x1870961896318080:12345-192.168.202.6@tcp:35:dd.0 00010000:00010000:3.0:1784290435.154062:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3075f60 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290435.154074:0:65989:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x14:0x0]: returning size 0 00010000:00010000:3.0:1784290435.154129:0:65989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075f52 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.154136:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075f52 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.154141:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075f52 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.154145:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075f52 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.154150:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429df200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290435.154153:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075f52 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.154159:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075f52 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.154168:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00000100:00100000:0.0:1784290435.154171:0:68995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c208050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+87:73472:x1870961896318080:12345-192.168.202.6@tcp:35:dd.0 Request processed in 119us (246us total) trans 120259084385 rc 0/0 00010000:00010000:3.0:1784290435.154172:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290435.154178:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075f52 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290435.154186:0:68995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 266 00010000:00010000:3.0:1784290435.154188:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075f52 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.154203:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075f59 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.154208:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075f59 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.154213:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075f59 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.154224:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24429dfe00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290435.154227:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075f59 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.154234:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075f59 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.154243:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2f385ca3 (ffff9c2449f0d000) 00010000:00010000:3.0:1784290435.154245:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290435.154248:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075f59 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.154253:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075f59 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.154461:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca200/0x5953bbf6b3075f4b lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2822 expref: 87 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.154474:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3075f60 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2822 expref: 86 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.154480:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9c244c870500) 00010000:00010000:3.0:1784290435.154482:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784290435.154484:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24429dfa00, rc 0) 00000100:00100000:3.0:1784290435.154513:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+86:73476:x1870961896317824:12345-192.168.202.6@tcp:101:dd.0 Request processed in 931us (1065us total) trans 120259084386 rc 0/0 00000100:00100000:3.0:1784290435.154519:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1410 00000100:00100000:2.0:1784290435.156170:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.156230:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.156231:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896318208 00000100:00100000:0.0:1784290435.156238:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896318208 00000100:00100000:3.0:1784290435.156293:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896318464 00000100:00100000:0.0:1784290435.156303:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5007 00000100:00100000:3.0:1784290435.156323:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896318464 00000100:00100000:0.0:1784290435.156330:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+19:73467:x1870961896318208:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1784290435.156339:0:26250:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290435.156353:0:26250:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c49049c8/0x5953bbf6b3075f6e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2829 expref: -99 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.156397:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 267 00000100:00100000:3.0:1784290435.156410:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+86:73466:x1870961896318464:12345-192.168.202.6@tcp:35:dd.0 00002000:00010000:0.0:1784290435.156416:0:26250:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x767:0x0] initial LVB size: 0, mtime: 0x6a5a1c7e, atime: 0x6a5a1c7e, ctime: 0x6a5a1c7e, blocks: 0x0 00010000:00010000:0.0:1784290435.156438:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x767:0x0].0x0 since=2176s v=(0 0) 00010000:00010000:0.0:1784290435.156443:0:26250:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x767:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290435.156449:0:26250:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c49049c8/0x5953bbf6b3075f6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2829 expref: 20 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.156459:0:26250:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c49049c8/0x5953bbf6b3075f6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2829 expref: 20 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.156468:0:26250:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246d951c00, rc 0) 00010000:00000080:0.0:1784290435.156472:0:26250:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c24581aa680 x1870961896318208/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 328/400 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.156514:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+20:73467:x1870961896318208:12345-192.168.202.6@tcp:101:dd.0 Request processed in 188us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290435.156522:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+87:73466:x1870961896318464:12345-192.168.202.6@tcp:35:dd.0 Request processed in 113us (293us total) trans 120259084387 rc 0/0 00000100:00100000:0.0:1784290435.156524:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5007 00000100:00100000:3.0:1784290435.156542:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 267 00000100:00100000:1.0:1784290435.156661:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.156767:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896318720 00000100:00100000:2.0:1784290435.156776:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896318720 00000100:00100000:2.0:1784290435.156827:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1411 00000100:00100000:2.0:1784290435.156837:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+87:73468:x1870961896318720:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:2.0:1784290435.156887:0:66004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290435.156906:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3075f21 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b280d expref: 87 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.156922:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9c2446227e00) 00010000:00010000:2.0:1784290435.156926:0:66004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290435.157045:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b3075f75 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.157057:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b3075f75 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.157065:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b3075f75 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784290435.157095:0:66004:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084388 00000004:00010000:2.0:1784290435.157114:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bd0a600b reply state 0000000000f85502 transno 120259084389 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b3075f75 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.157125:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b3075f75 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.157131:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9c2446227e00) 00010000:00010000:2.0:1784290435.157134:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290435.157136:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784290435.157207:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+89:73468:x1870961896318720:12345-192.168.202.6@tcp:36:dd.0 Request processed in 370us (550us total) trans 120259084389 rc 0/0 00000100:00100000:2.0:1784290435.157226:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1411 00000020:00080000:2.0:1784290435.157232:0:66004:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784290435.157918:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.157976:0:25100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896318848 00000100:00100000:3.0:1784290435.157983:0:25100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896318848 00002000:00010000:3.0:1784290435.158001:0:25100:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1895 (0->18446744073709551615) 00002000:00100000:3.0:1784290435.158006:0:25100:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345b31180 with x1870961896318848 ext(0->18446744073709551615) 00002000:00010000:3.0:1784290435.158011:0:25100:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2345b31180. 00000100:00100000:3.0:1784290435.158032:0:25100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 365 00000100:00100000:3.0:1784290435.158037:0:25100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345b31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+20:2398:x1870961896318848:12345-192.168.202.6@tcp:10:dd.0 00002000:00010000:3.0:1784290435.158117:0:25100:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1784290435.158121:0:25100:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb mtime from disk: 1784290430 -> 1784290435 00002000:00010000:3.0:1784290435.158124:0:25100:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb atime from disk: 1784290430 -> 1784290430 00002000:00010000:3.0:1784290435.158127:0:25100:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb ctime from disk: 1784290430 -> 1784290435 00002000:00010000:3.0:1784290435.158130:0:25100:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1784290435.158138:0:25100:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2345b31180 x1870961896318848/t4294968661(0) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290435.158181:0:25100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345b31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+21:2398:x1870961896318848:12345-192.168.202.6@tcp:10:dd.0 Request processed in 143us (267us total) trans 4294968661 rc 0/0 00000100:00100000:3.0:1784290435.158188:0:25100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 365 00002000:00010000:3.0:1784290435.158191:0:25100:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1895 (0->18446744073709551615) 00002000:00100000:3.0:1784290435.158193:0:25100:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345b31180 with x1870961896318848 ext(0->18446744073709551615) 00002000:00010000:3.0:1784290435.158203:0:25100:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2345b31180. 00000100:00100000:3.0:1784290435.158607:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.158652:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896318976 00000100:00100000:3.0:1784290435.158654:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.158663:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896318976 00000100:00100000:2.0:1784290435.158707:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896319232 00000100:00100000:2.0:1784290435.158711:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896319232 00000100:00100000:0.0:1784290435.158775:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1412 00000100:00100000:1.0:1784290435.158788:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1413 00000100:00100000:0.0:1784290435.158790:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+90:73476:x1870961896318976:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1784290435.158814:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1784290435.158820:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+90:73470:x1870961896319232:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1784290435.158828:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951800/0x5953bbf6b3075f7c lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2830 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.158836:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290435.158850:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d000/0x5953bbf6b3075f83 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2837 expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.158854:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950800/0x5953bbf6b3075f8a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.158877:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950800/0x5953bbf6b3075f8a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.158885:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950800/0x5953bbf6b3075f8a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.158933:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3075f91 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.158978:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3075f91 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.158987:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951800/0x5953bbf6b3075f7c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2830 expref: 93 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.158990:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3075f91 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.159038:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950800/0x5953bbf6b3075f8a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2830 expref: 92 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159039:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075f98 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.159079:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9c244c870500) 00010000:00010000:1.0:1784290435.159082:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075f98 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.159084:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784290435.159093:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246d950800, rc 0) 00010000:00010000:1.0:1784290435.159108:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075f98 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290435.159145:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+92:73476:x1870961896318976:12345-192.168.202.6@tcp:101:dd.0 Request processed in 360us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290435.159152:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1412 00010000:00010000:1.0:1784290435.159157:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b3075f9f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159168:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b3075f9f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159177:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b3075f9f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290435.159185:0:65988:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xe:0x0]: returning size 0 00010000:00010000:1.0:1784290435.159245:0:65988:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3075f91 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159254:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3075f91 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159260:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3075f91 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159274:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3075f91 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159280:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7d600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290435.159283:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3075f91 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159301:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3075f91 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159311:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:1.0:1784290435.159314:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290435.159318:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3075f91 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159324:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3075f91 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159334:0:65988:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075f98 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159378:0:65988:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075f98 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159385:0:65988:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075f98 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159390:0:65988:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7dc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290435.159394:0:65988:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075f98 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159411:0:65988:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075f98 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159426:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xdeb924a3 (ffff9c2458ba5000) 00010000:00010000:1.0:1784290435.159430:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290435.159435:0:65988:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075f98 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159445:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3075f98 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159500:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d000/0x5953bbf6b3075f83 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2837 expref: 93 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159523:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b3075f9f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2837 expref: 92 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159532:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9c2446227800) 00010000:00010000:1.0:1784290435.159534:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784290435.159537:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2469a7c400, rc 0) 00000100:00100000:1.0:1784290435.159585:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+92:73470:x1870961896319232:12345-192.168.202.6@tcp:101:dd.0 Request processed in 782us (930us total) trans 120259084390 rc 0/0 00000100:00100000:1.0:1784290435.159593:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1413 00000100:00100000:2.0:1784290435.159764:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290435.159815:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896319360 00000100:00100000:1.0:1784290435.159821:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896319360 00000100:00100000:1.0:1784290435.159857:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5008 00000100:00100000:1.0:1784290435.159866:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+21:73468:x1870961896319360:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:1.0:1784290435.159885:0:26258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290435.159898:0:26258:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c06e1811/0x5953bbf6b3075fad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b283e expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290435.159915:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x768:0x0] initial LVB size: 0, mtime: 0x6a5a1c7e, atime: 0x6a5a1c7e, ctime: 0x6a5a1c7e, blocks: 0x0 00010000:00010000:1.0:1784290435.159928:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x768:0x0].0x0 since=2176s v=(0 0) 00010000:00010000:1.0:1784290435.159933:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x768:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290435.159961:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c06e1811/0x5953bbf6b3075fad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b283e expref: 22 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159976:0:26258:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c06e1811/0x5953bbf6b3075fad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b283e expref: 22 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.159986:0:26258:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2469a7d800, rc 0) 00010000:00000080:1.0:1784290435.159992:0:26258:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2474e8c700 x1870961896319360/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 328/400 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290435.160033:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+22:73468:x1870961896319360:12345-192.168.202.6@tcp:101:dd.0 Request processed in 168us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290435.160040:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5008 00000100:00100000:3.0:1784290435.160719:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.160762:0:68995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896319616 00000100:00100000:0.0:1784290435.160770:0:68995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896319616 00000100:00100000:0.0:1784290435.160813:0:68995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 268 00000100:00100000:0.0:1784290435.160820:0:68995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+92:73467:x1870961896319616:12345-192.168.202.6@tcp:35:dd.0 00000100:00100000:0.0:1784290435.160983:0:68995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+93:73467:x1870961896319616:12345-192.168.202.6@tcp:35:dd.0 Request processed in 162us (264us total) trans 120259084391 rc 0/0 00000100:00100000:0.0:1784290435.160993:0:68995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 268 00000100:00100000:2.0:1784290435.161544:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.161581:0:25102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896319744 00000100:00100000:0.0:1784290435.161586:0:25102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896319744 00002000:00010000:0.0:1784290435.161600:0:25102:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1896 (0->18446744073709551615) 00002000:00100000:0.0:1784290435.161604:0:25102:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2474e8e680 with x1870961896319744 ext(0->18446744073709551615) 00002000:00010000:0.0:1784290435.161610:0:25102:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2474e8e680. 00000100:00100000:0.0:1784290435.161631:0:25102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 366 00000100:00100000:0.0:1784290435.161644:0:25102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+22:2397:x1870961896319744:12345-192.168.202.6@tcp:10:dd.0 00002000:00010000:0.0:1784290435.161710:0:25102:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784290435.161715:0:25102:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb mtime from disk: 1784290430 -> 1784290435 00002000:00010000:0.0:1784290435.161718:0:25102:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb atime from disk: 1784290430 -> 1784290430 00002000:00010000:0.0:1784290435.161721:0:25102:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb ctime from disk: 1784290430 -> 1784290435 00002000:00010000:0.0:1784290435.161724:0:25102:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1784290435.161733:0:25102:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2474e8e680 x1870961896319744/t4294968662(0) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.161771:0:25102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+23:2397:x1870961896319744:12345-192.168.202.6@tcp:10:dd.0 Request processed in 127us (231us total) trans 4294968662 rc 0/0 00000100:00100000:0.0:1784290435.161778:0:25102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 366 00002000:00010000:0.0:1784290435.161781:0:25102:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1896 (0->18446744073709551615) 00002000:00100000:0.0:1784290435.161784:0:25102:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2474e8e680 with x1870961896319744 ext(0->18446744073709551615) 00002000:00010000:0.0:1784290435.161788:0:25102:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2474e8e680. 00000100:00100000:2.0:1784290435.162481:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.162519:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896319872 00000100:00100000:3.0:1784290435.162524:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896319872 00000100:00100000:3.0:1784290435.162568:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1414 00000100:00100000:3.0:1784290435.162670:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+93:73470:x1870961896319872:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:3.0:1784290435.162682:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290435.162693:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075fb4 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2845 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.162731:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075fbb lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.162749:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:3.0:1784290435.162752:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075fbb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.162762:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075fbb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.162793:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896320384 00000100:00100000:2.0:1784290435.162800:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896320384 00010000:00010000:3.0:1784290435.162844:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3075fb4 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2845 expref: 96 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.162861:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429df200/0x5953bbf6b3075fbb lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2845 expref: 95 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.162882:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.162883:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1415 00000100:00100000:2.0:1784290435.162914:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+95:73476:x1870961896320384:12345-192.168.202.6@tcp:36:dd.0 00000100:00100000:0.0:1784290435.162916:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896320256 00000100:00100000:0.0:1784290435.162929:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896320256 00010000:00010000:3.0:1784290435.162958:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9c2446227800) 00010000:00010000:3.0:1784290435.162961:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784290435.162998:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24429df200, rc 0) 00010000:00010000:2.0:1784290435.163007:0:65990:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784290435.163020:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1416 00010000:00010000:2.0:1784290435.163033:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfa00/0x5953bbf6b3075f60 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2822 expref: 96 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290435.163043:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+96:73481:x1870961896320256:12345-192.168.202.6@tcp:101:dd.0 00000100:00100000:3.0:1784290435.163046:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+96:73470:x1870961896319872:12345-192.168.202.6@tcp:101:dd.0 Request processed in 374us (559us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290435.163081:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1784290435.163086:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1414 00010000:00010000:2.0:1784290435.163096:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9c244c870500) 00010000:00010000:0.0:1784290435.163105:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950200/0x5953bbf6b3075fc2 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b284c expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.163106:0:65990:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290435.163216:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950400/0x5953bbf6b3075fc9 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.163241:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950400/0x5953bbf6b3075fc9 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.163262:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075fd0 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.163263:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950400/0x5953bbf6b3075fc9 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.163304:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075fd0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.163319:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075fd0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.163320:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:0.0:1784290435.163321:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b3075fd7 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.163382:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b3075fd7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.163393:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b3075fd7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.163435:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896320640 00000001:00080000:2.0:1784290435.163438:0:65990:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084392 00010000:00010000:0.0:1784290435.163443:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951800/0x5953bbf6b3075fde lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.163444:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896320640 00010000:00010000:0.0:1784290435.163462:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951800/0x5953bbf6b3075fde lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.163468:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951800/0x5953bbf6b3075fde lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290435.163474:0:65989:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x19:0x0]: returning size 0 00000004:00010000:2.0:1784290435.163495:0:65990:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000558afa05 reply state 000000003d07f65f transno 120259084393 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075fd0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.163514:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075fd0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.163521:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 269 00010000:00010000:0.0:1784290435.163527:0:65989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950400/0x5953bbf6b3075fc9 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.163531:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9c244c870500) 00010000:00010000:0.0:1784290435.163542:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950400/0x5953bbf6b3075fc9 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.163545:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784290435.163545:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23443b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+99:73468:x1870961896320640:12345-192.168.202.6@tcp:35:dd.0 00000100:00100000:2.0:1784290435.163555:0:65990:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784290435.163572:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950400/0x5953bbf6b3075fc9 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.163596:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950400/0x5953bbf6b3075fc9 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.163610:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246d950400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290435.163615:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950400/0x5953bbf6b3075fc9 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.163622:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950400/0x5953bbf6b3075fc9 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.163635:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:0.0:1784290435.163637:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290435.163640:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950400/0x5953bbf6b3075fc9 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.163646:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950400/0x5953bbf6b3075fc9 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.163654:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+100:73476:x1870961896320384:12345-192.168.202.6@tcp:36:dd.0 Request processed in 746us (918us total) trans 120259084393 rc 0/0 00000100:00100000:2.0:1784290435.163674:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1415 00000020:00080000:2.0:1784290435.163681:0:65990:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784290435.163685:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b3075fd7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.163715:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b3075fd7 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.163723:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b3075fd7 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.163731:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246d951a00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290435.163735:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b3075fd7 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.163744:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b3075fd7 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.163773:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xb6f515a3 (ffff9c2443b66100) 00010000:00010000:0.0:1784290435.163778:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290435.163783:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b3075fd7 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.163792:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b3075fd7 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.163806:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23443b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+100:73468:x1870961896320640:12345-192.168.202.6@tcp:35:dd.0 Request processed in 265us (484us total) trans 120259084395 rc 0/0 00000100:00100000:1.0:1784290435.163818:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 269 00010000:00010000:0.0:1784290435.163864:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950200/0x5953bbf6b3075fc2 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b284c expref: 100 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.163880:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951800/0x5953bbf6b3075fde lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b284c expref: 99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.163886:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9c2474f5f300) 00010000:00010000:0.0:1784290435.163888:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784290435.163890:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246d951800, rc 0) 00000100:00100000:0.0:1784290435.163925:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+99:73481:x1870961896320256:12345-192.168.202.6@tcp:101:dd.0 Request processed in 897us (1064us total) trans 120259084394 rc 0/0 00000100:00100000:0.0:1784290435.163931:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1416 00000100:00100000:3.0:1784290435.164276:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.164320:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896320896 00000100:00100000:2.0:1784290435.164327:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896320896 00000100:00100000:2.0:1784290435.164411:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1417 00000100:00100000:2.0:1784290435.164434:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+99:73470:x1870961896320896:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:2.0:1784290435.164460:0:66004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290435.164477:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b3075f9f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2837 expref: 99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.164490:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9c2446227800) 00010000:00010000:2.0:1784290435.164494:0:66004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290435.164563:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3075fec lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.164574:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3075fec lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.164581:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3075fec lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784290435.164620:0:66004:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084396 00000004:00010000:2.0:1784290435.164640:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a49fb2ed reply state 000000009df85a52 transno 120259084397 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3075fec lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.164650:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3075fec lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.164656:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9c2446227800) 00010000:00010000:2.0:1784290435.164658:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290435.164660:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784290435.164734:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+101:73470:x1870961896320896:12345-192.168.202.6@tcp:36:dd.0 Request processed in 314us (456us total) trans 120259084397 rc 0/0 00000100:00100000:2.0:1784290435.164741:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1417 00000020:00080000:2.0:1784290435.164746:0:66004:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784290435.165170:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.165231:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896321024 00000100:00100000:2.0:1784290435.165240:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896321024 00000100:00100000:2.0:1784290435.165287:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5009 00000100:00100000:2.0:1784290435.165298:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+23:73476:x1870961896321024:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:2.0:1784290435.165312:0:26252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290435.165329:0:26252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e9f623d/0x5953bbf6b3075ff3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2853 expref: -99 pid: 26252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290435.165415:0:26252:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x770:0x0] initial LVB size: 0, mtime: 0x6a5a1c7f, atime: 0x6a5a1c7f, ctime: 0x6a5a1c7f, blocks: 0x0 00010000:00010000:2.0:1784290435.165433:0:26252:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x770:0x0].0x0 since=2176s v=(0 0) 00010000:00010000:2.0:1784290435.165437:0:26252:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x770:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290435.165444:0:26252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e9f623d/0x5953bbf6b3075ff3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2853 expref: 24 pid: 26252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.165471:0:26252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004e9f623d/0x5953bbf6b3075ff3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2853 expref: 24 pid: 26252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.165481:0:26252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aa000, rc 0) 00010000:00000080:2.0:1784290435.165487:0:26252:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2343890000 x1870961896321024/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 328/400 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290435.165534:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+24:73476:x1870961896321024:12345-192.168.202.6@tcp:101:dd.0 Request processed in 238us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290435.165547:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5009 00000100:00100000:0.0:1784290435.165678:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290435.165748:0:26257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896321152 00000100:00100000:1.0:1784290435.165755:0:26257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896321152 00000100:00100000:1.0:1784290435.165791:0:26257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5010 00000100:00100000:1.0:1784290435.165800:0:26257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+24:73470:x1870961896321152:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:1.0:1784290435.165808:0:26257:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290435.165829:0:26257:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a491819/0x5953bbf6b3075ffa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b285a expref: -99 pid: 26257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290435.165845:0:26257:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76a:0x0] initial LVB size: 0, mtime: 0x6a5a1c7e, atime: 0x6a5a1c7e, ctime: 0x6a5a1c7e, blocks: 0x0 00010000:00010000:1.0:1784290435.165856:0:26257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76a:0x0].0x0 since=2176s v=(0 0) 00010000:00010000:1.0:1784290435.165860:0:26257:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290435.165865:0:26257:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a491819/0x5953bbf6b3075ffa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b285a expref: 25 pid: 26257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.165877:0:26257:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a491819/0x5953bbf6b3075ffa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b285a expref: 25 pid: 26257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.165886:0:26257:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2469a7d000, rc 0) 00010000:00000080:1.0:1784290435.165890:0:26257:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2345c27b80 x1870961896321152/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 328/400 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290435.165931:0:26257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+25:73470:x1870961896321152:12345-192.168.202.6@tcp:101:dd.0 Request processed in 133us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290435.165965:0:26257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5010 00000100:00100000:3.0:1784290435.166296:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.166332:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896321280 00000100:00100000:0.0:1784290435.166338:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896321280 00000100:00100000:0.0:1784290435.166397:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1418 00000100:00100000:0.0:1784290435.166406:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+101:73481:x1870961896321280:12345-192.168.202.6@tcp:101:dd.0 00000100:00100000:3.0:1784290435.166422:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:0.0:1784290435.166424:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290435.166436:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950a00/0x5953bbf6b3076001 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2861 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.166448:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896321536 00000100:00100000:1.0:1784290435.166455:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896321536 00010000:00010000:0.0:1784290435.166467:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951200/0x5953bbf6b3076008 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.166478:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951200/0x5953bbf6b3076008 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.166487:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951200/0x5953bbf6b3076008 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.166515:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1419 00000100:00100000:1.0:1784290435.166526:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+103:73471:x1870961896321536:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:1.0:1784290435.166538:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290435.166549:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b307600f lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2868 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.166572:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950a00/0x5953bbf6b3076001 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2861 expref: 105 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.166589:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951200/0x5953bbf6b3076008 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2861 expref: 104 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.166595:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9c2474f5f300) 00010000:00010000:0.0:1784290435.166597:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784290435.166600:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246d951200, rc 0) 00010000:00010000:1.0:1784290435.166625:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3076016 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.166638:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3076016 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290435.166639:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+104:73481:x1870961896321280:12345-192.168.202.6@tcp:101:dd.0 Request processed in 233us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290435.166665:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1418 00010000:00010000:1.0:1784290435.166682:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3076016 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.166715:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b307601d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.166730:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b307601d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290435.166739:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:1.0:1784290435.166754:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b307601d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.166781:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896321664 00000100:00100000:2.0:1784290435.166788:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896321664 00010000:00010000:1.0:1784290435.166801:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3076024 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290435.166811:0:24752:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1904 (0->18446744073709551615) 00002000:00100000:2.0:1784290435.166819:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345c24a80 with x1870961896321664 ext(0->18446744073709551615) 00002000:00010000:2.0:1784290435.166831:0:24752:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2345c24a80. 00010000:00010000:1.0:1784290435.166834:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3076024 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.166844:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3076024 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290435.166853:0:74876:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0xf:0x0]: returning size 0 00000100:00100000:2.0:1784290435.166862:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 367 00000100:00100000:2.0:1784290435.166879:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+25:2399:x1870961896321664:12345-192.168.202.6@tcp:10:dd.0 00010000:00010000:1.0:1784290435.166906:0:74876:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3076016 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.166915:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3076016 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.166921:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3076016 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.166928:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3076016 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.166933:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7d600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290435.166958:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3076016 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.166966:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3076016 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.166979:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:1.0:1784290435.166983:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290435.166987:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3076016 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290435.166988:0:24752:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784290435.166997:0:24752:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb mtime from disk: 1784290431 -> 1784290435 00010000:00010000:1.0:1784290435.167000:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3076016 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290435.167002:0:24752:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb atime from disk: 1784290431 -> 1784290431 00002000:00010000:2.0:1784290435.167005:0:24752:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb ctime from disk: 1784290431 -> 1784290435 00002000:00010000:2.0:1784290435.167007:0:24752:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1784290435.167020:0:24752:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2345c24a80 x1870961896321664/t4294968663(0) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1784290435.167026:0:74876:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b307601d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.167036:0:74876:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b307601d lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.167063:0:74876:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b307601d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.167072:0:74876:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7cc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290435.167077:0:74876:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b307601d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.167088:0:74876:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b307601d lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.167101:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+26:2399:x1870961896321664:12345-192.168.202.6@tcp:10:dd.0 Request processed in 226us (364us total) trans 4294968663 rc 0/0 00000100:00100000:2.0:1784290435.167112:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 367 00010000:00010000:1.0:1784290435.167112:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x6e9b5ca3 (ffff9c2458ba5d00) 00010000:00010000:1.0:1784290435.167121:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00002000:00010000:2.0:1784290435.167122:0:24752:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1904 (0->18446744073709551615) 00002000:00100000:2.0:1784290435.167127:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345c24a80 with x1870961896321664 ext(0->18446744073709551615) 00010000:00010000:1.0:1784290435.167129:0:74876:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b307601d lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290435.167135:0:24752:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2345c24a80. 00010000:00010000:1.0:1784290435.167140:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b307601d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.167201:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b307600f lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2868 expref: 105 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.167221:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3076024 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2868 expref: 104 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.167251:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9c2446227500) 00010000:00010000:1.0:1784290435.167255:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784290435.167259:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2469a7ca00, rc 0) 00000100:00100000:1.0:1784290435.167314:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+104:73471:x1870961896321536:12345-192.168.202.6@tcp:101:dd.0 Request processed in 787us (889us total) trans 120259084398 rc 0/0 00000100:00100000:1.0:1784290435.167329:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1419 00000100:00100000:0.0:1784290435.167611:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.167652:0:25104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896321792 00000100:00100000:2.0:1784290435.167658:0:25104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896321792 00002000:00010000:2.0:1784290435.167676:0:25104:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1898 (0->18446744073709551615) 00002000:00100000:2.0:1784290435.167679:0:25104:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345c26d80 with x1870961896321792 ext(0->18446744073709551615) 00002000:00010000:2.0:1784290435.167684:0:25104:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2345c26d80. 00000100:00100000:2.0:1784290435.167708:0:25104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 368 00000100:00100000:2.0:1784290435.167722:0:25104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+26:2399:x1870961896321792:12345-192.168.202.6@tcp:10:dd.0 00002000:00010000:2.0:1784290435.167789:0:25104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784290435.167794:0:25104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb mtime from disk: 1784290430 -> 1784290435 00002000:00010000:2.0:1784290435.167797:0:25104:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb atime from disk: 1784290430 -> 1784290430 00002000:00010000:2.0:1784290435.167800:0:25104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb ctime from disk: 1784290430 -> 1784290435 00002000:00010000:2.0:1784290435.167802:0:25104:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1784290435.167812:0:25104:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2345c26d80 x1870961896321792/t4294968664(0) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290435.167903:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.167922:0:25104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+27:2399:x1870961896321792:12345-192.168.202.6@tcp:10:dd.0 Request processed in 197us (303us total) trans 4294968664 rc 0/0 00000100:00100000:2.0:1784290435.167958:0:25104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 368 00002000:00010000:2.0:1784290435.167965:0:25104:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1898 (0->18446744073709551615) 00002000:00100000:2.0:1784290435.167980:0:25104:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345c26d80 with x1870961896321792 ext(0->18446744073709551615) 00002000:00010000:2.0:1784290435.167991:0:25104:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2345c26d80. 00000100:00100000:0.0:1784290435.168014:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896322048 00000100:00100000:0.0:1784290435.168022:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896322048 00000100:00100000:0.0:1784290435.168057:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1420 00000100:00100000:0.0:1784290435.168066:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+104:73481:x1870961896322048:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:0.0:1784290435.168106:0:65988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290435.168123:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951800/0x5953bbf6b3075fde lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b284c expref: 104 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.168138:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9c2474f5f300) 00010000:00010000:0.0:1784290435.168142:0:65988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290435.168259:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3076032 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.168271:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3076032 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.168281:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3076032 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784290435.168337:0:65988:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084399 00000004:00010000:0.0:1784290435.168355:0:65988:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ef62b7d1 reply state 000000002f894fd7 transno 120259084400 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3076032 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.168383:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3076032 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.168428:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9c2474f5f300) 00010000:00010000:0.0:1784290435.168432:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290435.168435:0:65988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784290435.168500:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+106:73481:x1870961896322048:12345-192.168.202.6@tcp:36:dd.0 Request processed in 436us (598us total) trans 120259084400 rc 0/0 00000100:00100000:0.0:1784290435.168507:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1420 00000020:00080000:0.0:1784290435.168512:0:65988:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784290435.169124:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.169153:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.169180:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896322176 00000100:00100000:3.0:1784290435.169185:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896322176 00000100:00100000:2.0:1784290435.169193:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896322432 00000100:00100000:2.0:1784290435.169203:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896322432 00000100:00100000:3.0:1784290435.169222:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1421 00000100:00100000:3.0:1784290435.169237:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+107:73471:x1870961896322176:12345-192.168.202.6@tcp:101:dd.0 00000100:00100000:0.0:1784290435.169242:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1422 00010000:00010000:3.0:1784290435.169253:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1784290435.169257:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+107:73473:x1870961896322432:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1784290435.169267:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290435.169277:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b3076039 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2876 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.169331:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3076040 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b286f expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.169334:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076047 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.169400:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076047 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.169408:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076047 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.169424:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b307604e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.169433:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b307604e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.169448:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:0.0:1784290435.169466:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b307604e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.169469:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3076055 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.169486:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3076055 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.169495:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3076055 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.169513:0:68995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896322688 00010000:00010000:0.0:1784290435.169515:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b307605c lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.169522:0:68995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896322688 00010000:00010000:0.0:1784290435.169526:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b307605c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.169536:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b307605c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290435.169550:0:66008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x11:0x0]: returning size 0 00000100:00100000:2.0:1784290435.169571:0:68995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 270 00000100:00100000:2.0:1784290435.169591:0:68995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+111:73476:x1870961896322688:12345-192.168.202.6@tcp:35:dd.0 00010000:00010000:0.0:1784290435.169596:0:66008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076047 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.169606:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076047 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.169612:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076047 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.169617:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076047 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.169624:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290435.169628:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076047 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.169635:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076047 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.169649:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:0.0:1784290435.169652:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290435.169656:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076047 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.169670:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:0.0:1784290435.169673:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076047 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.169689:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b307604e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.169691:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfc00/0x5953bbf6b3076040 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b286f expref: 112 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.169720:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b307604e lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.169733:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b307604e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.169753:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24429dfe00/0x5953bbf6b3076055 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b286f expref: 112 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.169764:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26c00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290435.169767:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9c2446227500) 00010000:00010000:0.0:1784290435.169775:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b307604e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.169780:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:1.0:1784290435.169785:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:3.0:1784290435.169787:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24429dfe00, rc 0) 00010000:00010000:0.0:1784290435.169821:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b307604e lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.169823:0:68995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+112:73476:x1870961896322688:12345-192.168.202.6@tcp:35:dd.0 Request processed in 239us (385us total) trans 120259084402 rc 0/0 00000100:00100000:2.0:1784290435.169860:0:68995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 270 00010000:00010000:0.0:1784290435.169861:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x220d5ca3 (ffff9c2443b66100) 00010000:00010000:0.0:1784290435.169867:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290435.169870:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b307604e lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.169877:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b307604e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.169890:0:68995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896323072 00000100:00100000:2.0:1784290435.169898:0:68995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896323072 00010000:00010000:0.0:1784290435.169933:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b3076039 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2876 expref: 113 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.169956:0:68995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 271 00010000:00010000:0.0:1784290435.169971:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b307605c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2876 expref: 112 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.169976:0:68995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+112:73470:x1870961896323072:12345-192.168.202.6@tcp:35:dd.0 00000100:00100000:3.0:1784290435.170001:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+112:73471:x1870961896322176:12345-192.168.202.6@tcp:101:dd.0 Request processed in 759us (867us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290435.170005:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9c2446227b00) 00010000:00010000:0.0:1784290435.170011:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00100000:3.0:1784290435.170014:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1421 00010000:00010000:0.0:1784290435.170022:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd27e00, rc 0) 00000100:00100000:0.0:1784290435.170065:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+111:73473:x1870961896322432:12345-192.168.202.6@tcp:101:dd.0 Request processed in 810us (906us total) trans 120259084401 rc 0/0 00000100:00100000:0.0:1784290435.170073:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1422 00000100:00100000:2.0:1784290435.170164:0:68995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+111:73470:x1870961896323072:12345-192.168.202.6@tcp:35:dd.0 Request processed in 197us (391us total) trans 120259084403 rc 0/0 00000100:00100000:2.0:1784290435.170173:0:68995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 271 00000100:00100000:2.0:1784290435.170218:0:26261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896322816 00000100:00100000:2.0:1784290435.170225:0:26261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896322816 00000100:00100000:2.0:1784290435.170287:0:26261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5011 00000100:00100000:2.0:1784290435.170302:0:26261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+27:73481:x1870961896322816:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:2.0:1784290435.170314:0:26261:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290435.170333:0:26261:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053d0fe3d/0x5953bbf6b307606a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b287d expref: -99 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784290435.170408:0:26261:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x775:0x0] initial LVB size: 0, mtime: 0x6a5a1c7f, atime: 0x6a5a1c7f, ctime: 0x6a5a1c7f, blocks: 0x0 00010000:00010000:2.0:1784290435.170425:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x775:0x0].0x0 since=2176s v=(0 0) 00010000:00010000:2.0:1784290435.170431:0:26261:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x775:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290435.170439:0:26261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053d0fe3d/0x5953bbf6b307606a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b287d expref: 28 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.170452:0:26261:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000053d0fe3d/0x5953bbf6b307606a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b287d expref: 28 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.170462:0:26261:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aa400, rc 0) 00010000:00000080:2.0:1784290435.170468:0:26261:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c246a48ce00 x1870961896322816/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 328/400 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290435.170510:0:26261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+28:73481:x1870961896322816:12345-192.168.202.6@tcp:101:dd.0 Request processed in 213us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290435.170518:0:26261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5011 00000100:00100000:1.0:1784290435.172166:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290435.172223:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.172242:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896323328 00000100:00100000:2.0:1784290435.172249:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896323328 00000100:00100000:2.0:1784290435.172296:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896323456 00000100:00100000:2.0:1784290435.172299:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896323456 00000100:00100000:0.0:1784290435.172317:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1423 00000100:00100000:0.0:1784290435.172387:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+112:73471:x1870961896323328:12345-192.168.202.6@tcp:36:dd.0 00000100:00100000:1.0:1784290435.172399:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1424 00000100:00100000:1.0:1784290435.172416:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+112:73473:x1870961896323456:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:1.0:1784290435.172431:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290435.172432:0:65988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784290435.172447:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3076071 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2884 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.172462:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3076024 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2868 expref: 112 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.172478:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b3076078 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.172488:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9c2446227500) 00010000:00010000:1.0:1784290435.172490:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b3076078 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.172509:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:0.0:1784290435.172509:0:65988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290435.172518:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b3076078 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.172553:0:25097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896323712 00000100:00100000:3.0:1784290435.172562:0:25097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896323712 00002000:00010000:3.0:1784290435.172597:0:25097:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1909 (0->18446744073709551615) 00000100:00100000:2.0:1784290435.172604:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:1.0:1784290435.172607:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7dc00/0x5953bbf6b3076071 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2884 expref: 114 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1784290435.172613:0:25097:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2474e8fb80 with x1870961896323712 ext(0->18446744073709551615) 00002000:00010000:3.0:1784290435.172631:0:25097:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2474e8fb80. 00010000:00010000:0.0:1784290435.172643:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b307607f lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.172648:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7cc00/0x5953bbf6b3076078 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2884 expref: 113 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.172651:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896323840 00000100:00100000:2.0:1784290435.172663:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896323840 00010000:00010000:1.0:1784290435.172691:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9c2446227b00) 00010000:00010000:0.0:1784290435.172694:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b307607f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.172697:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784290435.172705:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2469a7cc00, rc 0) 00010000:00010000:0.0:1784290435.172717:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b307607f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.172718:0:25097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 369 00000100:00100000:2.0:1784290435.172732:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1425 00000100:00100000:3.0:1784290435.172752:0:25097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+28:2398:x1870961896323712:12345-192.168.202.6@tcp:10:dd.0 00000100:00100000:1.0:1784290435.172755:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+114:73473:x1870961896323456:12345-192.168.202.6@tcp:101:dd.0 Request processed in 339us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290435.172770:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f98ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+114:73475:x1870961896323840:12345-192.168.202.6@tcp:101:dd.0 00000100:00100000:1.0:1784290435.172781:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1424 00000001:00080000:0.0:1784290435.172785:0:65988:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084404 00010000:00010000:2.0:1784290435.172808:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00010000:0.0:1784290435.172823:0:65988:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000625d5743 reply state 00000000687f1c99 transno 120259084405 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b307607f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.172825:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b3076086 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b288b expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290435.172854:0:25097:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1784290435.172869:0:25097:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb mtime from disk: 1784290431 -> 1784290435 00010000:00010000:0.0:1784290435.172872:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b307607f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290435.172878:0:25097:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb atime from disk: 1784290431 -> 1784290431 00002000:00010000:3.0:1784290435.172884:0:25097:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb ctime from disk: 1784290431 -> 1784290435 00010000:00010000:0.0:1784290435.172888:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9c2446227500) 00002000:00010000:3.0:1784290435.172889:0:25097:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:0.0:1784290435.172895:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00000080:3.0:1784290435.172901:0:25097:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2474e8fb80 x1870961896323712/t4294968665(0) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.172908:0:65988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784290435.172963:0:25097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+29:2398:x1870961896323712:12345-192.168.202.6@tcp:10:dd.0 Request processed in 224us (468us total) trans 4294968665 rc 0/0 00010000:00010000:2.0:1784290435.172986:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b307608d lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.173007:0:25097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 369 00000100:00100000:0.0:1784290435.173009:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+116:73471:x1870961896323328:12345-192.168.202.6@tcp:36:dd.0 Request processed in 678us (842us total) trans 120259084405 rc 0/0 00010000:00010000:2.0:1784290435.173012:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b307608d lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290435.173013:0:25097:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1909 (0->18446744073709551615) 00002000:00100000:3.0:1784290435.173027:0:25097:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2474e8fb80 with x1870961896323712 ext(0->18446744073709551615) 00000100:00100000:0.0:1784290435.173039:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1423 00002000:00010000:3.0:1784290435.173045:0:25097:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2474e8fb80. 00000020:00080000:0.0:1784290435.173060:0:65988:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784290435.173066:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b307608d lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173091:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3076094 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173100:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3076094 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173108:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3076094 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173148:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b307609b lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173156:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b307609b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173163:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b307609b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784290435.173170:0:65989:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x13:0x0]: returning size 0 00010000:00010000:2.0:1784290435.173227:0:65989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b307608d lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173235:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b307608d lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173241:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b307608d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173247:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b307608d lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173252:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290435.173255:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b307608d lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173261:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b307608d lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173271:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:2.0:1784290435.173274:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290435.173278:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b307608d lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173284:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab600/0x5953bbf6b307608d lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173293:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3076094 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173298:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3076094 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173303:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3076094 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173315:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290435.173318:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3076094 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173324:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3076094 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173331:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xd57f5ca3 (ffff9c2442ffe700) 00010000:00010000:2.0:1784290435.173333:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290435.173336:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3076094 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173370:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab400/0x5953bbf6b3076094 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173413:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b3076086 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b288b expref: 117 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173429:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b307609b lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b288b expref: 116 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.173438:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9c244c870d00) 00010000:00010000:2.0:1784290435.173442:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784290435.173444:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aa800, rc 0) 00000100:00100000:2.0:1784290435.173486:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f98ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+116:73475:x1870961896323840:12345-192.168.202.6@tcp:101:dd.0 Request processed in 732us (899us total) trans 120259084406 rc 0/0 00000100:00100000:2.0:1784290435.173494:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1425 00000100:00100000:0.0:1784290435.175148:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.175176:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.175227:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896324096 00000100:00100000:2.0:1784290435.175229:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896324224 00000100:00100000:3.0:1784290435.175234:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896324096 00000100:00100000:2.0:1784290435.175247:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896324224 00000100:00100000:3.0:1784290435.175280:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5012 00000100:00100000:3.0:1784290435.175290:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+29:73471:x1870961896324096:12345-192.168.202.6@tcp:101:dd.0 00000100:00100000:2.0:1784290435.175312:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1426 00000100:00100000:2.0:1784290435.175329:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+116:73473:x1870961896324224:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:2.0:1784290435.175407:0:66004:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784290435.175422:0:9000:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290435.175432:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd27e00/0x5953bbf6b307605c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2876 expref: 116 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.175446:0:9000:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001acbc350/0x5953bbf6b30760a9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2892 expref: -99 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.175451:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9c2446227b00) 00010000:00010000:2.0:1784290435.175469:0:66004:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:3.0:1784290435.175478:0:9000:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76b:0x0] initial LVB size: 0, mtime: 0x6a5a1c7e, atime: 0x6a5a1c7e, ctime: 0x6a5a1c7e, blocks: 0x0 00000100:00100000:1.0:1784290435.175494:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.175536:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896324352 00000100:00100000:0.0:1784290435.175544:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896324352 00010000:00010000:3.0:1784290435.175546:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76b:0x0].0x0 since=2176s v=(0 0) 00000100:00100000:1.0:1784290435.175553:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:3.0:1784290435.175561:0:9000:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784290435.175572:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b30760b0 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.175581:0:9000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001acbc350/0x5953bbf6b30760a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2892 expref: 30 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.175594:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b30760b0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290435.175595:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1427 00010000:00010000:2.0:1784290435.175619:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b30760b0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.175627:0:9000:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001acbc350/0x5953bbf6b30760a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2892 expref: 30 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290435.175640:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+117:73475:x1870961896324352:12345-192.168.202.6@tcp:101:dd.0 00000100:00100000:1.0:1784290435.175654:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:0.0:1784290435.175670:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290435.175675:0:9000:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c24429dfc00, rc 0) 00010000:00010000:0.0:1784290435.175683:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951800/0x5953bbf6b30760b7 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2899 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000080:3.0:1784290435.175685:0:9000:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2345c25500 x1870961896324096/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 328/400 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000001:00080000:2.0:1784290435.175695:0:66004:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084407 00000100:00100000:1.0:1784290435.175713:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896324736 00010000:00010000:0.0:1784290435.175723:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950a00/0x5953bbf6b30760be lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.175724:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896324736 00000004:00010000:2.0:1784290435.175726:0:66004:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000031ae66bc reply state 0000000083e0e86f transno 120259084408 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b30760b0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.175753:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+30:73471:x1870961896324096:12345-192.168.202.6@tcp:101:dd.0 Request processed in 458us (567us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290435.175762:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950a00/0x5953bbf6b30760be lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.175765:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b30760b0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.175787:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5012 00000100:00100000:1.0:1784290435.175793:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 272 00010000:00010000:0.0:1784290435.175812:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950a00/0x5953bbf6b30760be lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.175813:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9c2446227b00) 00000100:00100000:1.0:1784290435.175825:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c20a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+120:73481:x1870961896324736:12345-192.168.202.6@tcp:35:dd.0 00010000:00010000:2.0:1784290435.175827:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290435.175836:0:66004:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784290435.175922:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+121:73473:x1870961896324224:12345-192.168.202.6@tcp:36:dd.0 Request processed in 598us (773us total) trans 120259084408 rc 0/0 00010000:00010000:0.0:1784290435.175963:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951800/0x5953bbf6b30760b7 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2899 expref: 122 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.175977:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1426 00010000:00010000:0.0:1784290435.175996:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950a00/0x5953bbf6b30760be lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2899 expref: 122 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1784290435.175998:0:66004:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784290435.176026:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9c244c870d00) 00010000:00010000:0.0:1784290435.176030:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784290435.176035:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246d950a00, rc 0) 00000100:00100000:2.0:1784290435.176044:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896324864 00000100:00100000:2.0:1784290435.176068:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896324864 00000100:00100000:0.0:1784290435.176096:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+122:73475:x1870961896324352:12345-192.168.202.6@tcp:101:dd.0 Request processed in 478us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290435.176108:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1427 00000100:00100000:2.0:1784290435.176117:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1428 00000100:00100000:2.0:1784290435.176130:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+121:73474:x1870961896324864:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:2.0:1784290435.176142:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290435.176156:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30760c5 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b28a0 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.176165:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c20a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+121:73481:x1870961896324736:12345-192.168.202.6@tcp:35:dd.0 Request processed in 348us (613us total) trans 120259084409 rc 0/0 00000100:00100000:1.0:1784290435.176176:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 272 00010000:00010000:2.0:1784290435.176234:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b30760cc lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176245:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b30760cc lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176254:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b30760cc lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176267:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30760d3 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176274:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30760d3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176280:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30760d3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176311:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b30760da lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176318:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b30760da lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176336:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b30760da lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784290435.176344:0:66004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x12:0x0]: returning size 0 00010000:00010000:2.0:1784290435.176443:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b30760cc lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176451:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b30760cc lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176457:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b30760cc lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176462:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b30760cc lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176468:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aaa00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290435.176471:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b30760cc lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176478:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b30760cc lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176494:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:2.0:1784290435.176497:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290435.176501:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b30760cc lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176507:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aaa00/0x5953bbf6b30760cc lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176518:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30760d3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176530:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30760d3 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176536:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30760d3 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176540:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aba00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290435.176542:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30760d3 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176547:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30760d3 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176554:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x7bc65ca3 (ffff9c2442ffed00) 00010000:00010000:2.0:1784290435.176556:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290435.176558:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30760d3 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176563:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aba00/0x5953bbf6b30760d3 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176591:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b30760c5 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28a0 expref: 123 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176602:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b30760da lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28a0 expref: 122 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.176609:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9c2446227200) 00010000:00010000:2.0:1784290435.176611:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784290435.176620:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236c200, rc 0) 00000100:00100000:2.0:1784290435.176659:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+122:73474:x1870961896324864:12345-192.168.202.6@tcp:101:dd.0 Request processed in 531us (1040us total) trans 120259084410 rc 0/0 00000100:00100000:2.0:1784290435.176666:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1428 00000100:00100000:0.0:1784290435.177432:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.177459:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.177467:0:25100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896324992 00000100:00100000:3.0:1784290435.177473:0:25100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896324992 00000100:00100000:0.0:1784290435.177490:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00002000:00010000:3.0:1784290435.177493:0:25100:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1899 (0->18446744073709551615) 00002000:00100000:3.0:1784290435.177498:0:25100:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345c25180 with x1870961896324992 ext(0->18446744073709551615) 00002000:00010000:3.0:1784290435.177506:0:25100:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2345c25180. 00000100:00100000:1.0:1784290435.177551:0:26260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896325120 00000100:00100000:2.0:1784290435.177553:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896325376 00000100:00100000:3.0:1784290435.177561:0:25100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 370 00000100:00100000:2.0:1784290435.177563:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896325376 00000100:00100000:1.0:1784290435.177563:0:26260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896325120 00000100:00100000:3.0:1784290435.177590:0:25100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+31:2400:x1870961896324992:12345-192.168.202.6@tcp:10:dd.0 00000100:00100000:2.0:1784290435.177627:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1429 00000100:00100000:2.0:1784290435.177646:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+122:73475:x1870961896325376:12345-192.168.202.6@tcp:36:dd.0 00000100:00100000:1.0:1784290435.177656:0:26260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5013 00002000:00010000:3.0:1784290435.177677:0:25100:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1784290435.177678:0:26260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+32:73473:x1870961896325120:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:2.0:1784290435.177680:0:65990:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1784290435.177682:0:25100:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb mtime from disk: 1784290430 -> 1784290435 00002000:00010000:3.0:1784290435.177699:0:25100:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb atime from disk: 1784290430 -> 1784290430 00010000:00010000:2.0:1784290435.177703:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa800/0x5953bbf6b307609b lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b288b expref: 122 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290435.177704:0:25100:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb ctime from disk: 1784290430 -> 1784290435 00010000:00010000:1.0:1784290435.177709:0:26260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1784290435.177718:0:25100:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1784290435.177731:0:26260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecf4fbb8/0x5953bbf6b30760e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b28a7 expref: -99 pid: 26260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000080:3.0:1784290435.177738:0:25100:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2345c25180 x1870961896324992/t4294968666(0) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1784290435.177740:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9c244c870d00) 00010000:00010000:2.0:1784290435.177758:0:65990:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1784290435.177810:0:26260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76d:0x0] initial LVB size: 0, mtime: 0x6a5a1c7e, atime: 0x6a5a1c7e, ctime: 0x6a5a1c7e, blocks: 0x0 00010000:00010000:1.0:1784290435.177827:0:26260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76d:0x0].0x0 since=2176s v=(0 0) 00000100:00100000:3.0:1784290435.177831:0:25100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+33:2400:x1870961896324992:12345-192.168.202.6@tcp:10:dd.0 Request processed in 254us (399us total) trans 4294968666 rc 0/0 00010000:00010000:1.0:1784290435.177843:0:26260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76d:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1784290435.177855:0:25100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 370 00002000:00010000:3.0:1784290435.177861:0:25100:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1899 (0->18446744073709551615) 00010000:00010000:2.0:1784290435.177861:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30760ef lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.177863:0:26260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecf4fbb8/0x5953bbf6b30760e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28a7 expref: 33 pid: 26260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1784290435.177875:0:25100:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345c25180 with x1870961896324992 ext(0->18446744073709551615) 00002000:00010000:3.0:1784290435.177895:0:25100:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2345c25180. 00010000:00010000:2.0:1784290435.177910:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30760ef lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.177920:0:26260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ecf4fbb8/0x5953bbf6b30760e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28a7 expref: 32 pid: 26260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.177924:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30760ef lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.177960:0:26260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2469a7dc00, rc 0) 00010000:00000080:1.0:1784290435.177968:0:26260:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2345c27480 x1870961896325120/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 328/400 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000001:00080000:2.0:1784290435.177999:0:65990:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084411 00000004:00010000:2.0:1784290435.178024:0:65990:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049c5b8bf reply state 0000000053373fde transno 120259084412 ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30760ef lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.178036:0:26260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+32:73473:x1870961896325120:12345-192.168.202.6@tcp:101:dd.0 Request processed in 365us (571us total) trans 0 rc 0/0 00010000:00010000:2.0:1784290435.178039:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30760ef lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.178055:0:26260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5013 00010000:00010000:2.0:1784290435.178070:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9c244c870d00) 00010000:00010000:2.0:1784290435.178073:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290435.178078:0:65990:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784290435.178150:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+124:73475:x1870961896325376:12345-192.168.202.6@tcp:36:dd.0 Request processed in 512us (659us total) trans 120259084412 rc 0/0 00000100:00100000:2.0:1784290435.178157:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1429 00000020:00080000:2.0:1784290435.178162:0:65990:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784290435.178509:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.178557:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896325504 00000100:00100000:2.0:1784290435.178564:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896325504 00000100:00100000:0.0:1784290435.178571:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.178606:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896325760 00000100:00100000:2.0:1784290435.178610:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896325760 00000100:00100000:2.0:1784290435.178637:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1430 00000100:00100000:2.0:1784290435.178655:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+125:73474:x1870961896325504:12345-192.168.202.6@tcp:101:dd.0 00000100:00100000:0.0:1784290435.178662:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1431 00010000:00010000:2.0:1784290435.178675:0:65988:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1784290435.178687:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+125:73477:x1870961896325760:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:2.0:1784290435.178690:0:65988:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b30760f6 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b28ae expref: -99 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.178713:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290435.178719:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30760fd lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.178730:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30760fd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.178732:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950400/0x5953bbf6b3076104 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b28b5 expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.178743:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30760fd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.178821:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b307610b lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.178824:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c000/0x5953bbf6b30760f6 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28ae expref: 128 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.178871:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b307610b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.178887:0:65988:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236ce00/0x5953bbf6b30760fd lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28ae expref: 127 pid: 65988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.178889:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b307610b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.178912:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9c2446227200) 00010000:00010000:2.0:1784290435.178921:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784290435.178924:0:65988:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c234236ce00, rc 0) 00010000:00010000:0.0:1784290435.178949:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3076112 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.178992:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3076112 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.179003:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+127:73474:x1870961896325504:12345-192.168.202.6@tcp:101:dd.0 Request processed in 353us (492us total) trans 0 rc 0/0 00010000:00010000:0.0:1784290435.179013:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3076112 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.179015:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1430 00010000:00010000:0.0:1784290435.179074:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076119 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.179083:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076119 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.179089:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076119 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784290435.179097:0:66004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x15:0x0]: returning size 0 00010000:00010000:0.0:1784290435.179135:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b307610b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.179140:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b307610b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.179145:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b307610b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.179149:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b307610b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.179153:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290435.179155:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b307610b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.179170:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b307610b lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.179179:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:0.0:1784290435.179181:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290435.179185:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b307610b lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.179190:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26400/0x5953bbf6b307610b lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.179201:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3076112 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.179206:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3076112 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.179210:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3076112 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.179214:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26c00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290435.179217:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3076112 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.179221:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3076112 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.179226:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x88f15ca3 (ffff9c2443b66100) 00010000:00010000:0.0:1784290435.179228:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784290435.179230:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3076112 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.179241:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26c00/0x5953bbf6b3076112 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.179252:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:0.0:1784290435.179291:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950400/0x5953bbf6b3076104 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28b5 expref: 128 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.179305:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076119 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28b5 expref: 127 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.179312:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9c244c870800) 00010000:00010000:0.0:1784290435.179314:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784290435.179316:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c246dd26600, rc 0) 00000100:00100000:1.0:1784290435.179335:0:25102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896325888 00000100:00100000:1.0:1784290435.179372:0:25102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896325888 00000100:00100000:0.0:1784290435.179387:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+127:73477:x1870961896325760:12345-192.168.202.6@tcp:101:dd.0 Request processed in 709us (816us total) trans 120259084413 rc 0/0 00000100:00100000:0.0:1784290435.179397:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1431 00002000:00010000:1.0:1784290435.179399:0:25102:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1901 (0->18446744073709551615) 00002000:00100000:1.0:1784290435.179405:0:25102:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c246a4f8a80 with x1870961896325888 ext(0->18446744073709551615) 00002000:00010000:1.0:1784290435.179415:0:25102:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c246a4f8a80. 00000100:00100000:1.0:1784290435.179454:0:25102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 371 00000100:00100000:1.0:1784290435.179464:0:25102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+32:2400:x1870961896325888:12345-192.168.202.6@tcp:10:dd.0 00000100:00100000:2.0:1784290435.179516:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00002000:00010000:1.0:1784290435.179568:0:25102:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1784290435.179574:0:25102:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb mtime from disk: 1784290430 -> 1784290435 00000100:00100000:0.0:1784290435.179581:0:26263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896326016 00002000:00010000:1.0:1784290435.179592:0:25102:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb atime from disk: 1784290430 -> 1784290430 00000100:00100000:0.0:1784290435.179594:0:26263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896326016 00002000:00010000:1.0:1784290435.179598:0:25102:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb ctime from disk: 1784290430 -> 1784290435 00002000:00010000:1.0:1784290435.179605:0:25102:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1784290435.179622:0:25102:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c246a4f8a80 x1870961896325888/t4294968667(0) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.179637:0:26263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5014 00000100:00100000:0.0:1784290435.179647:0:26263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f98b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+34:73475:x1870961896326016:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1784290435.179656:0:26263:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290435.179673:0:26263:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e71fe3a2/0x5953bbf6b3076127 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b28bc expref: -99 pid: 26263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.179694:0:25102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+34:2400:x1870961896325888:12345-192.168.202.6@tcp:10:dd.0 Request processed in 226us (440us total) trans 4294968667 rc 0/0 00002000:00010000:0.0:1784290435.179695:0:26263:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76f:0x0] initial LVB size: 0, mtime: 0x6a5a1c7e, atime: 0x6a5a1c7e, ctime: 0x6a5a1c7e, blocks: 0x0 00000100:00100000:1.0:1784290435.179717:0:25102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 371 00002000:00010000:1.0:1784290435.179722:0:25102:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1901 (0->18446744073709551615) 00002000:00100000:1.0:1784290435.179726:0:25102:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c246a4f8a80 with x1870961896325888 ext(0->18446744073709551615) 00010000:00010000:0.0:1784290435.179727:0:26263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76f:0x0].0x0 since=2176s v=(0 0) 00002000:00010000:1.0:1784290435.179737:0:25102:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c246a4f8a80. 00010000:00010000:0.0:1784290435.179737:0:26263:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290435.179762:0:26263:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e71fe3a2/0x5953bbf6b3076127 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28bc expref: 34 pid: 26263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.179785:0:26263:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e71fe3a2/0x5953bbf6b3076127 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28bc expref: 34 pid: 26263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.179796:0:26263:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2f4c00, rc 0) 00010000:00000080:0.0:1784290435.179802:0:26263:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c247f98b800 x1870961896326016/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 328/400 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.179837:0:26263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f98b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+34:73475:x1870961896326016:12345-192.168.202.6@tcp:101:dd.0 Request processed in 192us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290435.179843:0:26263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5014 00000100:00100000:3.0:1784290435.179953:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.180000:0:68995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896326272 00000100:00100000:0.0:1784290435.180005:0:68995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896326272 00000100:00100000:0.0:1784290435.180039:0:68995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 273 00000100:00100000:0.0:1784290435.180043:0:68995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+127:73471:x1870961896326272:12345-192.168.202.6@tcp:35:dd.0 00000100:00100000:0.0:1784290435.180166:0:68995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+128:73471:x1870961896326272:12345-192.168.202.6@tcp:35:dd.0 Request processed in 122us (214us total) trans 120259084414 rc 0/0 00000100:00100000:0.0:1784290435.180172:0:68995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 273 00000100:00100000:2.0:1784290435.181655:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.181694:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.181713:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896326400 00000100:00100000:0.0:1784290435.181722:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896326400 00002000:00010000:0.0:1784290435.181743:0:24752:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1903 (0->18446744073709551615) 00002000:00100000:0.0:1784290435.181749:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c247f989c00 with x1870961896326400 ext(0->18446744073709551615) 00002000:00010000:0.0:1784290435.181758:0:24752:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c247f989c00. 00000100:00100000:1.0:1784290435.181767:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896326528 00000100:00100000:1.0:1784290435.181776:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896326528 00000100:00100000:0.0:1784290435.181797:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 372 00000100:00100000:0.0:1784290435.181813:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+34:2398:x1870961896326400:12345-192.168.202.6@tcp:10:dd.0 00000100:00100000:1.0:1784290435.181833:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1432 00000100:00100000:1.0:1784290435.181845:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+128:73477:x1870961896326528:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:1.0:1784290435.181860:0:74876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290435.181874:0:74876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d400/0x5953bbf6b307612e lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b28c3 expref: -99 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.181899:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b3076135 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.181905:0:24752:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:1.0:1784290435.181910:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b3076135 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.181910:0:24752:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb mtime from disk: 1784290430 -> 1784290435 00002000:00010000:0.0:1784290435.181914:0:24752:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb atime from disk: 1784290430 -> 1784290430 00002000:00010000:0.0:1784290435.181929:0:24752:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb ctime from disk: 1784290430 -> 1784290435 00002000:00010000:0.0:1784290435.181946:0:24752:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:1.0:1784290435.181954:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b3076135 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:0.0:1784290435.181960:0:24752:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c247f989c00 x1870961896326400/t4294968668(0) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.182026:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+35:2398:x1870961896326400:12345-192.168.202.6@tcp:10:dd.0 Request processed in 218us (373us total) trans 4294968668 rc 0/0 00000100:00100000:0.0:1784290435.182033:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 372 00002000:00010000:0.0:1784290435.182037:0:24752:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1903 (0->18446744073709551615) 00002000:00100000:0.0:1784290435.182040:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c247f989c00 with x1870961896326400 ext(0->18446744073709551615) 00002000:00010000:0.0:1784290435.182045:0:24752:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c247f989c00. 00010000:00010000:1.0:1784290435.182084:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d400/0x5953bbf6b307612e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28c3 expref: 130 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.182112:0:74876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ce00/0x5953bbf6b3076135 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28c3 expref: 129 pid: 74876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.182122:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9c244c870800) 00010000:00010000:1.0:1784290435.182125:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784290435.182128:0:74876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2469a7ce00, rc 0) 00000100:00100000:1.0:1784290435.182176:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+129:73477:x1870961896326528:12345-192.168.202.6@tcp:101:dd.0 Request processed in 334us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290435.182184:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1432 00000100:00100000:2.0:1784290435.182421:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.182462:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.182477:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896327040 00000100:00100000:3.0:1784290435.182483:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896327040 00000100:00100000:1.0:1784290435.182505:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896326784 00000100:00100000:1.0:1784290435.182513:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896326784 00000100:00100000:1.0:1784290435.182552:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1433 00000100:00100000:2.0:1784290435.182567:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1434 00000100:00100000:1.0:1784290435.182571:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+130:73478:x1870961896327040:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:1.0:1784290435.182582:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1784290435.182588:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f98b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+130:73474:x1870961896326784:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:1.0:1784290435.182599:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7de00/0x5953bbf6b307613c lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b28ca expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.182618:0:65988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290435.182634:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c200/0x5953bbf6b30760da lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28a0 expref: 131 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.182649:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9c2446227200) 00010000:00010000:2.0:1784290435.182653:0:65988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290435.182692:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3076143 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.182702:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3076143 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.182710:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3076143 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.182734:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b307614a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.182742:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b307614a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.182745:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3076151 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.182750:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b307614a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.182761:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3076151 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.182784:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3076151 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.182796:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3076158 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.182806:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3076158 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.182814:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3076158 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784290435.182822:0:66008:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x16:0x0]: returning size 0 00000001:00080000:2.0:1784290435.182828:0:65988:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084415 00000004:00010000:2.0:1784290435.182858:0:65988:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6202854 reply state 000000004f784461 transno 120259084416 ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3076151 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.182881:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3076151 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.182886:0:66008:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3076143 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.182890:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9c2446227200) 00010000:00010000:2.0:1784290435.182909:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1784290435.182910:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.182920:0:65988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784290435.182924:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3076143 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.182932:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3076143 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.182958:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3076143 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.182967:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7ca00 already unused, calling callback (ffffffffc1aba4f0) 00000100:00100000:0.0:1784290435.182970:0:65991:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896327296 00000100:00100000:0.0:1784290435.182978:0:65991:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896327296 00010000:00010000:1.0:1784290435.182981:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3076143 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.182991:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3076143 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.183007:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:1.0:1784290435.183011:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290435.183015:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3076143 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.183023:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f98b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+135:73474:x1870961896326784:12345-192.168.202.6@tcp:36:dd.0 Request processed in 441us (560us total) trans 120259084416 rc 0/0 00010000:00010000:1.0:1784290435.183029:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7ca00/0x5953bbf6b3076143 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290435.183031:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 274 00000100:00100000:0.0:1784290435.183057:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+135:73473:x1870961896327296:12345-192.168.202.6@tcp:35:dd.0 00000100:00100000:2.0:1784290435.183059:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1434 00000020:00080000:2.0:1784290435.183076:0:65988:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784290435.183088:0:66008:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b307614a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.183103:0:66008:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b307614a lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.183114:0:66008:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b307614a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.183120:0:66008:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7c400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:1.0:1784290435.183124:0:66008:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b307614a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.183131:0:66008:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b307614a lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.183141:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe2aa5ca3 (ffff9c2458ba5200) 00010000:00010000:1.0:1784290435.183143:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784290435.183155:0:66008:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b307614a lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.183161:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c400/0x5953bbf6b307614a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.183204:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7de00/0x5953bbf6b307613c lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28ca expref: 136 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290435.183216:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+135:73473:x1870961896327296:12345-192.168.202.6@tcp:35:dd.0 Request processed in 162us (320us total) trans 120259084418 rc 0/0 00010000:00010000:1.0:1784290435.183224:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3076158 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28ca expref: 135 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290435.183236:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 274 00010000:00010000:1.0:1784290435.183247:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9c244c870600) 00010000:00010000:1.0:1784290435.183250:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784290435.183253:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2469a7d600, rc 0) 00000100:00100000:1.0:1784290435.183289:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f989880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+134:73478:x1870961896327040:12345-192.168.202.6@tcp:101:dd.0 Request processed in 728us (868us total) trans 120259084417 rc 0/0 00000100:00100000:1.0:1784290435.183296:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1433 00000100:00100000:3.0:1784290435.183684:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.183720:0:68995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896327552 00000100:00100000:0.0:1784290435.183726:0:68995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896327552 00000100:00100000:0.0:1784290435.183763:0:68995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 275 00000100:00100000:0.0:1784290435.183773:0:68995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+134:73475:x1870961896327552:12345-192.168.202.6@tcp:35:dd.0 00000100:00100000:0.0:1784290435.183929:0:68995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+135:73475:x1870961896327552:12345-192.168.202.6@tcp:35:dd.0 Request processed in 158us (245us total) trans 120259084419 rc 0/0 00000100:00100000:0.0:1784290435.183958:0:68995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 275 00000100:00100000:2.0:1784290435.184187:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.184223:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896327680 00000100:00100000:3.0:1784290435.184246:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896327680 00000100:00100000:3.0:1784290435.184275:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5015 00000100:00100000:3.0:1784290435.184283:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+35:73474:x1870961896327680:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:3.0:1784290435.184291:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784290435.184304:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090b36dfb/0x5953bbf6b3076166 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b28d1 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784290435.184319:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x76e:0x0] initial LVB size: 0, mtime: 0x6a5a1c7e, atime: 0x6a5a1c7e, ctime: 0x6a5a1c7e, blocks: 0x0 00010000:00010000:3.0:1784290435.184344:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76e:0x0].0x0 since=2176s v=(0 0) 00010000:00010000:3.0:1784290435.184347:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x76e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290435.184352:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090b36dfb/0x5953bbf6b3076166 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28d1 expref: 36 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.184411:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000090b36dfb/0x5953bbf6b3076166 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28d1 expref: 36 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.184421:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2ffc00, rc 0) 00010000:00000080:3.0:1784290435.184426:0:8403:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2475eb9850 x1870961896327680/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 328/400 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290435.184496:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475eb9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+36:73474:x1870961896327680:12345-192.168.202.6@tcp:101:dd.0 Request processed in 210us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290435.184507:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5015 00000100:00100000:3.0:1784290435.185113:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.185154:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896327808 00000100:00100000:2.0:1784290435.185162:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896327808 00000100:00100000:2.0:1784290435.185200:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1435 00000100:00100000:2.0:1784290435.185207:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+135:73478:x1870961896327808:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:2.0:1784290435.185225:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784290435.185237:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b307616d lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b28d8 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.185284:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3076174 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.185294:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3076174 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.185302:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3076174 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.185411:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045600/0x5953bbf6b307616d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28d8 expref: 137 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.185428:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482044c00/0x5953bbf6b3076174 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28d8 expref: 136 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.185435:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9c244c870600) 00010000:00010000:2.0:1784290435.185438:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784290435.185440:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2482044c00, rc 0) 00000100:00100000:2.0:1784290435.185480:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+136:73478:x1870961896327808:12345-192.168.202.6@tcp:101:dd.0 Request processed in 274us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290435.185486:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1435 00000100:00100000:3.0:1784290435.185755:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.185796:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896328064 00000100:00100000:0.0:1784290435.185802:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896328064 00000100:00100000:0.0:1784290435.185832:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1436 00000100:00100000:0.0:1784290435.185839:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+136:73479:x1870961896328064:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1784290435.185848:0:66004:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290435.185857:0:66004:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5c00/0x5953bbf6b307617b lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b28df expref: -99 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.185923:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3076182 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.185932:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3076182 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.185955:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3076182 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.185965:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:0.0:1784290435.185979:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3076189 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.185990:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3076189 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.185992:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:0.0:1784290435.186004:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3076189 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.186015:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896328320 00000100:00100000:2.0:1784290435.186023:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896328320 00010000:00010000:0.0:1784290435.186042:0:66004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5800/0x5953bbf6b3076190 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.186054:0:25104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896328448 00010000:00010000:0.0:1784290435.186059:0:66004:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5800/0x5953bbf6b3076190 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.186067:0:25104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896328448 00010000:00010000:0.0:1784290435.186072:0:66004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5800/0x5953bbf6b3076190 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.186081:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1437 00000004:00200000:0.0:1784290435.186098:0:66004:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x17:0x0]: returning size 0 00002000:00010000:1.0:1784290435.186106:0:25104:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1902 (0->18446744073709551615) 00000100:00100000:2.0:1784290435.186110:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+138:73477:x1870961896328320:12345-192.168.202.6@tcp:36:dd.0 00002000:00100000:1.0:1784290435.186112:0:25104:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c24483c8380 with x1870961896328448 ext(0->18446744073709551615) 00002000:00010000:1.0:1784290435.186126:0:25104:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c24483c8380. 00010000:00010000:0.0:1784290435.186146:0:66004:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3076182 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.186156:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3076182 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.186158:0:25104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 373 00010000:00010000:2.0:1784290435.186159:0:65988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290435.186176:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3076182 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.186184:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3076182 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.186185:0:25104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+36:2398:x1870961896328448:12345-192.168.202.6@tcp:10:dd.0 00010000:00010000:0.0:1784290435.186214:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f5600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:2.0:1784290435.186215:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076119 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28b5 expref: 139 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.186224:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3076182 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.186304:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3076182 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.186322:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9c244c870800) 00010000:00010000:0.0:1784290435.186323:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:0.0:1784290435.186341:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784290435.186342:0:65988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1784290435.186411:0:25104:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:0.0:1784290435.186414:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3076182 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290435.186425:0:25104:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb mtime from disk: 1784290430 -> 1784290435 00002000:00010000:1.0:1784290435.186438:0:25104:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb atime from disk: 1784290430 -> 1784290430 00010000:00010000:0.0:1784290435.186438:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5600/0x5953bbf6b3076182 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290435.186466:0:25104:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb ctime from disk: 1784290430 -> 1784290435 00002000:00010000:1.0:1784290435.186474:0:25104:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:0.0:1784290435.186480:0:66004:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3076189 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:1.0:1784290435.186492:0:25104:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c24483c8380 x1870961896328448/t4294968669(0) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1784290435.186494:0:66004:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3076189 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.186540:0:66004:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3076189 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.186549:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b307619e lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.186551:0:66004:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2f4200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:0.0:1784290435.186560:0:66004:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3076189 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.186583:0:66004:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3076189 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.186599:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b307619e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.186600:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x3c635ca3 (ffff9c2469829400) 00010000:00010000:0.0:1784290435.186618:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784290435.186624:0:25104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+37:2398:x1870961896328448:12345-192.168.202.6@tcp:10:dd.0 Request processed in 439us (620us total) trans 4294968669 rc 0/0 00010000:00010000:0.0:1784290435.186627:0:66004:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3076189 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.186631:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b307619e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.186668:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4200/0x5953bbf6b3076189 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.186671:0:25104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 373 00002000:00010000:1.0:1784290435.186684:0:25104:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1902 (0->18446744073709551615) 00002000:00100000:1.0:1784290435.186690:0:25104:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c24483c8380 with x1870961896328448 ext(0->18446744073709551615) 00002000:00010000:1.0:1784290435.186701:0:25104:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c24483c8380. 00000001:00080000:2.0:1784290435.186709:0:65988:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084421 00010000:00010000:0.0:1784290435.186748:0:66004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5c00/0x5953bbf6b307617b lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28df expref: 141 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784290435.186749:0:65988:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bf6aa5bd reply state 000000007353c6d7 transno 120259084422 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b307619e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.186796:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00010000:2.0:1784290435.186802:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b307619e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.186803:0:66004:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5800/0x5953bbf6b3076190 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28df expref: 140 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.186837:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896328704 00010000:00010000:2.0:1784290435.186849:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9c244c870800) 00000100:00100000:1.0:1784290435.186851:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896328704 00010000:00010000:2.0:1784290435.186864:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1784290435.186875:0:65988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784290435.186880:0:66004:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9c2474f5ff00) 00010000:00010000:0.0:1784290435.186886:0:66004:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784290435.186891:0:66004:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2f5800, rc 0) 00000100:00100000:1.0:1784290435.186900:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1438 00000100:00100000:1.0:1784290435.186914:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+142:73478:x1870961896328704:12345-192.168.202.6@tcp:36:dd.0 00000100:00100000:0.0:1784290435.186956:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+142:73479:x1870961896328064:12345-192.168.202.6@tcp:101:dd.0 Request processed in 1112us (1198us total) trans 120259084420 rc 0/0 00000100:00100000:2.0:1784290435.186968:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+142:73477:x1870961896328320:12345-192.168.202.6@tcp:36:dd.0 Request processed in 864us (1003us total) trans 120259084422 rc 0/0 00010000:00010000:1.0:1784290435.186971:0:74876:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784290435.186993:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1436 00010000:00010000:1.0:1784290435.187005:0:74876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7d600/0x5953bbf6b3076158 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28ca expref: 142 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.187011:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1437 00000020:00080000:2.0:1784290435.187020:0:65988:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784290435.187031:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9c244c870600) 00010000:00010000:1.0:1784290435.187038:0:74876:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784290435.187187:0:74876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b30761a5 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.187219:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b30761a5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.187226:0:74876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b30761a5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784290435.187276:0:74876:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084423 00000004:00010000:1.0:1784290435.187294:0:74876:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c73dc2a0 reply state 000000007bd8712f transno 120259084424 ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b30761a5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.187304:0:74876:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b30761a5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.187310:0:74876:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9c244c870600) 00010000:00010000:1.0:1784290435.187312:0:74876:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1784290435.187314:0:74876:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784290435.187401:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+142:73478:x1870961896328704:12345-192.168.202.6@tcp:36:dd.0 Request processed in 491us (620us total) trans 120259084424 rc 0/0 00000100:00100000:1.0:1784290435.187407:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1438 00000020:00080000:1.0:1784290435.187411:0:74876:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784290435.188509:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.188556:0:26253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896328832 00000100:00100000:0.0:1784290435.188579:0:26253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896328832 00000100:00100000:0.0:1784290435.188620:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5016 00000100:00100000:0.0:1784290435.188627:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+37:73477:x1870961896328832:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1784290435.188636:0:26253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290435.188649:0:26253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000924000f3/0x5953bbf6b30761ac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b28e6 expref: -99 pid: 26253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.188664:0:26253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x771:0x0] initial LVB size: 0, mtime: 0x6a5a1c7f, atime: 0x6a5a1c7f, ctime: 0x6a5a1c7f, blocks: 0x0 00010000:00010000:0.0:1784290435.188679:0:26253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x771:0x0].0x0 since=2176s v=(0 0) 00010000:00010000:0.0:1784290435.188684:0:26253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x771:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290435.188693:0:26253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000924000f3/0x5953bbf6b30761ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28e6 expref: 38 pid: 26253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.188710:0:26253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000924000f3/0x5953bbf6b30761ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28e6 expref: 38 pid: 26253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.188723:0:26253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2f4600, rc 0) 00000100:00100000:3.0:1784290435.188728:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00000080:0.0:1784290435.188741:0:26253:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c24483cad80 x1870961896328832/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 328/400 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290435.188772:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896328960 00000100:00100000:1.0:1784290435.188780:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896328960 00000100:00100000:0.0:1784290435.188784:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+38:73477:x1870961896328832:12345-192.168.202.6@tcp:101:dd.0 Request processed in 154us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290435.188793:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5016 00000100:00100000:0.0:1784290435.188835:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5017 00000100:00100000:0.0:1784290435.188845:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+38:73478:x1870961896328960:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1784290435.188853:0:26253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784290435.188863:0:26253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b5c07c7/0x5953bbf6b30761b3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b28ed expref: -99 pid: 26253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.188874:0:26253:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x772:0x0] initial LVB size: 0, mtime: 0x6a5a1c7f, atime: 0x6a5a1c7f, ctime: 0x6a5a1c7f, blocks: 0x0 00010000:00010000:0.0:1784290435.188883:0:26253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x772:0x0].0x0 since=2176s v=(0 0) 00010000:00010000:0.0:1784290435.188886:0:26253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x772:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784290435.188892:0:26253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b5c07c7/0x5953bbf6b30761b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28ed expref: 39 pid: 26253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.188901:0:26253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b5c07c7/0x5953bbf6b30761b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28ed expref: 39 pid: 26253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.188908:0:26253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2f4000, rc 0) 00010000:00000080:0.0:1784290435.188912:0:26253:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c24483ca300 x1870961896328960/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 328/400 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.188951:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+39:73478:x1870961896328960:12345-192.168.202.6@tcp:101:dd.0 Request processed in 107us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290435.188966:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5017 00000100:00100000:3.0:1784290435.189037:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.189083:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896329216 00000100:00100000:0.0:1784290435.189088:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896329216 00000100:00100000:0.0:1784290435.189133:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 276 00000100:00100000:0.0:1784290435.189139:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+142:73474:x1870961896329216:12345-192.168.202.6@tcp:35:dd.0 00000100:00100000:0.0:1784290435.189285:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+143:73474:x1870961896329216:12345-192.168.202.6@tcp:35:dd.0 Request processed in 146us (253us total) trans 120259084425 rc 0/0 00000100:00100000:0.0:1784290435.189292:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 276 00000100:00100000:2.0:1784290435.189967:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.190017:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896329344 00000100:00100000:3.0:1784290435.190023:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896329344 00002000:00010000:3.0:1784290435.190039:0:8408:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1905 (0->18446744073709551615) 00002000:00100000:3.0:1784290435.190043:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c247f98b800 with x1870961896329344 ext(0->18446744073709551615) 00002000:00010000:3.0:1784290435.190049:0:8408:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c247f98b800. 00000100:00100000:3.0:1784290435.190068:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 374 00000100:00100000:3.0:1784290435.190074:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f98b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+39:2397:x1870961896329344:12345-192.168.202.6@tcp:10:dd.0 00002000:00010000:3.0:1784290435.190205:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1784290435.190240:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00002000:00010000:3.0:1784290435.190259:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb mtime from disk: 1784290431 -> 1784290435 00002000:00010000:3.0:1784290435.190264:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb atime from disk: 1784290431 -> 1784290431 00002000:00010000:3.0:1784290435.190266:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb ctime from disk: 1784290431 -> 1784290435 00002000:00010000:3.0:1784290435.190268:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1784290435.190278:0:8408:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c247f98b800 x1870961896329344/t4294968670(0) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.190317:0:25100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896329472 00000100:00100000:0.0:1784290435.190324:0:25100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896329472 00002000:00010000:0.0:1784290435.190345:0:25100:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1906 (0->18446744073709551615) 00002000:00100000:0.0:1784290435.190349:0:25100:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c247f98a680 with x1870961896329472 ext(0->18446744073709551615) 00002000:00010000:0.0:1784290435.190409:0:25100:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c247f98a680. 00000100:00100000:0.0:1784290435.190453:0:25100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 375 00000100:00100000:0.0:1784290435.190468:0:25100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f98a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+41:2400:x1870961896329472:12345-192.168.202.6@tcp:10:dd.0 00000100:00100000:3.0:1784290435.190504:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f98b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+41:2397:x1870961896329344:12345-192.168.202.6@tcp:10:dd.0 Request processed in 426us (537us total) trans 4294968670 rc 0/0 00000100:00100000:3.0:1784290435.190514:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 374 00002000:00010000:3.0:1784290435.190519:0:8408:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1905 (0->18446744073709551615) 00002000:00100000:3.0:1784290435.190523:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c247f98b800 with x1870961896329344 ext(0->18446744073709551615) 00002000:00010000:3.0:1784290435.190532:0:8408:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c247f98b800. 00002000:00010000:0.0:1784290435.190564:0:25100:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784290435.190567:0:25100:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb mtime from disk: 1784290431 -> 1784290435 00002000:00010000:0.0:1784290435.190571:0:25100:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb atime from disk: 1784290431 -> 1784290431 00002000:00010000:0.0:1784290435.190574:0:25100:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb ctime from disk: 1784290431 -> 1784290435 00002000:00010000:0.0:1784290435.190577:0:25100:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1784290435.190588:0:25100:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c247f98a680 x1870961896329472/t4294968671(0) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.190616:0:25100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f98a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+41:2400:x1870961896329472:12345-192.168.202.6@tcp:10:dd.0 Request processed in 154us (377us total) trans 4294968671 rc 0/0 00000100:00100000:0.0:1784290435.190632:0:25100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 375 00002000:00010000:0.0:1784290435.190636:0:25100:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1906 (0->18446744073709551615) 00002000:00100000:0.0:1784290435.190642:0:25100:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c247f98a680 with x1870961896329472 ext(0->18446744073709551615) 00000100:00100000:2.0:1784290435.190644:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00002000:00010000:0.0:1784290435.190653:0:25100:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c247f98a680. 00000100:00100000:3.0:1784290435.190808:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896329600 00000100:00100000:3.0:1784290435.190813:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896329600 00000100:00100000:2.0:1784290435.190825:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.190889:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896329856 00000100:00100000:3.0:1784290435.190901:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896329856 00000100:00100000:1.0:1784290435.190902:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1439 00000100:00100000:1.0:1784290435.190923:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+144:73479:x1870961896329600:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:1.0:1784290435.190948:0:66008:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1784290435.190962:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1440 00010000:00010000:1.0:1784290435.190964:0:66008:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2474ea4600/0x5953bbf6b30761ba lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b28f4 expref: -99 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.190977:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c23433d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+144:73480:x1870961896329856:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:3.0:1784290435.190993:0:65989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290435.190994:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2474ea5200/0x5953bbf6b30761c1 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191012:0:65989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b30761c8 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b28fb expref: -99 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.191013:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c2474ea5200/0x5953bbf6b30761c1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.191064:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c2474ea5200/0x5953bbf6b30761c1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191169:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b30761cf lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191179:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b30761cf lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.191189:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2474ea4600/0x5953bbf6b30761ba lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28f4 expref: 147 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191191:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b30761cf lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191223:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b30761d6 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191231:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b30761d6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191236:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b30761d6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.191241:0:66008:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2474ea5200/0x5953bbf6b30761c1 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28f4 expref: 146 pid: 66008 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.191257:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9c2474f5ff00) 00010000:00010000:1.0:1784290435.191262:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784290435.191267:0:66008:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2474ea5200, rc 0) 00010000:00010000:3.0:1784290435.191272:0:65989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b30761dd lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191279:0:65989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b30761dd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191284:0:65989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b30761dd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784290435.191301:0:65989:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x20000cf21:0x18:0x0]: returning size 0 00000100:00100000:1.0:1784290435.191333:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f988e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+147:73479:x1870961896329600:12345-192.168.202.6@tcp:101:dd.0 Request processed in 415us (691us total) trans 0 rc 0/0 00010000:00010000:3.0:1784290435.191399:0:65989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b30761cf lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191412:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b30761cf lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191419:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b30761cf lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191425:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b30761cf lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191433:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2ff000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290435.191437:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b30761cf lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191449:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b30761cf lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290435.191461:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1439 00010000:00010000:3.0:1784290435.191472:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9c246de62700) 00010000:00010000:3.0:1784290435.191476:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290435.191482:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b30761cf lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191487:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2ff000/0x5953bbf6b30761cf lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191500:0:65989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b30761d6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191514:0:65989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b30761d6 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191519:0:65989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b30761d6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191522:0:65989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fea00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290435.191524:0:65989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b30761d6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191529:0:65989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b30761d6 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191584:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x961c5ca3 (ffff9c244abad900) 00010000:00010000:3.0:1784290435.191587:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290435.191590:0:65989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b30761d6 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191595:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fea00/0x5953bbf6b30761d6 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191627:0:65989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fe200/0x5953bbf6b30761c8 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28fb expref: 147 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191635:0:65989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b30761dd lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28fb expref: 146 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.191641:0:65989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9c244c870b00) 00010000:00010000:3.0:1784290435.191643:0:65989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784290435.191651:0:65989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2fec00, rc 0) 00000100:00100000:3.0:1784290435.191685:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c23433d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+146:73480:x1870961896329856:12345-192.168.202.6@tcp:101:dd.0 Request processed in 715us (867us total) trans 120259084426 rc 0/0 00000100:00100000:3.0:1784290435.191691:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1440 00000100:00100000:2.0:1784290435.192846:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.192889:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.192890:0:68995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896330112 00000100:00100000:0.0:1784290435.192896:0:68995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896330112 00000100:00100000:0.0:1784290435.192948:0:68995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896330368 00000100:00100000:0.0:1784290435.192954:0:68995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896330368 00000100:00100000:1.0:1784290435.192962:0:65991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 277 00000100:00100000:1.0:1784290435.192978:0:65991:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+147:73477:x1870961896330112:12345-192.168.202.6@tcp:35:dd.0 00000100:00100000:2.0:1784290435.192991:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 278 00000100:00100000:2.0:1784290435.193011:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247c209450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+147:73478:x1870961896330368:12345-192.168.202.6@tcp:35:dd.0 00000100:00100000:1.0:1784290435.193158:0:65991:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+149:73477:x1870961896330112:12345-192.168.202.6@tcp:35:dd.0 Request processed in 185us (314us total) trans 120259084427 rc 0/0 00000100:00100000:1.0:1784290435.193167:0:65991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 277 00000100:00100000:2.0:1784290435.193187:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247c209450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+148:73478:x1870961896330368:12345-192.168.202.6@tcp:35:dd.0 Request processed in 182us (296us total) trans 120259084428 rc 0/0 00000100:00100000:2.0:1784290435.193197:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 278 00000100:00100000:3.0:1784290435.193432:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.193461:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896330624 00000100:00100000:2.0:1784290435.193468:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896330624 00000100:00100000:2.0:1784290435.193503:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1441 00000100:00100000:2.0:1784290435.193511:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+148:73479:x1870961896330624:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:2.0:1784290435.193536:0:65988:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290435.193551:0:65988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5800/0x5953bbf6b3076190 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28df expref: 148 pid: 66004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.193577:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9c2474f5ff00) 00010000:00010000:2.0:1784290435.193580:0:65988:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784290435.193656:0:65988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30761eb lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.193668:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30761eb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.193677:0:65988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30761eb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.193695:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000001:00080000:2.0:1784290435.193719:0:65988:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084429 00000004:00010000:2.0:1784290435.193742:0:65988:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005b0aa08d reply state 000000000856bf71 transno 120259084430 ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30761eb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.193765:0:65988:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30761eb lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.193772:0:65988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9c2474f5ff00) 00010000:00010000:2.0:1784290435.193779:0:65988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290435.193779:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896330752 00000100:00100000:2.0:1784290435.193788:0:65988:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784290435.193793:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896330752 00000100:00100000:0.0:1784290435.193839:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1442 00000100:00100000:0.0:1784290435.193847:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+151:73480:x1870961896330752:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:0.0:1784290435.193858:0:65990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1784290435.193864:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+151:73479:x1870961896330624:12345-192.168.202.6@tcp:36:dd.0 Request processed in 350us (433us total) trans 120259084430 rc 0/0 00010000:00010000:0.0:1784290435.193869:0:65990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b30761f2 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2902 expref: -99 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290435.193884:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1441 00000020:00080000:2.0:1784290435.193890:0:65988:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784290435.193902:0:65990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4400/0x5953bbf6b30761f9 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.193914:0:65990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4400/0x5953bbf6b30761f9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.193922:0:65990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4400/0x5953bbf6b30761f9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.194012:0:65990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f5a00/0x5953bbf6b30761f2 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2902 expref: 152 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.194025:0:65990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2f4400/0x5953bbf6b30761f9 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2902 expref: 151 pid: 65990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.194037:0:65990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9c244c870b00) 00010000:00010000:0.0:1784290435.194039:0:65990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784290435.194041:0:65990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2f4400, rc 0) 00000100:00100000:0.0:1784290435.194074:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+151:73480:x1870961896330752:12345-192.168.202.6@tcp:101:dd.0 Request processed in 228us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290435.194081:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1442 00000100:00100000:3.0:1784290435.195124:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290435.195171:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896330880 00000100:00100000:1.0:1784290435.195180:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896330880 00000100:00100000:1.0:1784290435.195237:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5018 00000100:00100000:1.0:1784290435.195244:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+41:73479:x1870961896330880:12345-192.168.202.6@tcp:101:dd.0 00010000:00010000:1.0:1784290435.195253:0:26258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784290435.195270:0:26258:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000684c7b4d/0x5953bbf6b3076200 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2909 expref: -99 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290435.195297:0:26258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x773:0x0] initial LVB size: 0, mtime: 0x6a5a1c7f, atime: 0x6a5a1c7f, ctime: 0x6a5a1c7f, blocks: 0x0 00010000:00010000:1.0:1784290435.195312:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x773:0x0].0x0 since=2176s v=(0 0) 00010000:00010000:1.0:1784290435.195316:0:26258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x773:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784290435.195324:0:26258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000684c7b4d/0x5953bbf6b3076200 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2909 expref: 42 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.195337:0:26258:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000684c7b4d/0x5953bbf6b3076200 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2909 expref: 42 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.195389:0:26258:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2474ea4800, rc 0) 00000100:00100000:2.0:1784290435.195398:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00000080:1.0:1784290435.195401:0:26258:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c24483c8700 x1870961896330880/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 328/400 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.195456:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896331136 00000100:00100000:0.0:1784290435.195464:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896331136 00000100:00100000:1.0:1784290435.195467:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+42:73479:x1870961896330880:12345-192.168.202.6@tcp:101:dd.0 Request processed in 220us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290435.195478:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5018 00000100:00100000:0.0:1784290435.195535:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1443 00000100:00100000:0.0:1784290435.195549:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+151:73480:x1870961896331136:12345-192.168.202.6@tcp:36:dd.0 00010000:00010000:0.0:1784290435.195595:0:66008:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784290435.195607:0:66008:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247d2fec00/0x5953bbf6b30761dd lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28fb expref: 151 pid: 65989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.195618:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9c244c870b00) 00010000:00010000:0.0:1784290435.195620:0:66008:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784290435.195688:0:66008:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076207 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.195696:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076207 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.195702:0:66008:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076207 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784290435.195726:0:66008:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 120259084431 00000004:00010000:0.0:1784290435.195738:0:66008:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000085303f14 reply state 0000000088115e46 transno 120259084432 ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076207 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.195753:0:66008:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076207 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.195758:0:66008:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9c244c870b00) 00010000:00010000:0.0:1784290435.195761:0:66008:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1784290435.195762:0:66008:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784290435.195813:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+153:73480:x1870961896331136:12345-192.168.202.6@tcp:36:dd.0 Request processed in 270us (421us total) trans 120259084432 rc 0/0 00000100:00100000:0.0:1784290435.195819:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1443 00000020:00080000:0.0:1784290435.195823:0:66008:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784290435.196887:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290435.196969:0:25102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896331264 00000100:00100000:1.0:1784290435.196978:0:25102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896331264 00002000:00010000:1.0:1784290435.197006:0:25102:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1907 (0->18446744073709551615) 00002000:00100000:1.0:1784290435.197012:0:25102:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c234434f480 with x1870961896331264 ext(0->18446744073709551615) 00000100:00100000:2.0:1784290435.197020:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00002000:00010000:1.0:1784290435.197025:0:25102:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c234434f480. 00000100:00100000:3.0:1784290435.197062:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896331392 00000100:00100000:1.0:1784290435.197073:0:25102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 376 00000100:00100000:1.0:1784290435.197084:0:25102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234434f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+42:2400:x1870961896331264:12345-192.168.202.6@tcp:10:dd.0 00000100:00100000:3.0:1784290435.197105:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896331392 00000100:00100000:3.0:1784290435.197155:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5019 00000100:00100000:3.0:1784290435.197168:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+44:73480:x1870961896331392:12345-192.168.202.6@tcp:101:dd.0 00002000:00010000:1.0:1784290435.197193:0:25102:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:3.0:1784290435.197195:0:26252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1784290435.197200:0:25102:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb mtime from disk: 1784290431 -> 1784290435 00010000:00010000:3.0:1784290435.197212:0:26252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b26e3f5/0x5953bbf6b307620e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2910 expref: -99 pid: 26252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784290435.197212:0:25102:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb atime from disk: 1784290431 -> 1784290431 00002000:00010000:1.0:1784290435.197223:0:25102:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb ctime from disk: 1784290431 -> 1784290435 00002000:00010000:1.0:1784290435.197238:0:25102:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00010000:3.0:1784290435.197258:0:26252:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x774:0x0] initial LVB size: 0, mtime: 0x6a5a1c7f, atime: 0x6a5a1c7f, ctime: 0x6a5a1c7f, blocks: 0x0 00010000:00000080:1.0:1784290435.197260:0:25102:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c234434f480 x1870961896331264/t4294968672(0) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1784290435.197282:0:26252:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x774:0x0].0x0 since=2176s v=(0 0) 00010000:00010000:3.0:1784290435.197288:0:26252:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x774:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784290435.197295:0:26252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b26e3f5/0x5953bbf6b307620e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2910 expref: 45 pid: 26252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.197308:0:26252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002b26e3f5/0x5953bbf6b307620e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2910 expref: 45 pid: 26252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.197318:0:26252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2fe200, rc 0) 00000100:00100000:1.0:1784290435.197326:0:25102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234434f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+45:2400:x1870961896331264:12345-192.168.202.6@tcp:10:dd.0 Request processed in 237us (434us total) trans 4294968672 rc 0/0 00010000:00000080:3.0:1784290435.197333:0:26252:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c246a4f9180 x1870961896331392/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 328/400 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290435.197377:0:25102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 376 00002000:00010000:1.0:1784290435.197386:0:25102:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1907 (0->18446744073709551615) 00002000:00100000:1.0:1784290435.197391:0:25102:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c234434f480 with x1870961896331264 ext(0->18446744073709551615) 00002000:00010000:1.0:1784290435.197399:0:25102:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c234434f480. 00000100:00100000:3.0:1784290435.197554:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+44:73480:x1870961896331392:12345-192.168.202.6@tcp:101:dd.0 Request processed in 313us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290435.197565:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5019 00000100:00100000:2.0:1784290435.198534:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.198589:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896331520 00000100:00100000:0.0:1784290435.198595:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896331520 00002000:00010000:0.0:1784290435.198612:0:24752:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1908 (0->18446744073709551615) 00002000:00100000:0.0:1784290435.198616:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c247581f480 with x1870961896331520 ext(0->18446744073709551615) 00002000:00010000:0.0:1784290435.198621:0:24752:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c247581f480. 00000100:00100000:0.0:1784290435.198643:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 377 00000100:00100000:0.0:1784290435.198649:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+44:2397:x1870961896331520:12345-192.168.202.6@tcp:10:dd.0 00002000:00010000:0.0:1784290435.198712:0:24752:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1784290435.198716:0:24752:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb mtime from disk: 1784290431 -> 1784290435 00002000:00010000:0.0:1784290435.198718:0:24752:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb atime from disk: 1784290431 -> 1784290431 00002000:00010000:0.0:1784290435.198720:0:24752:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb ctime from disk: 1784290431 -> 1784290435 00002000:00010000:0.0:1784290435.198721:0:24752:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1784290435.198726:0:24752:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c247581f480 x1870961896331520/t4294968673(0) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.198761:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+45:2397:x1870961896331520:12345-192.168.202.6@tcp:10:dd.0 Request processed in 113us (230us total) trans 4294968673 rc 0/0 00000100:00100000:0.0:1784290435.198782:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 377 00002000:00010000:0.0:1784290435.198785:0:24752:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/1908 (0->18446744073709551615) 00002000:00100000:0.0:1784290435.198788:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c247581f480 with x1870961896331520 ext(0->18446744073709551615) 00002000:00010000:0.0:1784290435.198793:0:24752:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c247581f480. 00000100:00100000:1.0:1784290435.199196:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.199262:0:68995:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896331776 00000100:00100000:0.0:1784290435.199268:0:68995:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896331776 00000100:00100000:0.0:1784290435.199297:0:68995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 279 00000100:00100000:0.0:1784290435.199302:0:68995:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+153:73479:x1870961896331776:12345-192.168.202.6@tcp:35:dd.0 00000100:00100000:0.0:1784290435.199466:0:68995:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+154:73479:x1870961896331776:12345-192.168.202.6@tcp:35:dd.0 Request processed in 163us (272us total) trans 120259084433 rc 0/0 00000100:00100000:0.0:1784290435.199472:0:68995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 279 00000100:00100000:2.0:1784290435.200249:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.200313:0:65992:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896332032 00000100:00100000:0.0:1784290435.200318:0:65992:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896332032 00000100:00100000:0.0:1784290435.200370:0:65992:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 280 00000100:00100000:0.0:1784290435.200381:0:65992:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ded8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+154:73480:x1870961896332032:12345-192.168.202.6@tcp:35:dd.0 00000100:00100000:0.0:1784290435.200485:0:65992:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ded8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+155:73480:x1870961896332032:12345-192.168.202.6@tcp:35:dd.0 Request processed in 107us (241us total) trans 120259084434 rc 0/0 00000100:00100000:0.0:1784290435.200491:0:65992:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 280 00000100:00100000:0.0:1784290435.589689:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.589690:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.589761:0:25104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896332160 00000100:00100000:1.0:1784290435.589763:0:26257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896332288 00000100:00100000:2.0:1784290435.589771:0:25104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896332160 00000100:00100000:1.0:1784290435.589772:0:26257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896332288 00002000:00100000:2.0:1784290435.589827:0:25104:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x762:0x0] (0->1023) req@ffff9c2475c7dc00 x1870961896332160/t0(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/0 e 0 to 0 dl 1784290446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290435.589835:0:26257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5020 00002000:00100000:2.0:1784290435.589847:0:25104:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2475c7dc00 with x1870961896332160 ext(0->1023) 00000100:00100000:1.0:1784290435.589853:0:26257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+46:2400:x1870961896332288:12345-192.168.202.6@tcp:16:kworker.0 00002000:00010000:2.0:1784290435.589856:0:25104:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2475c7dc00 00000100:00100000:2.0:1784290435.589893:0:25104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 378 00000100:00100000:2.0:1784290435.589909:0:25104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+46:2400:x1870961896332160:12345-192.168.202.6@tcp:4:dd.0 00000001:00080000:0.0:1784290435.590239:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968673 is committed 00010000:00000080:2.0:1784290435.590329:0:25104:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2475c7dc00 x1870961896332160/t4294968674(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00000080:1.0:1784290435.590413:0:26257:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2345c25880 x1870961896332288/t0(0) o16->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290435.590429:0:25104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+28:2400:x1870961896332160:12345-192.168.202.6@tcp:4:dd.0 Request processed in 526us (759us total) trans 4294968674 rc 0/0 00000100:00100000:2.0:1784290435.590441:0:25104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 378 00002000:00100000:2.0:1784290435.590449:0:25104:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x762:0x0] (0->1023) req@ffff9c2475c7dc00 x1870961896332160/t4294968674(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290435.590457:0:26257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+28:2400:x1870961896332288:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 609us (784us total) trans 0 rc 0/0 00002000:00100000:2.0:1784290435.590459:0:25104:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2475c7dc00 with x1870961896332160 ext(0->1023) 00002000:00010000:2.0:1784290435.590466:0:25104:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2475c7dc00 00000100:00100000:1.0:1784290435.590471:0:26257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5020 00000100:00100000:0.0:1784290435.591780:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.591813:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.591848:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896332416 00000100:00100000:0.0:1784290435.591859:0:26261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896332544 00000100:00100000:3.0:1784290435.591860:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896332416 00000100:00100000:0.0:1784290435.591866:0:26261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896332544 00002000:00100000:3.0:1784290435.591914:0:8409:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x763:0x0] (0->1023) req@ffff9c2345c27b80 x1870961896332416/t0(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/0 e 0 to 0 dl 1784290446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.591919:0:26261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5021 00002000:00100000:3.0:1784290435.591944:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345c27b80 with x1870961896332416 ext(0->1023) 00000100:00100000:0.0:1784290435.591948:0:26261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+28:2400:x1870961896332544:12345-192.168.202.6@tcp:16:kworker.0 00002000:00010000:3.0:1784290435.591953:0:8409:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2345c27b80 00000100:00100000:3.0:1784290435.591987:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 379 00000100:00100000:3.0:1784290435.592004:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+28:2400:x1870961896332416:12345-192.168.202.6@tcp:4:dd.0 00010000:00000080:0.0:1784290435.592022:0:26261:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2475c7fb80 x1870961896332544/t0(0) o16->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.592086:0:26261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+28:2400:x1870961896332544:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 155us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290435.592096:0:26261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5021 00000100:00100000:0.0:1784290435.593290:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.593316:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.593330:0:25100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896332672 00000100:00100000:0.0:1784290435.593335:0:25100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896332672 00000100:00100000:2.0:1784290435.593410:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896332800 00000100:00100000:2.0:1784290435.593419:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896332800 00002000:00100000:0.0:1784290435.593432:0:25100:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x764:0x0] (0->1023) req@ffff9c2345c25500 x1870961896332672/t0(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/0 e 0 to 0 dl 1784290446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784290435.593442:0:25100:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345c25500 with x1870961896332672 ext(0->1023) 00002000:00010000:0.0:1784290435.593447:0:25100:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2345c25500 00000100:00100000:0.0:1784290435.593479:0:25100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 380 00000100:00100000:2.0:1784290435.593500:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5022 00000100:00100000:0.0:1784290435.593500:0:25100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+29:2399:x1870961896332672:12345-192.168.202.6@tcp:4:dd.0 00000100:00100000:2.0:1784290435.593523:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+29:2400:x1870961896332800:12345-192.168.202.6@tcp:16:kworker.0 00010000:00000080:2.0:1784290435.593556:0:9000:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c245fe3b100 x1870961896332800/t0(0) o16->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290435.593591:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+29:2400:x1870961896332800:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 72us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290435.593596:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5022 00010000:00000080:3.0:1784290435.593825:0:8409:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2345c27b80 x1870961896332416/t4294968675(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290435.593872:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+32:2400:x1870961896332416:12345-192.168.202.6@tcp:4:dd.0 Request processed in 1877us (2094us total) trans 4294968675 rc 0/0 00000100:00100000:3.0:1784290435.593881:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 379 00002000:00100000:3.0:1784290435.593887:0:8409:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x763:0x0] (0->1023) req@ffff9c2345c27b80 x1870961896332416/t4294968675(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784290435.593895:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345c27b80 with x1870961896332416 ext(0->1023) 00002000:00010000:3.0:1784290435.593902:0:8409:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2345c27b80 00010000:00000080:0.0:1784290435.593904:0:25100:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2345c25500 x1870961896332672/t4294968676(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.593976:0:25100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+31:2399:x1870961896332672:12345-192.168.202.6@tcp:4:dd.0 Request processed in 486us (687us total) trans 4294968676 rc 0/0 00000100:00100000:0.0:1784290435.593992:0:25100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 380 00002000:00100000:0.0:1784290435.594001:0:25100:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x764:0x0] (0->1023) req@ffff9c2345c25500 x1870961896332672/t4294968676(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784290435.594013:0:25100:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345c25500 with x1870961896332672 ext(0->1023) 00002000:00010000:0.0:1784290435.594019:0:25100:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2345c25500 00000100:00100000:2.0:1784290435.594506:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.594551:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.594569:0:25102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896332928 00000100:00100000:0.0:1784290435.594583:0:25102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896332928 00000100:00100000:2.0:1784290435.594585:0:26255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896333056 00000100:00100000:2.0:1784290435.594590:0:26255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896333056 00002000:00100000:0.0:1784290435.594615:0:25102:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x765:0x0] (0->1023) req@ffff9c245fe38380 x1870961896332928/t0(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/0 e 0 to 0 dl 1784290446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290435.594628:0:26255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5023 00002000:00100000:0.0:1784290435.594629:0:25102:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c245fe38380 with x1870961896332928 ext(0->1023) 00002000:00010000:0.0:1784290435.594638:0:25102:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c245fe38380 00000100:00100000:2.0:1784290435.594643:0:26255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+32:2397:x1870961896333056:12345-192.168.202.6@tcp:16:kworker.0 00010000:00000080:2.0:1784290435.594675:0:26255:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c24483caa00 x1870961896333056/t0(0) o16->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.594686:0:25102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 381 00000100:00100000:0.0:1784290435.594704:0:25102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+32:2397:x1870961896332928:12345-192.168.202.6@tcp:4:dd.0 00000100:00100000:2.0:1784290435.594735:0:26255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+32:2397:x1870961896333056:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 95us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290435.594745:0:26255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5023 00010000:00000080:0.0:1784290435.594923:0:25102:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c245fe38380 x1870961896332928/t4294968677(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.594990:0:25102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+33:2397:x1870961896332928:12345-192.168.202.6@tcp:4:dd.0 Request processed in 290us (485us total) trans 4294968677 rc 0/0 00000100:00100000:0.0:1784290435.594999:0:25102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 381 00002000:00100000:0.0:1784290435.595008:0:25102:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x765:0x0] (0->1023) req@ffff9c245fe38380 x1870961896332928/t4294968677(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784290435.595018:0:25102:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c245fe38380 with x1870961896332928 ext(0->1023) 00002000:00010000:0.0:1784290435.595022:0:25102:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c245fe38380 00000100:00100000:3.0:1784290435.595760:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.595767:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.595815:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896333184 00000100:00100000:0.0:1784290435.595822:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896333184 00000100:00100000:1.0:1784290435.595828:0:26263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896333312 00000100:00100000:1.0:1784290435.595834:0:26263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896333312 00002000:00100000:0.0:1784290435.595850:0:24752:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x766:0x0] (0->1023) req@ffff9c24483cb100 x1870961896333184/t0(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/0 e 0 to 0 dl 1784290446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784290435.595863:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c24483cb100 with x1870961896333184 ext(0->1023) 00002000:00010000:0.0:1784290435.595868:0:24752:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c24483cb100 00000100:00100000:1.0:1784290435.595875:0:26263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5024 00000100:00100000:1.0:1784290435.595891:0:26263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c245fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+34:2400:x1870961896333312:12345-192.168.202.6@tcp:16:kworker.0 00000100:00100000:0.0:1784290435.595912:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 382 00010000:00000080:1.0:1784290435.595923:0:26263:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c245fe3ad80 x1870961896333312/t0(0) o16->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.595946:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+34:2399:x1870961896333184:12345-192.168.202.6@tcp:4:dd.0 00000100:00100000:1.0:1784290435.595986:0:26263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c245fe3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+34:2400:x1870961896333312:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 101us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290435.596002:0:26263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5024 00010000:00000080:0.0:1784290435.596205:0:24752:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c24483cb100 x1870961896333184/t4294968678(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.596253:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+35:2399:x1870961896333184:12345-192.168.202.6@tcp:4:dd.0 Request processed in 330us (499us total) trans 4294968678 rc 0/0 00000100:00100000:0.0:1784290435.596263:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 382 00002000:00100000:0.0:1784290435.596272:0:24752:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x766:0x0] (0->1023) req@ffff9c24483cb100 x1870961896333184/t4294968678(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784290435.596282:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c24483cb100 with x1870961896333184 ext(0->1023) 00002000:00010000:0.0:1784290435.596287:0:24752:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c24483cb100 00000100:00100000:0.0:1784290435.597077:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.597104:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290435.597144:0:25104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896333440 00000100:00100000:0.0:1784290435.597148:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896333568 00000100:00100000:1.0:1784290435.597152:0:25104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896333440 00000100:00100000:0.0:1784290435.597155:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896333568 00002000:00100000:1.0:1784290435.597184:0:25104:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x767:0x0] (0->1023) req@ffff9c2345c27480 x1870961896333440/t0(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/0 e 0 to 0 dl 1784290446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784290435.597196:0:25104:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345c27480 with x1870961896333440 ext(0->1023) 00000100:00100000:0.0:1784290435.597203:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5025 00002000:00010000:1.0:1784290435.597205:0:25104:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2345c27480 00000100:00100000:0.0:1784290435.597220:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+36:2398:x1870961896333568:12345-192.168.202.6@tcp:16:kworker.0 00000100:00100000:1.0:1784290435.597239:0:25104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 383 00010000:00000080:0.0:1784290435.597251:0:8403:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c24483c8a80 x1870961896333568/t0(0) o16->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290435.597253:0:25104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+36:2397:x1870961896333440:12345-192.168.202.6@tcp:4:dd.0 00000100:00100000:0.0:1784290435.597305:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+36:2398:x1870961896333568:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 89us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290435.597316:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5025 00010000:00000080:1.0:1784290435.597546:0:25104:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2345c27480 x1870961896333440/t4294968679(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290435.597590:0:25104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+37:2397:x1870961896333440:12345-192.168.202.6@tcp:4:dd.0 Request processed in 341us (516us total) trans 4294968679 rc 0/0 00000100:00100000:1.0:1784290435.597603:0:25104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 383 00002000:00100000:1.0:1784290435.597611:0:25104:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x767:0x0] (0->1023) req@ffff9c2345c27480 x1870961896333440/t4294968679(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784290435.597620:0:25104:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345c27480 with x1870961896333440 ext(0->1023) 00002000:00010000:1.0:1784290435.597624:0:25104:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2345c27480 00000100:00100000:3.0:1784290435.598317:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.598397:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290435.598434:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896333824 00000100:00100000:1.0:1784290435.598440:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896333824 00000100:00100000:1.0:1784290435.598483:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5026 00000100:00100000:1.0:1784290435.598493:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+37:2398:x1870961896333824:12345-192.168.202.6@tcp:16:kworker.0 00010000:00000080:1.0:1784290435.598521:0:26250:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c246dee5180 x1870961896333824/t0(0) o16->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290435.598552:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+37:2398:x1870961896333824:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 63us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290435.598557:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5026 00000100:00100000:1.0:1784290435.598580:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896333696 00000100:00100000:1.0:1784290435.598583:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896333696 00002000:00100000:1.0:1784290435.598600:0:8409:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x768:0x0] (0->1023) req@ffff9c246d95e300 x1870961896333696/t0(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/0 e 0 to 0 dl 1784290446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784290435.598610:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c246d95e300 with x1870961896333696 ext(0->1023) 00002000:00010000:1.0:1784290435.598614:0:8409:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c246d95e300 00000100:00100000:1.0:1784290435.598643:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 384 00000100:00100000:1.0:1784290435.598654:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+37:2397:x1870961896333696:12345-192.168.202.6@tcp:4:dd.0 00010000:00000080:1.0:1784290435.598841:0:8409:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c246d95e300 x1870961896333696/t4294968680(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290435.598880:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+39:2397:x1870961896333696:12345-192.168.202.6@tcp:4:dd.0 Request processed in 230us (568us total) trans 4294968680 rc 0/0 00000100:00100000:1.0:1784290435.598893:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 384 00002000:00100000:1.0:1784290435.598901:0:8409:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x768:0x0] (0->1023) req@ffff9c246d95e300 x1870961896333696/t4294968680(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784290435.598910:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c246d95e300 with x1870961896333696 ext(0->1023) 00002000:00010000:1.0:1784290435.598914:0:8409:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c246d95e300 00000100:00100000:1.0:1784290435.599473:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.599480:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.599526:0:25100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896333952 00000100:00100000:2.0:1784290435.599534:0:25100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896333952 00000100:00100000:0.0:1784290435.599534:0:26253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896334080 00000100:00100000:0.0:1784290435.599541:0:26253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896334080 00002000:00100000:2.0:1784290435.599569:0:25100:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x769:0x0] (0->1023) req@ffff9c24483cd880 x1870961896333952/t0(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/0 e 0 to 0 dl 1784290446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784290435.599579:0:25100:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c24483cd880 with x1870961896333952 ext(0->1023) 00000100:00100000:0.0:1784290435.599579:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5027 00002000:00010000:2.0:1784290435.599586:0:25100:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c24483cd880 00000100:00100000:0.0:1784290435.599590:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345b77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+40:2398:x1870961896334080:12345-192.168.202.6@tcp:16:kworker.0 00000100:00100000:2.0:1784290435.599614:0:25100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 385 00010000:00000080:0.0:1784290435.599622:0:26253:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2345b77480 x1870961896334080/t0(0) o16->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290435.599626:0:25100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+40:2397:x1870961896333952:12345-192.168.202.6@tcp:4:dd.0 00000100:00100000:0.0:1784290435.599664:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345b77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+40:2398:x1870961896334080:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 76us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290435.599670:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5027 00010000:00000080:2.0:1784290435.599786:0:25100:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c24483cd880 x1870961896333952/t4294968681(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290435.599824:0:25100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+41:2397:x1870961896333952:12345-192.168.202.6@tcp:4:dd.0 Request processed in 204us (355us total) trans 4294968681 rc 0/0 00000100:00100000:2.0:1784290435.599830:0:25100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 385 00002000:00100000:2.0:1784290435.599835:0:25100:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x769:0x0] (0->1023) req@ffff9c24483cd880 x1870961896333952/t4294968681(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784290435.599841:0:25100:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c24483cd880 with x1870961896333952 ext(0->1023) 00002000:00010000:2.0:1784290435.599844:0:25100:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c24483cd880 00000100:00100000:3.0:1784290435.600658:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.600687:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.600711:0:25102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896334208 00000100:00100000:2.0:1784290435.600718:0:25102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896334208 00000100:00100000:3.0:1784290435.600732:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896334336 00000100:00100000:3.0:1784290435.600741:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896334336 00002000:00100000:2.0:1784290435.600747:0:25102:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x76a:0x0] (0->1023) req@ffff9c246d95ea00 x1870961896334208/t0(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/0 e 0 to 0 dl 1784290446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784290435.600761:0:25102:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c246d95ea00 with x1870961896334208 ext(0->1023) 00002000:00010000:2.0:1784290435.600765:0:25102:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c246d95ea00 00000100:00100000:3.0:1784290435.600793:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5028 00000100:00100000:2.0:1784290435.600797:0:25102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 386 00000100:00100000:3.0:1784290435.600812:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+42:2398:x1870961896334336:12345-192.168.202.6@tcp:16:kworker.0 00000100:00100000:2.0:1784290435.600817:0:25102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246d95ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+42:2397:x1870961896334208:12345-192.168.202.6@tcp:4:dd.0 00010000:00000080:3.0:1784290435.600858:0:26258:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2345b74a80 x1870961896334336/t0(0) o16->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290435.600897:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+42:2398:x1870961896334336:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 89us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290435.600903:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5028 00010000:00000080:2.0:1784290435.601008:0:25102:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c246d95ea00 x1870961896334208/t4294968682(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290435.601044:0:25102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246d95ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+43:2397:x1870961896334208:12345-192.168.202.6@tcp:4:dd.0 Request processed in 234us (391us total) trans 4294968682 rc 0/0 00000100:00100000:2.0:1784290435.601050:0:25102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 386 00002000:00100000:2.0:1784290435.601055:0:25102:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x76a:0x0] (0->1023) req@ffff9c246d95ea00 x1870961896334208/t4294968682(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784290435.601061:0:25102:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c246d95ea00 with x1870961896334208 ext(0->1023) 00002000:00010000:2.0:1784290435.601064:0:25102:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c246d95ea00 00000100:00100000:3.0:1784290435.601989:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.601991:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.602040:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896334592 00000100:00100000:2.0:1784290435.602046:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896334592 00000100:00100000:2.0:1784290435.602080:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5029 00000100:00100000:2.0:1784290435.602091:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+43:2400:x1870961896334592:12345-192.168.202.6@tcp:16:kworker.0 00010000:00000080:2.0:1784290435.602119:0:26252:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c247581ad80 x1870961896334592/t0(0) o16->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290435.602158:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+43:2400:x1870961896334592:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 70us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290435.602164:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5029 00000100:00100000:2.0:1784290435.602194:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896334464 00000100:00100000:2.0:1784290435.602206:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896334464 00002000:00100000:2.0:1784290435.602232:0:24752:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x76b:0x0] (0->1023) req@ffff9c2467deea00 x1870961896334464/t0(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/0 e 0 to 0 dl 1784290446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784290435.602241:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2467deea00 with x1870961896334464 ext(0->1023) 00002000:00010000:2.0:1784290435.602246:0:24752:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2467deea00 00000100:00100000:2.0:1784290435.602274:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 387 00000100:00100000:2.0:1784290435.602283:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2467deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+43:2399:x1870961896334464:12345-192.168.202.6@tcp:4:dd.0 00010000:00000080:2.0:1784290435.602578:0:24752:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2467deea00 x1870961896334464/t4294968683(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290435.602610:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2467deea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+45:2399:x1870961896334464:12345-192.168.202.6@tcp:4:dd.0 Request processed in 330us (650us total) trans 4294968683 rc 0/0 00000100:00100000:2.0:1784290435.602616:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 387 00002000:00100000:2.0:1784290435.602621:0:24752:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x76b:0x0] (0->1023) req@ffff9c2467deea00 x1870961896334464/t4294968683(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784290435.602627:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2467deea00 with x1870961896334464 ext(0->1023) 00002000:00010000:2.0:1784290435.602630:0:24752:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2467deea00 00000100:00100000:3.0:1784290435.603174:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.603174:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.603275:0:26257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896334848 00000100:00100000:0.0:1784290435.603281:0:26257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896334848 00000100:00100000:0.0:1784290435.603311:0:26257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5030 00000100:00100000:0.0:1784290435.603317:0:26257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+45:2398:x1870961896334848:12345-192.168.202.6@tcp:16:kworker.0 00010000:00000080:0.0:1784290435.603367:0:26257:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2447cc9180 x1870961896334848/t0(0) o16->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290435.603395:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896334720 00000100:00100000:2.0:1784290435.603400:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896334720 00000100:00100000:0.0:1784290435.603405:0:26257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+45:2398:x1870961896334848:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 86us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290435.603416:0:26257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5030 00002000:00100000:2.0:1784290435.603427:0:8408:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x76c:0x0] (0->1023) req@ffff9c2345cfca80 x1870961896334720/t0(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/0 e 0 to 0 dl 1784290446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784290435.603434:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345cfca80 with x1870961896334720 ext(0->1023) 00002000:00010000:2.0:1784290435.603437:0:8408:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2345cfca80 00000100:00100000:2.0:1784290435.603457:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 388 00000100:00100000:2.0:1784290435.603464:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+45:2397:x1870961896334720:12345-192.168.202.6@tcp:4:dd.0 00010000:00000080:2.0:1784290435.603595:0:8408:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2345cfca80 x1870961896334720/t4294968684(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290435.603624:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+47:2397:x1870961896334720:12345-192.168.202.6@tcp:4:dd.0 Request processed in 161us (460us total) trans 4294968684 rc 0/0 00000100:00100000:2.0:1784290435.603631:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 388 00002000:00100000:2.0:1784290435.603638:0:8408:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x76c:0x0] (0->1023) req@ffff9c2345cfca80 x1870961896334720/t4294968684(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784290435.603643:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2345cfca80 with x1870961896334720 ext(0->1023) 00002000:00010000:2.0:1784290435.603646:0:8408:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2345cfca80 00000100:00100000:2.0:1784290435.604475:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.604520:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.604552:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896334976 00000100:00100000:3.0:1784290435.604559:0:26261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896335104 00000100:00100000:0.0:1784290435.604562:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896334976 00000100:00100000:3.0:1784290435.604568:0:26261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896335104 00002000:00100000:0.0:1784290435.604585:0:8409:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x76d:0x0] (0->1023) req@ffff9c247f974700 x1870961896334976/t0(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/0 e 0 to 0 dl 1784290446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784290435.604594:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c247f974700 with x1870961896334976 ext(0->1023) 00002000:00010000:0.0:1784290435.604598:0:8409:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c247f974700 00000100:00100000:3.0:1784290435.604622:0:26261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5031 00000100:00100000:0.0:1784290435.604623:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 389 00000100:00100000:0.0:1784290435.604637:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+48:2400:x1870961896334976:12345-192.168.202.6@tcp:4:dd.0 00000100:00100000:3.0:1784290435.604647:0:26261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+48:2399:x1870961896335104:12345-192.168.202.6@tcp:16:kworker.0 00010000:00000080:3.0:1784290435.604684:0:26261:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2345cfd180 x1870961896335104/t0(0) o16->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290435.604738:0:26261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+48:2399:x1870961896335104:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 99us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290435.604748:0:26261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5031 00010000:00000080:0.0:1784290435.604843:0:8409:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c247f974700 x1870961896334976/t4294968685(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.604883:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+49:2400:x1870961896334976:12345-192.168.202.6@tcp:4:dd.0 Request processed in 248us (365us total) trans 4294968685 rc 0/0 00000100:00100000:0.0:1784290435.604890:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 389 00002000:00100000:0.0:1784290435.604896:0:8409:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x76d:0x0] (0->1023) req@ffff9c247f974700 x1870961896334976/t4294968685(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784290435.604903:0:8409:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c247f974700 with x1870961896334976 ext(0->1023) 00002000:00010000:0.0:1784290435.604906:0:8409:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c247f974700 00000100:00100000:2.0:1784290435.605794:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.605842:0:25097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896335232 00000100:00100000:2.0:1784290435.605847:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.605848:0:25097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896335232 00002000:00100000:0.0:1784290435.605871:0:25097:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x76e:0x0] (0->1023) req@ffff9c246dfd2680 x1870961896335232/t0(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/0 e 0 to 0 dl 1784290446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784290435.605877:0:25097:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c246dfd2680 with x1870961896335232 ext(0->1023) 00002000:00010000:0.0:1784290435.605880:0:25097:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c246dfd2680 00000100:00100000:3.0:1784290435.605881:0:26260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896335360 00000100:00100000:3.0:1784290435.605889:0:26260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896335360 00000100:00100000:0.0:1784290435.605907:0:25097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 390 00000100:00100000:0.0:1784290435.605918:0:25097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dfd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+50:2397:x1870961896335232:12345-192.168.202.6@tcp:4:dd.0 00000100:00100000:3.0:1784290435.605967:0:26260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5032 00000100:00100000:3.0:1784290435.605981:0:26260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+50:2398:x1870961896335360:12345-192.168.202.6@tcp:16:kworker.0 00010000:00000080:3.0:1784290435.606017:0:26260:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c246a540e00 x1870961896335360/t0(0) o16->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290435.606079:0:26260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+50:2398:x1870961896335360:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 99us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290435.606091:0:26260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5032 00010000:00000080:0.0:1784290435.606111:0:25097:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c246dfd2680 x1870961896335232/t4294968686(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.606141:0:25097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dfd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+51:2397:x1870961896335232:12345-192.168.202.6@tcp:4:dd.0 Request processed in 227us (347us total) trans 4294968686 rc 0/0 00000100:00100000:0.0:1784290435.606148:0:25097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 390 00002000:00100000:0.0:1784290435.606154:0:25097:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x76e:0x0] (0->1023) req@ffff9c246dfd2680 x1870961896335232/t4294968686(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784290435.606170:0:25097:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c246dfd2680 with x1870961896335232 ext(0->1023) 00002000:00010000:0.0:1784290435.606173:0:25097:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c246dfd2680 00000100:00100000:2.0:1784290435.607090:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290435.607138:0:26255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896335616 00000100:00100000:2.0:1784290435.607143:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290435.607145:0:26255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896335616 00000100:00100000:1.0:1784290435.607184:0:26255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5033 00000100:00100000:1.0:1784290435.607190:0:26255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+51:2399:x1870961896335616:12345-192.168.202.6@tcp:16:kworker.0 00000100:00100000:3.0:1784290435.607217:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896335488 00010000:00000080:1.0:1784290435.607221:0:26255:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c246a543480 x1870961896335616/t0(0) o16->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290435.607224:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896335488 00002000:00100000:3.0:1784290435.607261:0:8407:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x76f:0x0] (0->1023) req@ffff9c24483d3480 x1870961896335488/t0(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/0 e 0 to 0 dl 1784290446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290435.607274:0:26255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+52:2399:x1870961896335616:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 79us (180us total) trans 0 rc 0/0 00002000:00100000:3.0:1784290435.607276:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c24483d3480 with x1870961896335488 ext(0->1023) 00002000:00010000:3.0:1784290435.607284:0:8407:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c24483d3480 00000100:00100000:1.0:1784290435.607293:0:26255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5033 00000100:00100000:3.0:1784290435.607318:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 391 00000100:00100000:3.0:1784290435.607327:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+51:2399:x1870961896335488:12345-192.168.202.6@tcp:4:dd.0 00010000:00000080:3.0:1784290435.607601:0:8407:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c24483d3480 x1870961896335488/t4294968687(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290435.607638:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+53:2399:x1870961896335488:12345-192.168.202.6@tcp:4:dd.0 Request processed in 314us (497us total) trans 4294968687 rc 0/0 00000100:00100000:3.0:1784290435.607645:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 391 00002000:00100000:3.0:1784290435.607651:0:8407:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x76f:0x0] (0->1023) req@ffff9c24483d3480 x1870961896335488/t4294968687(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784290435.607658:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c24483d3480 with x1870961896335488 ext(0->1023) 00002000:00010000:3.0:1784290435.607661:0:8407:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c24483d3480 00000100:00100000:2.0:1784290435.608146:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.608187:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896335744 00000100:00100000:0.0:1784290435.608192:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896335744 00002000:00100000:0.0:1784290435.608213:0:24752:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x770:0x0] (0->1023) req@ffff9c24483d1f80 x1870961896335744/t0(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/0 e 0 to 0 dl 1784290446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784290435.608219:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c24483d1f80 with x1870961896335744 ext(0->1023) 00002000:00010000:0.0:1784290435.608222:0:24752:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c24483d1f80 00000100:00100000:0.0:1784290435.608250:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 392 00000100:00100000:0.0:1784290435.608261:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+53:2400:x1870961896335744:12345-192.168.202.6@tcp:4:dd.0 00000100:00100000:2.0:1784290435.608276:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290435.608331:0:26263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896335872 00000100:00100000:1.0:1784290435.608338:0:26263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896335872 00000100:00100000:1.0:1784290435.608417:0:26263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5034 00000100:00100000:1.0:1784290435.608429:0:26263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+54:2399:x1870961896335872:12345-192.168.202.6@tcp:16:kworker.0 00010000:00000080:1.0:1784290435.608452:0:26263:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2468792680 x1870961896335872/t0(0) o16->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290435.608491:0:26263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+56:2399:x1870961896335872:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 64us (215us total) trans 0 rc 0/0 00010000:00000080:0.0:1784290435.608495:0:24752:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c24483d1f80 x1870961896335744/t4294968688(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290435.608507:0:26263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5034 00000100:00100000:0.0:1784290435.608541:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+55:2400:x1870961896335744:12345-192.168.202.6@tcp:4:dd.0 Request processed in 281us (393us total) trans 4294968688 rc 0/0 00000100:00100000:0.0:1784290435.608558:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 392 00002000:00100000:0.0:1784290435.608568:0:24752:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x770:0x0] (0->1023) req@ffff9c24483d1f80 x1870961896335744/t4294968688(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784290435.608577:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c24483d1f80 with x1870961896335744 ext(0->1023) 00002000:00010000:0.0:1784290435.608582:0:24752:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c24483d1f80 00000100:00100000:2.0:1784290435.609512:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.609563:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290435.609565:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896336000 00000100:00100000:1.0:1784290435.609571:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896336000 00002000:00100000:1.0:1784290435.609598:0:8408:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x771:0x0] (0->1023) req@ffff9c2468790380 x1870961896336000/t0(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/0 e 0 to 0 dl 1784290446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784290435.609609:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2468790380 with x1870961896336000 ext(0->1023) 00002000:00010000:1.0:1784290435.609615:0:8408:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2468790380 00000100:00100000:0.0:1784290435.609625:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896336128 00000100:00100000:0.0:1784290435.609632:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896336128 00000100:00100000:1.0:1784290435.609655:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 393 00000100:00100000:0.0:1784290435.609680:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5035 00000100:00100000:1.0:1784290435.609681:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+56:2398:x1870961896336000:12345-192.168.202.6@tcp:4:dd.0 00000100:00100000:0.0:1784290435.609701:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+56:2397:x1870961896336128:12345-192.168.202.6@tcp:16:kworker.0 00010000:00000080:0.0:1784290435.609739:0:8403:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2447cca680 x1870961896336128/t0(0) o16->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.609784:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+56:2397:x1870961896336128:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 91us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290435.609794:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5035 00010000:00000080:1.0:1784290435.609867:0:8408:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2468790380 x1870961896336000/t4294968689(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290435.609903:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+57:2398:x1870961896336000:12345-192.168.202.6@tcp:4:dd.0 Request processed in 239us (391us total) trans 4294968689 rc 0/0 00000100:00100000:1.0:1784290435.609913:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 393 00002000:00100000:1.0:1784290435.609922:0:8408:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x771:0x0] (0->1023) req@ffff9c2468790380 x1870961896336000/t4294968689(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784290435.609945:0:8408:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2468790380 with x1870961896336000 ext(0->1023) 00002000:00010000:1.0:1784290435.609950:0:8408:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2468790380 00000100:00100000:2.0:1784290435.610971:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.610976:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290435.611021:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896336384 00000100:00100000:1.0:1784290435.611026:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896336384 00000100:00100000:0.0:1784290435.611032:0:25100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896336256 00000100:00100000:0.0:1784290435.611040:0:25100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896336256 00000100:00100000:1.0:1784290435.611056:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5036 00002000:00100000:0.0:1784290435.611068:0:25100:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x772:0x0] (0->1023) req@ffff9c2447cc8a80 x1870961896336256/t0(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/0 e 0 to 0 dl 1784290446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290435.611069:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+58:2399:x1870961896336384:12345-192.168.202.6@tcp:16:kworker.0 00002000:00100000:0.0:1784290435.611085:0:25100:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2447cc8a80 with x1870961896336256 ext(0->1023) 00002000:00010000:0.0:1784290435.611089:0:25100:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2447cc8a80 00010000:00000080:1.0:1784290435.611097:0:26250:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2468791c00 x1870961896336384/t0(0) o16->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.611115:0:25100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 394 00000100:00100000:0.0:1784290435.611125:0:25100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+58:2400:x1870961896336256:12345-192.168.202.6@tcp:4:dd.0 00000100:00100000:1.0:1784290435.611154:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+58:2399:x1870961896336384:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 85us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290435.611168:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5036 00010000:00000080:0.0:1784290435.611269:0:25100:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2447cc8a80 x1870961896336256/t4294968690(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.611304:0:25100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+59:2400:x1870961896336256:12345-192.168.202.6@tcp:4:dd.0 Request processed in 182us (353us total) trans 4294968690 rc 0/0 00000100:00100000:0.0:1784290435.611310:0:25100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 394 00002000:00100000:0.0:1784290435.611315:0:25100:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x772:0x0] (0->1023) req@ffff9c2447cc8a80 x1870961896336256/t4294968690(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784290435.611321:0:25100:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2447cc8a80 with x1870961896336256 ext(0->1023) 00002000:00010000:0.0:1784290435.611325:0:25100:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2447cc8a80 00000100:00100000:2.0:1784290435.612165:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290435.612210:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.612212:0:25097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896336512 00000100:00100000:0.0:1784290435.612217:0:25097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896336512 00002000:00100000:0.0:1784290435.612243:0:25097:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x773:0x0] (0->1023) req@ffff9c2446e55500 x1870961896336512/t0(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/0 e 0 to 0 dl 1784290446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784290435.612249:0:25097:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2446e55500 with x1870961896336512 ext(0->1023) 00002000:00010000:0.0:1784290435.612252:0:25097:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2446e55500 00000100:00100000:0.0:1784290435.612273:0:25097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 395 00000100:00100000:1.0:1784290435.612280:0:26253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896336640 00000100:00100000:0.0:1784290435.612280:0:25097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+59:2398:x1870961896336512:12345-192.168.202.6@tcp:4:dd.0 00000100:00100000:1.0:1784290435.612288:0:26253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896336640 00000100:00100000:1.0:1784290435.612327:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5037 00000100:00100000:1.0:1784290435.612334:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+60:2398:x1870961896336640:12345-192.168.202.6@tcp:16:kworker.0 00010000:00000080:1.0:1784290435.612404:0:26253:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2447cc8000 x1870961896336640/t0(0) o16->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290435.612440:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+62:2398:x1870961896336640:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 108us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290435.612447:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5037 00010000:00000080:0.0:1784290435.612464:0:25097:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2446e55500 x1870961896336512/t4294968691(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.612500:0:25097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+61:2398:x1870961896336512:12345-192.168.202.6@tcp:4:dd.0 Request processed in 220us (336us total) trans 4294968691 rc 0/0 00000100:00100000:0.0:1784290435.612506:0:25097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 395 00002000:00100000:0.0:1784290435.612513:0:25097:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x773:0x0] (0->1023) req@ffff9c2446e55500 x1870961896336512/t4294968691(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784290435.612519:0:25097:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2446e55500 with x1870961896336512 ext(0->1023) 00002000:00010000:0.0:1784290435.612522:0:25097:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2446e55500 00000100:00100000:3.0:1784290435.613437:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.613440:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.613493:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896336768 00000100:00100000:0.0:1784290435.613499:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896336768 00000100:00100000:1.0:1784290435.613503:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896336896 00000100:00100000:1.0:1784290435.613510:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896336896 00002000:00100000:0.0:1784290435.613520:0:8407:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x774:0x0] (0->1023) req@ffff9c2446e57b80 x1870961896336768/t0(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/0 e 0 to 0 dl 1784290446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784290435.613531:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2446e57b80 with x1870961896336768 ext(0->1023) 00002000:00010000:0.0:1784290435.613535:0:8407:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2446e57b80 00000100:00100000:1.0:1784290435.613554:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5038 00000100:00100000:0.0:1784290435.613576:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 396 00000100:00100000:1.0:1784290435.613577:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+62:2399:x1870961896336896:12345-192.168.202.6@tcp:16:kworker.0 00000100:00100000:0.0:1784290435.613597:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2446e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+62:2399:x1870961896336768:12345-192.168.202.6@tcp:4:dd.0 00010000:00000080:1.0:1784290435.613611:0:26258:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2447cca300 x1870961896336896/t0(0) o16->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290435.613657:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+62:2399:x1870961896336896:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 92us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290435.613667:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5038 00010000:00000080:0.0:1784290435.613763:0:8407:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2446e57b80 x1870961896336768/t4294968692(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.613800:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2446e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+63:2399:x1870961896336768:12345-192.168.202.6@tcp:4:dd.0 Request processed in 212us (369us total) trans 4294968692 rc 0/0 00000100:00100000:0.0:1784290435.613806:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 396 00002000:00100000:0.0:1784290435.613812:0:8407:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x774:0x0] (0->1023) req@ffff9c2446e57b80 x1870961896336768/t4294968692(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784290435.613821:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2446e57b80 with x1870961896336768 ext(0->1023) 00002000:00010000:0.0:1784290435.613825:0:8407:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2446e57b80 00000100:00100000:3.0:1784290435.614827:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290435.614863:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290435.614893:0:24752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896337024 00000100:00100000:0.0:1784290435.614901:0:24752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896337024 00000100:00100000:3.0:1784290435.614902:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896337152 00000100:00100000:3.0:1784290435.614909:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896337152 00002000:00100000:0.0:1784290435.614948:0:24752:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x775:0x0] (0->1023) req@ffff9c2447ccb800 x1870961896337024/t0(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/0 e 0 to 0 dl 1784290446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784290435.614955:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2447ccb800 with x1870961896337024 ext(0->1023) 00000100:00100000:3.0:1784290435.614960:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5039 00002000:00010000:0.0:1784290435.614960:0:24752:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2447ccb800 00000100:00100000:3.0:1784290435.614981:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+64:2400:x1870961896337152:12345-192.168.202.6@tcp:16:kworker.0 00000100:00100000:0.0:1784290435.614996:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 397 00000100:00100000:0.0:1784290435.615004:0:24752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+64:2399:x1870961896337024:12345-192.168.202.6@tcp:4:dd.0 00010000:00000080:3.0:1784290435.615015:0:26252:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2474e8c700 x1870961896337152/t0(0) o16->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 440/432 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290435.615054:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+64:2400:x1870961896337152:12345-192.168.202.6@tcp:16:kworker.0 Request processed in 78us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290435.615062:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5039 00010000:00000080:0.0:1784290435.615168:0:24752:0:(ldlm_lib.c:3302:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9c2447ccb800 x1870961896337024/t4294968693(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290435.615203:0:24752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+65:2399:x1870961896337024:12345-192.168.202.6@tcp:4:dd.0 Request processed in 202us (379us total) trans 4294968693 rc 0/0 00000100:00100000:0.0:1784290435.615209:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 397 00002000:00100000:0.0:1784290435.615214:0:24752:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x775:0x0] (0->1023) req@ffff9c2447ccb800 x1870961896337024/t4294968693(0) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:456/0 lens 1512/448 e 0 to 0 dl 1784290446 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784290435.615220:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9c2447ccb800 with x1870961896337024 ext(0->1023) 00002000:00010000:0.0:1784290435.615229:0:24752:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c2447ccb800 00010000:00010000:0.0:1784290435.751548:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784290435.820598:0:95684:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1784290435.820649:0:95684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b9c00/0x5953bbf6b3075821 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075828 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.820661:0:95684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b9c00/0x5953bbf6b3075821 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075828 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.820667:0:95684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b9c00/0x5953bbf6b3075821 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3075828 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.820672:0:95684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c24414b9c00/0x5953bbf6b3075821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3075828 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.820688:0:95684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784290435.820693:0:95684:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1784290435.820697:0:8418:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784290435.820706:0:8418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c24414b9c00/0x5953bbf6b3075821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3075828 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.820714:0:8418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b9c00 already unused, calling callback (ffffffffc14a9c20) 00000100:00080000:0.0:1784290435.820714:0:95684:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784290435.820720:0:95684:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 10000000:00010000:1.0:1784290435.820721:0:8418:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c24414b9c00/0x5953bbf6b3075821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3075828 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784290435.820727:0:95684:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1784290435.820731:0:8418:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c24414b9c00/0x5953bbf6b3075821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3075828 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290435.820738:0:8418:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c24414b9c00/0x5953bbf6b3075821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3075828 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290435.820748:0:8418:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784290435.820750:0:8418:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00080000:0.0:1784290435.820750:0:95684:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:1.0:1784290435.820755:0:8418:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1784290435.820780:0:8418:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c24414b9c00/0x5953bbf6b3075821 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3075828 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.820786:0:8418:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784290435.820811:0:8418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c24414b9c00/0x5953bbf6b3075821 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3075828 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.820816:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a51b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901184640:0@lo:39:umount.0 00010000:00010000:1.0:1784290435.820818:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c24414b9c00/0x5953bbf6b3075821 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3075828 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290435.820830:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1784290435.820860:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290435.820862:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290435.820865:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784290435.820869:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901184768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784290435.820962:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290435.820970:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290435.821032:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901184768 00000100:00100000:2.0:1784290435.821034:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901184640 00000100:00100000:1.0:1784290435.821039:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901184768 00000100:00100000:2.0:1784290435.821041:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901184640 00000100:00080000:0.0:1784290435.821080:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784290435.821102:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:2.0:1784290435.821118:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:1.0:1784290435.821124:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3618:x1870961901184768:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290435.821132:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1870961901184640:12345-0@lo:39:umount.0 00010000:00010000:1.0:1784290435.821142:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:2.0:1784290435.821161:0:74876:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307544d 00010000:00010000:1.0:1784290435.821162:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c234236d000/0x5953bbf6b3075828 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3075821 expref: 24 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.821179:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1784290435.821181:0:74876:0:(import.c:65:import_set_state_nolock()) ffff9c2345299800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1784290435.821212:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290435.821243:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3618:x1870961901184768:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290435.821256:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:2.0:1784290435.821265:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+1:3616:x1870961901184640:12345-0@lo:39:umount.0 Request processed in 135us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290435.821272:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000020:00000080:2.0:1784290435.821280:0:74876:0:(genops.c:906:class_export_put()) final put ffff9c234529d800/lustre-MDT0000-lwp-OST0000_UUID 00000100:00100000:3.0:1784290435.821287:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901184768:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1784290435.821316:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c234529d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1784290435.821396:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784290435.821415:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a51b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901184640:0@lo:39:umount.0 00000100:00080000:2.0:1784290435.821440:0:95684:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784290435.821444:0:95684:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784290435.821448:0:95684:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784290435.821459:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2345299800 for lustre-MDT0000 00000100:00080000:2.0:1784290435.822141:0:95684:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1784290435.822143:0:95684:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784290435.822146:0:95684:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1784290435.822155:0:95684:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1784290435.822212:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1870961901184896:0@lo:39:umount.0 00000100:00100000:3.0:1784290435.822240:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290435.822275:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901184896 00000100:00100000:2.0:1784290435.822280:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901184896 00000100:00100000:2.0:1784290435.822315:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:2.0:1784290435.822320:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1870961901184896:12345-0@lo:39:umount.0 00000020:00000080:2.0:1784290435.822332:0:65988:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b306f238 00000100:00080000:2.0:1784290435.822338:0:65988:0:(import.c:65:import_set_state_nolock()) ffff9c23454bf800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1784290435.822367:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1784290435.822493:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290435.822509:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+1:3616:x1870961901184896:12345-0@lo:39:umount.0 Request processed in 189us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290435.822516:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000020:00000080:2.0:1784290435.822524:0:65988:0:(genops.c:906:class_export_put()) final put ffff9c23454bb000/lustre-MDT0001-lwp-OST0000_UUID 00000100:00080000:3.0:1784290435.822542:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ea9000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784290435.822562:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1870961901184896:0@lo:39:umount.0 00000020:00000080:0.0:1784290435.822562:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c23454bb000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00080000:1.0:1784290435.822580:0:95684:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784290435.822586:0:95684:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784290435.822591:0:95684:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784290435.822637:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c23454bf800 for lustre-MDT0001 00010000:00010000:1.0:1784290435.823442:0:95684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b8000/0x5953bbf6b307582f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075836 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.823453:0:95684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b8000/0x5953bbf6b307582f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075836 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.823462:0:95684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b8000/0x5953bbf6b307582f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3075836 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.823469:0:95684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c24414b8000/0x5953bbf6b307582f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3075836 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.823491:0:95684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784290435.823500:0:95684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3075400 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075407 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.823510:0:95684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3075400 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075407 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.823513:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290435.823523:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c24414b8000/0x5953bbf6b307582f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3075836 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.823525:0:95684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3075400 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3075407 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.823545:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b8000 already unused, calling callback (ffffffffc14a9c20) 00010000:00010000:1.0:1784290435.823550:0:95684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3075400 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5953bbf6b3075407 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784290435.823559:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c24414b8000/0x5953bbf6b307582f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3075836 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.823571:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c24414b8000/0x5953bbf6b307582f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3075836 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784290435.823578:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c24414b8000/0x5953bbf6b307582f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3075836 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290435.823580:0:95684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784290435.823584:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784290435.823588:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1784290435.823589:0:95684:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 10000000:01000000:3.0:1784290435.823592:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1784290435.823623:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784290435.823629:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c24414b8000/0x5953bbf6b307582f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3075836 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.823630:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3075400 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3075407 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784290435.823642:0:95684:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1784290435.823650:0:95684:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:1.0:1784290435.823659:0:95684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1784290435.823667:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784290435.823670:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fe000 already unused, calling callback (ffffffffc14a9c20) 00000020:02000400:1.0:1784290435.823672:0:95684:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 10000000:00010000:2.0:1784290435.823682:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3075400 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5953bbf6b3075407 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.823695:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c24414b8000/0x5953bbf6b307582f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3075836 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.823696:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3075400 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5953bbf6b3075407 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.823720:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c24414b8000/0x5953bbf6b307582f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3075836 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784290435.823723:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3075400 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5953bbf6b3075407 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290435.823749:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784290435.823752:0:6476:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1784290435.823756:0:6476:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784290435.823759:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290435.823763:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290435.823771:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290435.823785:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901185024:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290435.823787:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3075400 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3075407 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.823799:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784290435.823820:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3075400 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3075407 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290435.823826:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe000/0x5953bbf6b3075400 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5953bbf6b3075407 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784290435.823843:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784290435.823843:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290435.823853:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784290435.823859:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784290435.823884:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24581aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901185152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784290435.823955:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290435.824002:0:19591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901185024 00000100:00100000:3.0:1784290435.824009:0:19591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901185024 00000100:00100000:2.0:1784290435.824010:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901185152 00000100:00100000:2.0:1784290435.824015:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901185152 00000100:00100000:2.0:1784290435.824080:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:2.0:1784290435.824089:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3618:x1870961901185024:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784290435.824093:0:19591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:3.0:1784290435.824109:0:19591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2458027450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3619:x1870961901185152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784290435.824110:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290435.824124:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c246dd27200/0x5953bbf6b3075836 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b307582f expref: 24 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.824130:0:19591:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784290435.824133:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784290435.824149:0:19591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebf600/0x5953bbf6b3075407 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5953bbf6b3075400 expref: 23 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290435.824161:0:19591:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784290435.824179:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:3618:x1870961901185024:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290435.824189:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1784290435.824203:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901185024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784290435.824220:0:19591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2458027450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:3619:x1870961901185152:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290435.824228:0:19591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:2.0:1784290435.824244:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24581aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2e54cd1c-9dbd-4e31-b60e-998135d46053:3619:1870961901185152:0@lo:103:ldlm_bl.0 00002000:00000080:1.0:1784290435.825025:0:95684:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:1.0:1784290435.825043:0:95684:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000001:00080000:0.0:1784290435.825356:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968693 is committed 00000020:00000080:1.0:1784290435.825492:0:95684:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:1.0:1784290435.825498:0:95684:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9c2474ee5000 711f3c77-e791-4aa8-86ee-bc854fd0bcc5 192.168.202.6@tcp 24 (0 0 20) 0 0 0 0: 0000000000000000 4294968693 stale:0 00000020:00080000:1.0:1784290435.825503:0:95684:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9c246ff9a000 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294968649 stale:0 00000020:00080000:1.0:1784290435.825507:0:95684:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9c2345f44800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294968631 stale:0 00000020:00080000:1.0:1784290435.825511:0:95684:0:(genops.c:1574:class_disconnect_exports()) OBD device 18 (ffff9c2458b9cd40) has exports, disconnecting them 00000020:00080000:1.0:1784290435.825514:0:95684:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.202.6@tcp (ffff9c2474ee5000), last request at 1784290435 00000020:00000080:1.0:1784290435.825518:0:95684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3075493 00000020:00010000:1.0:1784290435.825522:0:95684:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9c2474ee5000: total 0 00000100:00080000:1.0:1784290435.825524:0:95684:0:(import.c:65:import_set_state_nolock()) ffff9c2343905000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784290435.825536:0:95684:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.6@tcp (ffff9c2474ee5000): rc 0 00000020:00080000:1.0:1784290435.825539:0:95684:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff9c246ff9a000), last request at 1784290433 00000020:00000080:1.0:1784290435.825541:0:95684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b307530b 00000020:00010000:0.0:1784290435.825544:0:8418:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9c2474ee5000: total 0 00000100:00080000:1.0:1784290435.825546:0:95684:0:(import.c:65:import_set_state_nolock()) ffff9c2474f80000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784290435.825561:0:95684:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c246ff9a000): rc 0 00000020:00000080:1.0:1784290435.825564:0:95684:0:(genops.c:906:class_export_put()) final put ffff9c246ff9a000/lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1784290435.825577:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290435.825579:0:8418:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9c2474ee5000, canceled 0 locks, left on hash table 20. 00000020:00080000:1.0:1784290435.825582:0:95684:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff9c2345f44800), last request at 1784290433 00000020:00000080:1.0:1784290435.825589:0:95684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b306f1b3 00000100:00080000:1.0:1784290435.825596:0:95684:0:(import.c:65:import_set_state_nolock()) ffff9c2345f41800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1784290435.825604:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246ff9a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00002000:00010000:0.0:1784290435.825604:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb size from disk: 0 -> 1024 00000020:00080000:1.0:1784290435.825616:0:95684:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2345f44800): rc 0 00010000:00010000:2.0:1784290435.825617:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784290435.825618:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x765:0x0] updating lvb blocks from disk: 0 -> 8 00000020:00000080:1.0:1784290435.825623:0:95684:0:(genops.c:906:class_export_put()) final put ffff9c2345f44800/lustre-MDT0001-mdtlov_UUID 00010000:00010000:0.0:1784290435.825646:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006e71acd/0x5953bbf6b3075e10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x765:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27c0 expref: 21 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784290435.825676:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2474f80000 for lustre-OST0000 00000020:00080000:1.0:1784290435.825676:0:95684:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9c2458b9cd40) has no exports 00002000:00010000:0.0:1784290435.825679:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1784290435.825687:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76c:0x0] updating lvb blocks from disk: 0 -> 8 00000020:00000080:3.0:1784290435.825693:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2345f44800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00010000:00010000:0.0:1784290435.825700:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005caf552d/0x5953bbf6b3075ef0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27ff expref: 20 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.825715:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1784290435.825716:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784290435.825727:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090b36dfb/0x5953bbf6b3076166 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28d1 expref: 19 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1784290435.825748:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2345f41800 for lustre-OST0000 00002000:00010000:0.0:1784290435.825754:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1784290435.825757:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x774:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784290435.825763:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b26e3f5/0x5953bbf6b307620e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x774:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2910 expref: 18 pid: 26252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.825776:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1784290435.825783:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x772:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784290435.825790:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b5c07c7/0x5953bbf6b30761b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x772:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28ed expref: 17 pid: 26253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.825800:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1784290435.825802:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x764:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784290435.825807:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058607b66/0x5953bbf6b3075dfb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x764:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27ab expref: 16 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.825818:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1784290435.825820:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x768:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784290435.825824:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c06e1811/0x5953bbf6b3075fad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x768:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b283e expref: 15 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.825835:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1784290435.825837:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x775:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784290435.825841:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053d0fe3d/0x5953bbf6b307606a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x775:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b287d expref: 14 pid: 26261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.825851:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1784290435.825853:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784290435.825857:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e71fe3a2/0x5953bbf6b3076127 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28bc expref: 13 pid: 26263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.825867:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1784290435.825869:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x762:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784290435.825879:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b7dec93/0x5953bbf6b3075eb1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x762:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27ea expref: 12 pid: 26263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.825889:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1784290435.825891:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x767:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784290435.825895:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c49049c8/0x5953bbf6b3075f6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x767:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2829 expref: 11 pid: 26250 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.825906:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1784290435.825907:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784290435.825911:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecf4fbb8/0x5953bbf6b30760e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28a7 expref: 10 pid: 26260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.825921:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1784290435.825923:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x771:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784290435.825928:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000924000f3/0x5953bbf6b30761ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x771:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b28e6 expref: 9 pid: 26253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.825956:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1784290435.825958:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x763:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784290435.825964:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f9d3235/0x5953bbf6b3075d84 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x763:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2788 expref: 8 pid: 26257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.825973:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1784290435.825975:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x773:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784290435.825979:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000684c7b4d/0x5953bbf6b3076200 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x773:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2909 expref: 7 pid: 26258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.826005:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1784290435.826008:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784290435.826018:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a491819/0x5953bbf6b3075ffa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b285a expref: 6 pid: 26257 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.826036:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1784290435.826039:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x769:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784290435.826048:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cadb06b/0x5953bbf6b3075e72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x769:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b27d5 expref: 5 pid: 26251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.826064:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1784290435.826066:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x766:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784290435.826075:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ca690c2/0x5953bbf6b3075f2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x766:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2814 expref: 4 pid: 26253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.826087:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1784290435.826089:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x770:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784290435.826094:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e9f623d/0x5953bbf6b3075ff3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x770:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2853 expref: 3 pid: 26252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784290435.826103:0:8418:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1784290435.826104:0:8418:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x76b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1784290435.826108:0:8418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001acbc350/0x5953bbf6b30760a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x76b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2892 expref: 2 pid: 9000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290435.826130:0:8418:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9c2474ee5000, canceled 20 locks, left on hash table 0. 00000020:00000080:0.0:1784290435.838462:0:8418:0:(genops.c:906:class_export_put()) final put ffff9c2474ee5000/711f3c77-e791-4aa8-86ee-bc854fd0bcc5 00010000:00010000:0.0:1784290435.838475:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290435.838477:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290435.838479:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784290435.838498:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2474ee5000/711f3c77-e791-4aa8-86ee-bc854fd0bcc5 for lustre-OST0000 00000020:00000080:3.0:1784290435.838551:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2343905000 for lustre-OST0000 00000020:01000000:1.0:1784290435.838738:0:95684:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c246df6e120 - data ffff9c2470b396c0/ffff9c2474f63000 00000020:01000000:1.0:1784290435.838855:0:95684:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9c246df6ede0 - data ffff9c2470a7a510/ffff9c247e41c800 00100000:10000000:1.0:1784290435.856677:0:95684:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1784290435.861399:0:95684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3030357 00000020:00000080:1.0:1784290435.861408:0:95684:0:(genops.c:906:class_export_put()) final put ffff9c23417da800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1784290435.861426:0:95684:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c247d3d2000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1784290435.861430:0:95684:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c247d3d2000 2 00000020:01000004:1.0:1784290435.861434:0:95684:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c247d3d2000 from lustre-OST0000 00000020:00000080:1.0:1784290435.861459:0:95684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290435.861468:0:95684:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1784290435.861473:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c23417da800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1784290435.861473:0:95684:0:(genops.c:906:class_export_put()) final put ffff9c23417df000/lustre-OST0000_UUID 00000020:00000080:1.0:1784290435.861485:0:95684:0:(genops.c:865:class_export_destroy()) destroying export ffff9c23417df000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1784290435.861496:0:95684:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1784290435.861526:0:95684:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:1.0:1784290435.861530:0:95684:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1784290435.861532:0:95684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784290435.861535:0:95684:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784290435.861539:0:95684:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9c2341eab000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784290435.861543:0:95684:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff9c2341ea3380) has exports, disconnecting them 00000020:00080000:1.0:1784290435.861546:0:95684:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9c2341eab000), last request at 1784288349 00000020:00000080:1.0:1784290435.861549:0:95684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3030381 00000020:00080000:1.0:1784290435.861557:0:95684:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2341eab000): rc 0 00000020:00000080:1.0:1784290435.861560:0:95684:0:(genops.c:906:class_export_put()) final put ffff9c2341eab000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1784290435.861596:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2341eab000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1784290435.863434:0:95684:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1784290435.863442:0:95684:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784290435.863447:0:95684:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784290435.863451:0:95684:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784290435.863491:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2341ea9800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1784290435.863626:0:95684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784290435.863637:0:95684:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1784290435.863642:0:95684:0:(genops.c:906:class_export_put()) final put ffff9c2341eab800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1784290435.863645:0:95684:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2341eab800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1784290435.863654:0:95684:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1784290435.863713:0:95684:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1784290435.863716:0:95684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784290435.863720:0:95684:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784290435.863724:0:95684:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9c2341ead800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784290435.863728:0:95684:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff9c2341ea19c0) has exports, disconnecting them 00000020:00080000:0.0:1784290435.863730:0:95684:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9c2341ead800), last request at 1784288349 00000020:00000080:0.0:1784290435.863732:0:95684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b3030396 00000020:00080000:0.0:1784290435.863741:0:95684:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c2341ead800): rc 0 00000020:00000080:0.0:1784290435.863743:0:95684:0:(genops.c:906:class_export_put()) final put ffff9c2341ead800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1784290435.863768:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2341ead800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1784290435.864377:0:95684:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1784290435.864381:0:95684:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1784290435.864383:0:95684:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784290435.864386:0:95684:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1784290435.864426:0:83795:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9c2341ea9000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1784290435.864517:0:95684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290435.864524:0:95684:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1784290435.864526:0:95684:0:(genops.c:906:class_export_put()) final put ffff9c2341eaa800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1784290435.864529:0:95684:0:(genops.c:865:class_export_destroy()) destroying export ffff9c2341eaa800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1784290435.864540:0:95684:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1784290435.864583:0:95684:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c247d3d2000 1 00000020:00000080:1.0:1784290435.864587:0:95684:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x5953bbf6b303031f 00000020:00000080:1.0:1784290435.864591:0:95684:0:(genops.c:906:class_export_put()) final put ffff9c246d58a800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1784290435.864605:0:95684:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1784290435.864619:0:95684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784290435.864622:0:83795:0:(genops.c:865:class_export_destroy()) destroying export ffff9c246d58a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1784290435.864628:0:95684:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784290435.864634:0:95684:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9c247d26cd40) has no exports 00000020:00000080:1.0:1784290435.882276:0:95684:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784290435.882286:0:95684:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1784290435.882289:0:95684:0:(genops.c:906:class_export_put()) final put ffff9c247d3d5000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1784290435.882293:0:95684:0:(genops.c:865:class_export_destroy()) destroying export ffff9c247d3d5000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1784290435.882297:0:95684:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1784290435.882498:0:95684:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c247d3d4000 00000020:02000400:1.0:1784290435.882534:0:95684:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00100000:2.0:1784290436.613809:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290436.613858:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290436.613940:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290436.613954:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896337280 00000100:00100000:3.0:1784290436.613961:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896337536 00000100:00100000:1.0:1784290436.613966:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896337280 00000100:00100000:3.0:1784290436.613973:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896337536 00000100:00100000:2.0:1784290436.613984:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290436.614009:0:26257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896337792 00000100:00100000:0.0:1784290436.614017:0:26257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896337792 00000100:00100000:1.0:1784290436.614049:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 169 00000100:00100000:2.0:1784290436.614055:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290436.614066:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896337408 00000100:00100000:3.0:1784290436.614072:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896337408 00000100:00100000:1.0:1784290436.614074:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2397:x1870961896337280:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290436.614083:0:26257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896337664 00000100:00100000:0.0:1784290436.614099:0:26257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896337664 00000100:00100000:3.0:1784290436.614114:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 776 00000100:00100000:2.0:1784290436.614128:0:26261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1637 00000100:00100000:3.0:1784290436.614132:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24581aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:2397:x1870961896337536:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290436.614145:0:26257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5040 00000100:00100000:2.0:1784290436.614147:0:26261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2397:x1870961896337792:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290436.614156:0:26257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2397:x1870961896337664:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290436.614165:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2397:x1870961896337280:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 95us (361us total) trans 0 rc 0/0 00000020:00080000:0.0:1784290436.614167:0:26257:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.6@tcp 00000100:00100000:1.0:1784290436.614182:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 169 00000100:00100000:2.0:1784290436.614214:0:26261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2397:x1870961896337792:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 76us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290436.614222:0:26261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1637 00000100:00100000:3.0:1784290436.614234:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24581aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:2397:x1870961896337536:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 109us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290436.614235:0:26257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2397:x1870961896337664:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 81us (186us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784290436.614243:0:26257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5040 00000100:00100000:3.0:1784290436.614259:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 776 00000100:00100000:2.0:1784290436.614271:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 777 00000100:00100000:2.0:1784290436.614290:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+155:2397:x1870961896337408:12345-192.168.202.6@tcp:400:kworker.0 00000100:00080000:0.0:1784290436.614295:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784290436.614302:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784290436.614368:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+155:2397:x1870961896337408:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 55us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290436.614387:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 777 00000100:00100000:3.0:1784290436.620682:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290436.620743:0:26260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896337920 00000100:00100000:2.0:1784290436.620749:0:26260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896337920 00000100:00100000:2.0:1784290436.620779:0:26260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5041 00000100:00100000:2.0:1784290436.620784:0:26260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2396:x1870961896337920:12345-192.168.202.6@tcp:8:ptlrpcd_00_00.0 00010000:00020000:2.0:1784290436.620802:0:26260:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.202.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784290436.620875:0:26260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2396:x1870961896337920:12345-192.168.202.6@tcp:8:ptlrpcd_00_00.0 Request processed in 86us (192us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290436.620885:0:26260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5041 00010000:00010000:3.0:1784290436.776502:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290437.287653:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784290437.287684:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901185408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1784290437.287706:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901185280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290437.287790:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290437.287878:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290437.287906:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901185408 00000100:00100000:1.0:1784290437.287944:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901185408 00000100:00100000:0.0:1784290437.288006:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901185280 00000100:00100000:0.0:1784290437.288020:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901185280 00000100:00100000:1.0:1784290437.288029:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:1.0:1784290437.288044:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3618:x1870961901185408:12345-0@lo:13:osp-pre-0-1.0 00000020:00080000:1.0:1784290437.288071:0:17967:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00080000:2.0:1784290437.288088:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290437.288119:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:0.0:1784290437.288135:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901185280:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290437.288151:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3618:x1870961901185408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (366us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784290437.288163:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00002000:00000024:0.0:1784290437.288184:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:02020000:1.0:1784290437.288233:0:3618:0:(client.c:1492:ptlrpc_check_status()) lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1784290437.288241:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784290437.288248:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c2341ead000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784290437.288255:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1784290437.288293:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901185280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 161us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290437.288306:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:2.0:1784290437.288454:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901185280:0@lo:13:osp-pre-1-1.0 00000004:00080000:1.0:1784290437.298082:0:3618:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00080000:1.0:1784290437.298089:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c2341ead000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784290437.298096:0:3618:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 1620 00000100:00080000:1.0:1784290437.298108:0:3618:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c2341ead000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:1.0:1784290437.298146:0:3618:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c24483ce680 x1870961901185536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290437.298212:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901185536:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:0.0:1784290437.298262:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290437.298329:0:26255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901185536 00000100:00100000:1.0:1784290437.298393:0:26255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901185536 00000100:00100000:1.0:1784290437.298439:0:26255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5042 00000100:00100000:1.0:1784290437.298449:0:26255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a51a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3616:x1870961901185536:12345-0@lo:8:ptlrpcd_00_01.0 00010000:00020000:1.0:1784290437.298476:0:26255:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1784290437.298546:0:26255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a51a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3616:x1870961901185536:12345-0@lo:8:ptlrpcd_00_01.0 Request processed in 96us (281us total) trans 0 rc -19/-19 00000100:00100000:1.0:1784290437.298556:0:26255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5042 00000100:00080000:0.0:1784290437.298577:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ead000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784290437.298584:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1784290437.298589:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901185536:0@lo:8:ptlrpcd_00_01.0 00010000:00010000:3.0:1784290437.799551:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784290437.801010:0:94053:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084434 is committed 00010000:00010000:3.0:1784290437.801082:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3075cb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801102:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3075cb2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801115:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3075cb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801126:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236cc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.801133:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3075cb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801145:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3075cb2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801177:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2461f23000) 00010000:00010000:3.0:1784290437.801183:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.801194:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3075cb2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801208:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236cc00/0x5953bbf6b3075cb2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801263:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca400/0x5953bbf6b3075cea lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801302:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca400/0x5953bbf6b3075cea lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801314:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca400/0x5953bbf6b3075cea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801325:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8ca400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.801331:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca400/0x5953bbf6b3075cea lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801412:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca400/0x5953bbf6b3075cea lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801428:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6479ba7a (ffff9c2461f23000) 00010000:00010000:3.0:1784290437.801434:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.801438:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca400/0x5953bbf6b3075cea lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801447:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca400/0x5953bbf6b3075cea lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x6479ba7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801480:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b3075d7d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801488:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b3075d7d lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801495:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b3075d7d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801501:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8cbc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.801516:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b3075d7d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801524:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b3075d7d lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801539:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9c24821d9000) 00010000:00010000:3.0:1784290437.801545:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.801551:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b3075d7d lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801562:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8cbc00/0x5953bbf6b3075d7d lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801588:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075dd1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801601:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075dd1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801613:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075dd1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801624:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247f8ca600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.801631:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075dd1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801645:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075dd1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801663:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9c24821d9a00) 00010000:00010000:3.0:1784290437.801667:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.801681:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075dd1 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801689:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c247f8ca600/0x5953bbf6b3075dd1 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801712:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7da00/0x5953bbf6b3075df4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801719:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7da00/0x5953bbf6b3075df4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801727:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7da00/0x5953bbf6b3075df4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801734:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7da00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.801738:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7da00/0x5953bbf6b3075df4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801746:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7da00/0x5953bbf6b3075df4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801758:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff9c24821d9e00) 00010000:00010000:3.0:1784290437.801761:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.801766:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7da00/0x5953bbf6b3075df4 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801773:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7da00/0x5953bbf6b3075df4 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801785:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075e3a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801791:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075e3a lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801807:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075e3a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801814:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246d951600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.801818:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075e3a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801824:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075e3a lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801834:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff9c2446227c00) 00010000:00010000:3.0:1784290437.801836:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.801840:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075e3a lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801846:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951600/0x5953bbf6b3075e3a lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801859:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075e79 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801867:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075e79 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801874:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075e79 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801879:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c400 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.801883:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075e79 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801901:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075e79 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801932:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff9c24821d9400) 00010000:00010000:3.0:1784290437.801935:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.801939:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075e79 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801946:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c400/0x5953bbf6b3075e79 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801961:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950e00/0x5953bbf6b3075eb8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801968:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950e00/0x5953bbf6b3075eb8 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801974:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950e00/0x5953bbf6b3075eb8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801979:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246d950e00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.801982:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950e00/0x5953bbf6b3075eb8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801989:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950e00/0x5953bbf6b3075eb8 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.801998:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff9c2446227100) 00010000:00010000:3.0:1784290437.802000:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.802004:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950e00/0x5953bbf6b3075eb8 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802023:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d950e00/0x5953bbf6b3075eb8 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802038:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c800/0x5953bbf6b3075ef7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802045:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c800/0x5953bbf6b3075ef7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802053:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c800/0x5953bbf6b3075ef7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802059:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2469a7c800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.802062:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c800/0x5953bbf6b3075ef7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802070:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c800/0x5953bbf6b3075ef7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802079:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9c2446227300) 00010000:00010000:3.0:1784290437.802081:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.802084:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c800/0x5953bbf6b3075ef7 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802091:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2469a7c800/0x5953bbf6b3075ef7 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802102:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951000/0x5953bbf6b3075f44 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802108:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951000/0x5953bbf6b3075f44 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802124:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951000/0x5953bbf6b3075f44 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802131:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246d951000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.802134:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951000/0x5953bbf6b3075f44 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802141:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951000/0x5953bbf6b3075f44 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802150:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9c2446227a00) 00010000:00010000:3.0:1784290437.802153:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.802156:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951000/0x5953bbf6b3075f44 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802163:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951000/0x5953bbf6b3075f44 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802178:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b3075f75 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802185:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b3075f75 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802192:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b3075f75 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802198:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aae00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.802202:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b3075f75 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802222:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b3075f75 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802233:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9c2446227e00) 00010000:00010000:3.0:1784290437.802236:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.802239:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b3075f75 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802246:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aae00/0x5953bbf6b3075f75 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802262:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075fd0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802269:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075fd0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802276:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075fd0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802285:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.802288:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075fd0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802295:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075fd0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802308:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9c244c870500) 00010000:00010000:3.0:1784290437.802311:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.802314:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075fd0 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802335:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa200/0x5953bbf6b3075fd0 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802427:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3075fec lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802441:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3075fec lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802453:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3075fec lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802465:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450ab000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.802472:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3075fec lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802484:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3075fec lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802503:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff9c2446227800) 00010000:00010000:3.0:1784290437.802507:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.802511:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3075fec lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802518:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450ab000/0x5953bbf6b3075fec lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802538:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3076032 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802546:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3076032 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802563:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3076032 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802569:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26200 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.802574:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3076032 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802581:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3076032 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802592:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9c2474f5f300) 00010000:00010000:3.0:1784290437.802595:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.802600:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3076032 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802607:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26200/0x5953bbf6b3076032 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802627:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b307607f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802634:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b307607f lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802641:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b307607f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802647:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246d951a00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.802652:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b307607f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802670:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b307607f lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802681:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff9c2446227500) 00010000:00010000:3.0:1784290437.802685:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.802689:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b307607f lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802696:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246d951a00/0x5953bbf6b307607f lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802711:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b30760b0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802717:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b30760b0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802724:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b30760b0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802730:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aa600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.802734:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b30760b0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802742:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b30760b0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802751:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff9c2446227b00) 00010000:00010000:3.0:1784290437.802754:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.802757:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b30760b0 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802774:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aa600/0x5953bbf6b30760b0 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66004 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802791:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30760ef lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802798:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30760ef lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802804:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30760ef lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802810:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236c800 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.802813:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30760ef lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802820:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30760ef lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802829:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9c244c870d00) 00010000:00010000:3.0:1784290437.802831:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.802834:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30760ef lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802840:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c234236c800/0x5953bbf6b30760ef lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802852:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3076151 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802859:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3076151 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802874:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3076151 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802881:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2482045000 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.802885:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3076151 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802893:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3076151 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802905:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff9c2446227200) 00010000:00010000:3.0:1784290437.802908:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.802960:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3076151 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802969:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c2482045000/0x5953bbf6b3076151 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802989:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b307619e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.802996:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b307619e lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803004:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b307619e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803012:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450abc00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.803018:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b307619e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803040:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b307619e lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803056:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff9c244c870800) 00010000:00010000:3.0:1784290437.803059:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.803063:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b307619e lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803069:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450abc00/0x5953bbf6b307619e lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803084:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b30761a5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803092:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b30761a5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803099:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b30761a5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803107:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c24414b8a00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.803111:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b30761a5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803118:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b30761a5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803130:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff9c244c870600) 00010000:00010000:3.0:1784290437.803134:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.803139:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b30761a5 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803157:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c24414b8a00/0x5953bbf6b30761a5 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 74876 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803174:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30761eb lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803180:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30761eb lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803187:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30761eb lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803193:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c23450aac00 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.803197:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30761eb lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803204:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30761eb lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803217:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff9c2474f5ff00) 00010000:00010000:3.0:1784290437.803220:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.803225:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30761eb lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803231:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c23450aac00/0x5953bbf6b30761eb lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65988 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803246:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076207 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803254:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076207 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803268:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076207 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803276:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c246dd26600 already unused, calling callback (ffffffffc1aba4f0) 00010000:00010000:3.0:1784290437.803282:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076207 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803293:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076207 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803312:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9c244c870b00) 00010000:00010000:3.0:1784290437.803318:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784290437.803325:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076207 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290437.803336:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c246dd26600/0x5953bbf6b3076207 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66008 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:02000400:3.0:1784290438.200153:0:96029:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing load_module ../libcfs/libcfs/libcfs 00000100:00080000:2.0:1784290438.311552:0:9947:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290438.311558:0:9947:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784290438.311562:0:9947:0:(import.c:65:import_set_state_nolock()) ffff9c2341ead000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290438.311572:0:9947:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 2178 00000100:00100000:0.0:1784290438.311574:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a51ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901185792:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784290438.311578:0:9947:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784290438.311593:0:9947:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c2341ead000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290438.311622:0:9947:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2444058a80 x1870961901186304/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290438.311701:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290438.311731:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901185664:0@lo:400:kworker.0 00000100:00100000:0.0:1784290438.311787:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c244405aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901186432:0@lo:400:kworker.0 00000100:00100000:2.0:1784290438.311803:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290438.311857:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901185664 00000100:00100000:1.0:1784290438.311869:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901185664 00000100:00100000:0.0:1784290438.311876:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290438.311889:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901186176:0@lo:400:kworker.0 00000100:00100000:2.0:1784290438.311967:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290438.311978:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901186944:0@lo:400:kworker.0 00000100:00100000:1.0:1784290438.311981:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1784290438.311998:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901186816:0@lo:400:kworker.0 00000100:00100000:1.0:1784290438.312014:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:3618:x1870961901185664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290438.312036:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290438.312050:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1870961901186048:0@lo:400:kworker.0 00000100:00100000:0.0:1784290438.312083:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1784290438.312094:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1870961901185920:0@lo:400:kworker.0 00000100:00100000:2.0:1784290438.312108:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290438.312116:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:3618:x1870961901185664:12345-0@lo:400:kworker.0 Request processed in 106us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290438.312131:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1784290438.312145:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901186688:0@lo:400:kworker.0 00000100:00100000:0.0:1784290438.312169:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290438.312202:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290438.312213:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961901186560:0@lo:400:kworker.0 00000100:00100000:1.0:1784290438.312227:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901186048 00000100:00100000:1.0:1784290438.312236:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901186048 00000100:00100000:2.0:1784290438.312271:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901186304:0@lo:8:kworker.0 00000100:00100000:0.0:1784290438.312296:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290438.312311:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290438.312342:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1870961901187072:0@lo:400:kworker.0 00000100:00100000:1.0:1784290438.312384:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901185920 00000100:00100000:1.0:1784290438.312392:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901185920 00000100:00100000:0.0:1784290438.312428:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290438.312430:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901186176 00000100:00100000:2.0:1784290438.312436:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901186176 00000100:00100000:1.0:1784290438.312459:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901186560 00000100:00100000:1.0:1784290438.312468:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901186560 00000100:00100000:2.0:1784290438.312495:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901186688 00000100:00100000:2.0:1784290438.312500:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901186688 00000100:00100000:0.0:1784290438.312517:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901185792 00000100:00100000:1.0:1784290438.312518:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901187072 00000100:00100000:0.0:1784290438.312530:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901185792 00000100:00100000:1.0:1784290438.312531:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901187072 00000100:00100000:2.0:1784290438.312539:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3913 00000100:00100000:2.0:1784290438.312555:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3618:x1870961901186176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290438.312591:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:1.0:1784290438.312610:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1870961901186048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290438.312617:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3618:x1870961901186176:12345-0@lo:400:kworker.0 Request processed in 61us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290438.312625:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:2.0:1784290438.312640:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3913 00000100:00100000:0.0:1784290438.312645:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a51b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901185792:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290438.312662:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3914 00000100:00100000:2.0:1784290438.312670:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3617:x1870961901186688:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1784290438.312675:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1784290438.312694:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1870961901186048:12345-0@lo:400:kworker.0 Request processed in 91us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290438.312707:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3617:x1870961901186688:12345-0@lo:400:kworker.0 Request processed in 36us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290438.312708:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:2.0:1784290438.312720:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3914 00000100:00100000:1.0:1784290438.312751:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:2.0:1784290438.312771:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:1.0:1784290438.312776:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1870961901185920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290438.312786:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a51b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901185792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290438.312792:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ddf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1870961901186560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290438.312817:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:1.0:1784290438.312859:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1870961901185920:12345-0@lo:400:kworker.0 Request processed in 93us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290438.312889:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:0.0:1784290438.312892:0:26263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901186432 00000100:00100000:2.0:1784290438.312896:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ddf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1870961901186560:12345-0@lo:400:kworker.0 Request processed in 100us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290438.312900:0:26263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901186432 00000100:00100000:2.0:1784290438.312924:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:1.0:1784290438.312946:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:1.0:1784290438.312968:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ddf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1870961901187072:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784290438.312975:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784290438.312983:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784290438.312992:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1784290438.312993:0:26263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901186944 00000100:00100000:0.0:1784290438.312999:0:26263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901186944 00000100:00100000:0.0:1784290438.313044:0:26263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901186304 00000100:00100000:0.0:1784290438.313049:0:26263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901186304 00000100:00100000:1.0:1784290438.313059:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ddf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1870961901187072:12345-0@lo:400:kworker.0 Request processed in 88us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290438.313074:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:0.0:1784290438.313091:0:26263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1638 00000100:00100000:2.0:1784290438.313104:0:8999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1639 00000100:00100000:0.0:1784290438.313110:0:26263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2343269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901186432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290438.313128:0:8999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c234326a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901186944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290438.313229:0:26263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2343269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901186432:12345-0@lo:400:kworker.0 Request processed in 122us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290438.313230:0:8999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c234326a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901186944:12345-0@lo:400:kworker.0 Request processed in 111us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290438.313251:0:8999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1639 00000100:00100000:0.0:1784290438.313269:0:26263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1638 00000100:00100000:2.0:1784290438.313292:0:8999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5043 00000100:00100000:2.0:1784290438.313305:0:8999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3616:x1870961901186304:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1784290438.313325:0:8999:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784290438.313425:0:8999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3616:x1870961901186304:12345-0@lo:8:kworker.0 Request processed in 123us (1114us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290438.313441:0:8999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5043 00000100:00100000:0.0:1784290438.313462:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290438.313474:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784290438.313489:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901187456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784290438.313551:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290438.313554:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901187328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290438.313603:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901187456 00000100:00100000:2.0:1784290438.313608:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901187456 00000100:00100000:0.0:1784290438.313617:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290438.313672:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:2.0:1784290438.313682:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3620:x1870961901187456:12345-0@lo:13:osp-pre-0-0.0 00000020:00080000:2.0:1784290438.313695:0:17967:0:(tgt_handler.c:807:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1784290438.313702:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2e54cd1c-9dbd-4e31-b60e-998135d46053:3618:1870961901185664:0@lo:400:kworker.0 00000100:00100000:0.0:1784290438.313750:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901186176:0@lo:400:kworker.0 00000100:00100000:2.0:1784290438.313764:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3620:x1870961901187456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (222us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784290438.313788:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:0.0:1784290438.313830:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784290438.313846:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901187200:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1784290438.313867:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ead000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290438.313874:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784290438.313880:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901186304:0@lo:8:kworker.0 00000100:00100000:0.0:1784290438.313894:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290438.313937:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901187328 00000100:00100000:2.0:1784290438.313942:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901187328 00000100:00100000:0.0:1784290438.313988:0:26253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901186816 00000100:00100000:2.0:1784290438.313989:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901187200 00000100:00100000:0.0:1784290438.314006:0:26253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901186816 00000100:00100000:2.0:1784290438.314008:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901187200 00000100:00100000:2.0:1784290438.314100:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3915 00000100:00100000:0.0:1784290438.314102:0:26253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5044 00000100:00100000:0.0:1784290438.314134:0:26253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ddf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3618:x1870961901186816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290438.314135:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ddf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3618:x1870961901187328:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1784290438.314164:0:26253:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000004:00000024:2.0:1784290438.314176:0:8413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444581376 avail 1298341888 00000100:00100000:2.0:1784290438.314240:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ddf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3618:x1870961901187328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290438.314244:0:26253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ddf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:3618:x1870961901186816:12345-0@lo:400:kworker.0 Request processed in 111us (787us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784290438.314250:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3915 00000100:00100000:0.0:1784290438.314272:0:26253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5044 00000100:00100000:2.0:1784290438.314274:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3916 00000100:00100000:2.0:1784290438.314293:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ddf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901187200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1784290438.314310:0:8413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445097472 avail 1298857984 00000100:00100000:2.0:1784290438.314386:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ddf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901187200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290438.314393:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3916 00000100:00100000:0.0:1784290438.314415:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901187328:0@lo:41:osp-pre-0-1.0 00000100:02020000:2.0:1784290438.314451:0:3620:0:(client.c:1492:ptlrpc_check_status()) lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1784290438.314458:0:3620:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784290438.314461:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9c2458110000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:00080000:0.0:1784290438.314468:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:02000400:2.0:1784290438.314469:0:3620:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784290438.314489:0:3618:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9c2458110000 already not connected (conn 1, was 1): DISCONN 00000004:00080000:2.0:1784290438.314492:0:3620:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00100000:0.0:1784290438.314502:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901186816:0@lo:400:kworker.0 00000100:00080000:2.0:1784290438.314504:0:3620:0:(import.c:65:import_set_state_nolock()) ffff9c2458110000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784290438.314523:0:3620:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 2153 00000100:00080000:2.0:1784290438.314539:0:3620:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c2458110000 using connection 192.168.202.106@tcp/0@lo 00000100:00100000:2.0:1784290438.314562:0:3620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2468ab8000 x1870961901187584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290438.314600:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901187200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1784290438.314607:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901187584:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:2.0:1784290438.314654:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290438.314688:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1870961901185920:0@lo:400:kworker.0 00000100:00100000:2.0:1784290438.314705:0:26258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901187584 00000100:00100000:2.0:1784290438.314716:0:26258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901187584 00000100:00100000:0.0:1784290438.314746:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1870961901186560:0@lo:400:kworker.0 00000100:00100000:2.0:1784290438.314757:0:26258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5045 00000100:00100000:2.0:1784290438.314768:0:26258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3616:x1870961901187584:12345-0@lo:8:ptlrpcd_00_03.0 00000100:00100000:0.0:1784290438.314779:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1870961901187072:0@lo:400:kworker.0 00010000:00020000:2.0:1784290438.314786:0:26258:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290438.314834:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c244405aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901186432:0@lo:400:kworker.0 00000100:00100000:2.0:1784290438.314851:0:26258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3616:x1870961901187584:12345-0@lo:8:ptlrpcd_00_03.0 Request processed in 78us (198us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784290438.314858:0:26258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5045 00000100:00100000:0.0:1784290438.314871:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901186944:0@lo:400:kworker.0 00000100:00100000:2.0:1784290438.314926:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1870961901186048:0@lo:400:kworker.0 00000100:00100000:0.0:1784290438.314971:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a51ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901185792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290438.314975:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a42e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901186688:0@lo:400:kworker.0 00000100:00080000:2.0:1784290438.315090:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2458110000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784290438.315096:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784290438.315100:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901187584:0@lo:8:ptlrpcd_00_03.0 00010000:00010000:0.0:1784290438.824683:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290439.849203:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784290440.871539:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1784290441.734058:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c246a4fc850 x1870961896338048 msgsize 224 00000100:00100000:3.0:1784290441.734186:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00000040:3.0:1784290441.734192:0:3612:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1784290441.734266:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c2447cc8e00 x1870961896338304 msgsize 224 00000100:00100000:3.0:1784290441.734275:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00000040:3.0:1784290441.734307:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c2447cc9c00 x1870961896338176 msgsize 224 00000100:00100000:3.0:1784290441.734314:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290441.734387:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896338048 00000100:00100000:2.0:1784290441.734393:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896338304 00000100:00100000:2.0:1784290441.734408:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896338304 00000100:00100000:1.0:1784290441.734408:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896338048 00000020:00000040:2.0:1784290441.734417:0:65988:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b30748d1 00000020:00000040:1.0:1784290441.734417:0:94060:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307542a 00000020:00000040:2.0:1784290441.734427:0:65988:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c234687c800 refcount=11 00000020:00000040:1.0:1784290441.734427:0:94060:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2474cc5000 refcount=10 00000100:00100000:0.0:1784290441.734433:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896338176 00000100:00100000:0.0:1784290441.734454:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896338176 00000020:00000040:2.0:1784290441.734456:0:65988:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9c24449119c0) now 10 - evictor 00000020:00000040:0.0:1784290441.734460:0:65990:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b30752b7 00000100:00000040:1.0:1784290441.734471:0:94060:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000020:00000040:0.0:1784290441.734472:0:65990:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c247e4b1000 refcount=51 00000020:00000040:0.0:1784290441.734506:0:65990:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9c2474fd3380) now 14 - evictor 00000100:00000040:2.0:1784290441.734508:0:65988:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1784290441.734538:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 171 00000100:00000040:1.0:1784290441.734548:0:94060:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2474cc5000 : new rpc_count 1 00000100:00000040:3.0:1784290441.734557:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c2447ccad80 x1870961896338432 msgsize 520 00000100:00000040:1.0:1784290441.734569:0:94060:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246a4fc850 x1870961896338048/t0(0) o400->fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f@192.168.202.6@tcp:462/0 lens 224/0 e 0 to 0 dl 1784290452 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290441.734581:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 782 00000100:00000040:2.0:1784290441.734589:0:65988:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c234687c800 : new rpc_count 1 00000100:00000040:2.0:1784290441.734599:0:65988:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2447cc8e00 x1870961896338304/t0(0) o400->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:462/0 lens 224/0 e 0 to 0 dl 1784290452 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290441.734616:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 783 00000100:00100000:1.0:1784290441.734618:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2400:x1870961896338048:12345-192.168.202.6@tcp:400:kworker.0 00000100:00000040:0.0:1784290441.734635:0:65990:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c247e4b1000 : new rpc_count 1 00000100:00100000:2.0:1784290441.734656:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:2400:x1870961896338304:12345-192.168.202.6@tcp:400:kworker.0 00000100:00000040:0.0:1784290441.734659:0:65990:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2447cc9c00 x1870961896338176/t0(0) o400->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:462/0 lens 224/0 e 0 to 0 dl 1784290452 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1784290441.734664:0:94060:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961896338048 00000100:00100000:3.0:1784290441.734682:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00010000:00000040:2.0:1784290441.734694:0:65988:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 81604378776, transno 0, xid 1870961896338304 00000100:00000040:1.0:1784290441.734694:0:94060:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 9 to 192.168.202.6@tcp 00000100:00000040:2.0:1784290441.734716:0:65988:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00000100:00000040:1.0:1784290441.734717:0:94060:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00100000:0.0:1784290441.734729:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+51:2400:x1870961896338176:12345-192.168.202.6@tcp:400:kworker.0 00000100:00000040:2.0:1784290441.734731:0:65988:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00010000:00000040:0.0:1784290441.734780:0:65990:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 120259084434, transno 0, xid 1870961896338176 00000100:00000040:2.0:1784290441.734797:0:65988:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 8 to 192.168.202.6@tcp 00000100:00000040:1.0:1784290441.734797:0:94060:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 8 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290441.734806:0:65990:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 9 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290441.734813:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c2447cc8700 x1870961896338560 msgsize 224 00000100:00000040:2.0:1784290441.734821:0:65988:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2447cc8e00 x1870961896338304/t0(0) o400->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:462/0 lens 224/224 e 0 to 0 dl 1784290452 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290441.734821:0:94060:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246a4fc850 x1870961896338048/t0(0) o400->fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f@192.168.202.6@tcp:462/0 lens 224/224 e 0 to 0 dl 1784290452 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290441.734830:0:65990:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00100000:3.0:1784290441.734855:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290441.734909:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:2400:x1870961896338304:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 229us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290441.734909:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2400:x1870961896338048:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 278us (815us total) trans 0 rc 0/0 00000100:00000040:0.0:1784290441.734923:0:65990:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 8 to 192.168.202.6@tcp 00000100:00100000:2.0:1784290441.734935:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 782 00000100:00100000:1.0:1784290441.734935:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 171 00000100:00000040:0.0:1784290441.734943:0:65990:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2447cc9c00 x1870961896338176/t0(0) o400->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:462/0 lens 224/224 e 0 to 0 dl 1784290452 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290441.734954:0:65988:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c234687c800 : new rpc_count 0 00000100:00000040:1.0:1784290441.734954:0:94060:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2474cc5000 : new rpc_count 0 00000100:00100000:0.0:1784290441.734977:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+51:2400:x1870961896338176:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 260us (661us total) trans 0 rc 0/0 00000020:00000040:2.0:1784290441.734990:0:65988:0:(genops.c:900:class_export_put()) PUTting export ffff9c234687c800 : new refcount 10 00000020:00000040:1.0:1784290441.734990:0:94060:0:(genops.c:900:class_export_put()) PUTting export ffff9c2474cc5000 : new refcount 9 00000100:00100000:0.0:1784290441.735020:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 783 00000100:00000040:0.0:1784290441.735026:0:65990:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c247e4b1000 : new rpc_count 0 00000100:00080000:2.0:1784290441.735049:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1784290441.735050:0:65990:0:(genops.c:900:class_export_put()) PUTting export ffff9c247e4b1000 : new refcount 50 00000020:00000040:2.0:1784290441.735069:0:6484:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9c2474fd3380) now 14 - evictor 00000100:00080000:2.0:1784290441.735083:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:2.0:1784290441.735088:0:6484:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9c24449119c0) now 10 - evictor 00000100:00100000:3.0:1784290441.735115:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896338432 00000100:00100000:0.0:1784290441.735144:0:26261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896338560 00000100:00100000:0.0:1784290441.735153:0:26261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896338560 00000020:00000040:0.0:1784290441.735156:0:26261:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307549a 00000020:00000040:0.0:1784290441.735161:0:26261:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c234687f000 refcount=7 00000020:00000040:0.0:1784290441.735173:0:26261:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9c2342163380) now 10 - evictor 00000100:00000040:0.0:1784290441.735212:0:26261:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:3.0:1784290441.735218:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896338432 00000020:00000040:3.0:1784290441.735229:0:26252:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075493 00000100:00080000:2.0:1784290441.735247:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1784290441.735273:0:6484:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9c2342163380) now 10 - evictor 00000100:00100000:0.0:1784290441.735302:0:26261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1640 00000100:00000040:0.0:1784290441.735314:0:26261:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c234687f000 : new rpc_count 1 00000100:00100000:3.0:1784290441.735325:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5046 00000100:00000040:0.0:1784290441.735338:0:26261:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2447cc8700 x1870961896338560/t0(0) o400->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:462/0 lens 224/0 e 0 to 0 dl 1784290452 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290441.735379:0:26252:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2447ccad80 x1870961896338432/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784290461 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290441.735414:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2396:x1870961896338432:12345-192.168.202.6@tcp:8:kworker.0 00010000:00020000:3.0:1784290441.735445:0:26252:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.202.6@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1784290441.735458:0:26261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2400:x1870961896338560:12345-192.168.202.6@tcp:400:kworker.0 00000100:00000040:3.0:1784290441.735477:0:26252:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 9 to 192.168.202.6@tcp 00010000:00000040:0.0:1784290441.735484:0:26261:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961896338560 00000100:00000040:3.0:1784290441.735486:0:26252:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c2341df1780 refcount 9 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290441.735499:0:26252:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290441.735511:0:26261:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290441.735526:0:26261:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:3.0:1784290441.735549:0:26252:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 9 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290441.735558:0:26252:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2447ccad80 x1870961896338432/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1784290461 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290441.735577:0:26261:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 8 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290441.735598:0:26261:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2447cc8700 x1870961896338560/t0(0) o400->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:462/0 lens 224/224 e 0 to 0 dl 1784290452 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290441.735619:0:26261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2400:x1870961896338560:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 176us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290441.735640:0:26261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1640 00000100:00000040:0.0:1784290441.735646:0:26261:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c234687f000 : new rpc_count 0 00000100:00100000:3.0:1784290441.735661:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2396:x1870961896338432:12345-192.168.202.6@tcp:8:kworker.0 Request processed in 173us (1015us total) trans 0 rc -19/-19 00000020:00000040:0.0:1784290441.735665:0:26261:0:(genops.c:900:class_export_put()) PUTting export ffff9c234687f000 : new refcount 6 00000100:00100000:3.0:1784290441.735693:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5046 00010000:00010000:3.0:1784290441.895452:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:2.0:1784290442.407444:0:75397:0:(genops.c:1231:class_import_get()) import ffff9c2450097000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1784290442.407495:0:75397:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c0251ab3] to pc [ptlrpcd_00_03+3] req@ffff9c2468ab8000 x1870961901187712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290442.407541:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:0.0:1784290442.407565:0:3619:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2468ab8000 x1870961901187712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290442.407579:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901187712:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1784290442.407619:0:3619:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2468ab8000 x1870961901187712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784290458 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290442.407626:0:3619:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784290442.407679:0:3619:0:(events.c:337:request_in_callback()) incoming req@ffff9c246ddf2680 x1870961901187712 msgsize 224 00000100:00100000:0.0:1784290442.407683:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784290442.407713:0:3619:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2468ab8000 x1870961901187712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784290458 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290442.407730:0:3619:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 1360 usecs (2 jiffies) 00000100:00100000:2.0:1784290442.407748:0:26373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901187712 00000100:00100000:2.0:1784290442.407761:0:26373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901187712 00000020:00000040:2.0:1784290442.407778:0:26373:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b306f1c1 00000020:00000040:2.0:1784290442.407784:0:26373:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2342c84000 refcount=5 00000020:00000040:2.0:1784290442.407806:0:26373:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9c2342163380) now 10 - evictor 00000100:00000040:2.0:1784290442.407838:0:26373:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:2.0:1784290442.407887:0:26373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00000040:2.0:1784290442.407892:0:26373:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2342c84000 : new rpc_count 1 00000100:00080000:3.0:1784290442.407900:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00000040:2.0:1784290442.407900:0:26373:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246ddf2680 x1870961901187712/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:463/0 lens 224/0 e 0 to 0 dl 1784290453 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784290442.407910:0:6484:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9c2342163380) now 10 - evictor 00000100:00100000:2.0:1784290442.407917:0:26373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ddf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901187712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1784290442.407959:0:26373:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00010000:00000040:2.0:1784290442.407972:0:26373:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968618, transno 0, xid 1870961901187712 00000100:00000040:2.0:1784290442.407985:0:26373:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 52 to 0@lo 00000100:00000040:2.0:1784290442.407991:0:26373:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290442.408013:0:26373:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9c2468ab8000 x1870961901187712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784290458 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290442.408039:0:26373:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 51 to 0@lo 00000100:00000040:2.0:1784290442.408044:0:26373:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf2680 x1870961901187712/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:463/0 lens 224/368 e 0 to 0 dl 1784290453 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290442.408053:0:26373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ddf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901187712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 140us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290442.408059:0:26373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00000040:2.0:1784290442.408062:0:26373:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2342c84000 : new rpc_count 0 00000100:00000040:0.0:1784290442.408071:0:3619:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968618 00000020:00000040:2.0:1784290442.408076:0:26373:0:(genops.c:900:class_export_put()) PUTting export ffff9c2342c84000 : new refcount 4 00000100:00000040:0.0:1784290442.408081:0:3619:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2468ab8000 x1870961901187712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784290458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1784290442.408092:0:3619:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:0.0:1784290442.408095:0:3619:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:0.0:1784290442.408103:0:3619:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468ab8000 x1870961901187712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784290458 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290442.408110:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901187712:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1784290442.408115:0:3619:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2468ab8000 x1870961901187712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784290458 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784290442.408125:0:3619:0:(genops.c:1244:class_import_put()) import ffff9c2450097000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00010000:00010000:3.0:1784290442.920463:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1784290443.253918:0:96622:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784290443.253922:0:96622:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1784290443.253923:0:96622:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1784290443.254023:0:96622:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9c234479f800 00000020:01000004:0.0:1784290443.254039:0:96622:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1784290443.254060:0:96622:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1784290443.254074:0:96622:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c247d26cd40) 00000020:00000040:0.0:1784290443.254082:0:96622:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c234479d800 with handle 0x5953bbf6b3076215 to hash 00000020:00000040:0.0:1784290443.254088:0:96622:0:(genops.c:900:class_export_put()) PUTting export ffff9c234479d800 : new refcount 1 00000020:00000040:0.0:1784290443.254094:0:96622:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9c247d26cd40) now 2 - obd_device_list 00000020:00000080:0.0:1784290443.254099:0:96622:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00000001:00000040:2.0:1784290443.371935:0:96622:0:(osd_compat.c:233:osd_last_rcvd_subdir_count()) read last_rcvd header, uuid = lustre-OST0000_UUID, subdir count = 32 00100000:10000000:2.0:1784290443.375597:0:96622:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1784290443.375681:0:96622:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1784290443.375701:0:96622:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1784290443.375719:0:96622:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1784290443.375745:0:96622:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1784290443.375763:0:96622:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1784290443.375780:0:96622:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1784290443.376546:0:96622:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000040:2.0:1784290443.376711:0:96622:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9c247d26cd40) now 3 - setup 00000020:00000080:2.0:1784290443.376716:0:96622:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1784290443.376729:0:96622:0:(osd_handler.c:8932:osd_obd_connect()) connect #0 00000020:00000040:2.0:1784290443.376736:0:96622:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c23417dd000 with handle 0x5953bbf6b307621c to hash 00000020:00000040:2.0:1784290443.376741:0:96622:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9c247d26cd40) now 4 - export 00000020:00000040:2.0:1784290443.376745:0:96622:0:(genops.c:900:class_export_put()) PUTting export ffff9c23417dd000 : new refcount 1 00000020:00000080:2.0:1784290443.376747:0:96622:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5953bbf6b307621c 00000020:00000040:2.0:1784290443.376750:0:96622:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307621c 00000020:00000040:2.0:1784290443.376752:0:96622:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c23417dd000 refcount=2 00000020:01000004:2.0:1784290443.376757:0:96622:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1784290443.376783:0:96622:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.106@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784290443.376787:0:96622:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784290443.376793:0:96622:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1784290443.376822:0:96622:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1784290443.376827:0:96622:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000020:00000040:2.0:1784290443.377308:0:96622:0:(genops.c:889:class_export_get()) GET export ffff9c234479d800 refcount=2 00000040:00000040:2.0:1784290443.377313:0:96622:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c23422e1780 : new refcount 2 00000040:00000040:2.0:1784290443.378087:0:96622:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9c23422e1780 : new refcount 1 00000040:01000000:2.0:1784290443.378090:0:96622:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.106@tcp ctxt 0 is initialized 10000000:00000040:2.0:1784290443.378093:0:96622:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c23422e1780 : new refcount 2 10000000:00000040:2.0:1784290443.378095:0:96622:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9c23422e1780 : new refcount 1 00000020:00000040:2.0:1784290443.378097:0:96622:0:(obd_config.c:994:class_incref()) incref MGC192.168.202.106@tcp (ffff9c2480260000) now 6 - mgc_fs 00000020:01000004:2.0:1784290443.378123:0:96622:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.106@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1784290443.378126:0:96622:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1784290443.378128:0:96622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784290443.378129:0:96622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784290443.378130:0:96622:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784290443.378134:0:96622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784290443.378135:0:96622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784290443.378136:0:96622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784290443.378137:0:96622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784290443.378138:0:96622:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1784290443.378140:0:96622:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1784290443.378142:0:96622:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784290443.378143:0:96622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784290443.378144:0:96622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784290443.378144:0:96622:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784290443.378145:0:96622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784290443.378146:0:96622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784290443.378146:0:96622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784290443.378147:0:96622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784290443.378148:0:96622:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:00000040:2.0:1784290443.378154:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 10000000:01000000:2.0:1784290443.378183:0:96622:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:2.0:1784290443.378205:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2468abb480 x1870961901187840/t0(0) o253->MGC192.168.202.106@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.378218:0:96622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901187840:0@lo:253:mount.lustre.0 00000100:00000040:2.0:1784290443.378250:0:96622:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2468abb480 x1870961901187840/t0(0) o253->MGC192.168.202.106@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784290459 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.378257:0:96622:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290443.378310:0:96622:0:(events.c:337:request_in_callback()) incoming req@ffff9c246a4fe850 x1870961901187840 msgsize 4848 00000100:00100000:2.0:1784290443.378314:0:96622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784290443.378315:0:96622:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784290443.378354:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2468abb480 x1870961901187840/t0(0) o253->MGC192.168.202.106@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784290459 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.378395:0:96622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345844f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784290443.378405:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901187840 00000100:00100000:1.0:1784290443.378422:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901187840 00000020:00000040:1.0:1784290443.378426:0:94062:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:1.0:1784290443.378431:0:94062:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=21 00000100:00000040:1.0:1784290443.378460:0:94062:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784290443.378508:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00000040:1.0:1784290443.378513:0:94062:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:1.0:1784290443.378538:0:94062:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246a4fe850 x1870961901187840/t0(0) o253->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 4848/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.378554:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:96622:x1870961901187840:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784290443.378597:0:94062:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1784290443.378602:0:94062:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1784290443.378609:0:94062:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00000040:1.0:1784290443.378889:0:94062:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901187840 00000100:00000040:1.0:1784290443.378907:0:94062:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 52 to 0@lo 00000100:00000040:1.0:1784290443.378916:0:94062:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290443.378979:0:94062:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff9c2468abb480 x1870961901187840/t0(0) o253->MGC192.168.202.106@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.379017:0:94062:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 51 to 0@lo 00000100:00000040:1.0:1784290443.379026:0:94062:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246a4fe850 x1870961901187840/t0(0) o253->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 4848/4768 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.379039:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:96622:x1870961901187840:12345-0@lo:253:mount.lustre.0 Request processed in 485us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290443.379048:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00000040:1.0:1784290443.379052:0:94062:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000100:00000040:2.0:1784290443.379057:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2468abb480 x1870961901187840/t0(0) o253->MGC192.168.202.106@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.379067:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468abb480 x1870961901187840/t0(0) o253->MGC192.168.202.106@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784290459 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784290443.379071:0:94062:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 20 00000100:00100000:2.0:1784290443.379086:0:96622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901187840:0@lo:253:mount.lustre.0 00000100:00000040:2.0:1784290443.379097:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2468abb480 x1870961901187840/t0(0) o253->MGC192.168.202.106@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784290459 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1784290443.379109:0:96622:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1784290443.379112:0:96622:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784290443.379113:0:96622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784290443.379114:0:96622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784290443.379115:0:96622:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784290443.379116:0:96622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784290443.379117:0:96622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784290443.379118:0:96622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784290443.379119:0:96622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784290443.379121:0:96622:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000100:00000040:2.0:1784290443.379123:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2468abb480 x1870961901187840/t0(0) o253->MGC192.168.202.106@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.379136:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 00000020:01000004:2.0:1784290443.379152:0:96622:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c234479f800 from lustre-OST0000 10000000:01000000:2.0:1784290443.379173:0:96622:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1784290443.379176:0:96622:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:00000040:2.0:1784290443.379186:0:96622:0:(mgc_request.c:108:config_log_get()) log lustre-sptlrpc (ffff9c245fd43600) refs 5 10000000:01000000:2.0:1784290443.379189:0:96622:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c2480260000 local copy 00000020:00000040:2.0:1784290443.379194:0:96622:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c24414b9400 refcount=2 00010000:00010000:2.0:1784290443.379203:0:96622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b9400/0x5953bbf6b307583d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075844 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:2.0:1784290443.379224:0:96622:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c24587c6e40 : new refcount 2 10000000:00000040:2.0:1784290443.379226:0:96622:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c23422e1780 : new refcount 2 10000000:00000040:2.0:1784290443.379228:0:96622:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.202.106@tcp: copy local log lustre-sptlrpc 00000020:00000040:2.0:1784290443.379252:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:2.0:1784290443.379255:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=5 obd=MGC192.168.202.106@tcp 00000100:00000040:2.0:1784290443.379274:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2468abb480 x1870961901187968/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.379281:0:96622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901187968:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1784290443.379292:0:96622:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2468abb480 x1870961901187968/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.379298:0:96622:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290443.379315:0:96622:0:(events.c:337:request_in_callback()) incoming req@ffff9c246a4fe450 x1870961901187968 msgsize 512 00000100:00100000:2.0:1784290443.379318:0:96622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784290443.379320:0:96622:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784290443.379336:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2468abb480 x1870961901187968/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.379376:0:96622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345844600 going to sleep for 11 seconds 00000100:00100000:1.0:1784290443.379390:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901187968 00000100:00100000:1.0:1784290443.379399:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901187968 00000020:00000040:1.0:1784290443.379401:0:94060:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:1.0:1784290443.379405:0:94060:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=21 00000100:00000040:1.0:1784290443.379419:0:94060:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784290443.379459:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00000040:1.0:1784290443.379464:0:94060:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:1.0:1784290443.379473:0:94060:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246a4fe450 x1870961901187968/t0(0) o501->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 512/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.379529:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:96622:x1870961901187968:12345-0@lo:501:mount.lustre.0 00000040:00000040:1.0:1784290443.379551:0:94060:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-sptlrpc 00000040:00000040:1.0:1784290443.379556:0:94060:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c247d2fc6c0 : new refcount 2 00000040:00000040:1.0:1784290443.379599:0:94060:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9c247d2fc6c0 : new refcount 1 00010000:00000040:1.0:1784290443.379604:0:94060:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901187968 00000100:00000040:1.0:1784290443.379610:0:94060:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 52 to 0@lo 00000100:00000040:1.0:1784290443.379614:0:94060:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290443.379639:0:94060:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9c2468abb480 x1870961901187968/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.379665:0:94060:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 51 to 0@lo 00000100:00000040:1.0:1784290443.379672:0:94060:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246a4fe450 x1870961901187968/t0(0) o501->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 512/272 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.379682:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:96622:x1870961901187968:12345-0@lo:501:mount.lustre.0 Request processed in 158us (363us total) trans 0 rc -2/-2 00000100:00000040:2.0:1784290443.379695:0:96622:0:(client.c:1497:ptlrpc_check_status()) @@@ check status: rc = -2 req@ffff9c2468abb480 x1870961901187968/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQU/200/0 rc 0/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.379696:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00000040:1.0:1784290443.379707:0:94060:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000100:00000040:2.0:1784290443.379723:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2468abb480 x1870961901187968/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784290443.379723:0:94060:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 20 00000100:00000040:2.0:1784290443.379740:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468abb480 x1870961901187968/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 2 fl Interpret:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.379747:0:96622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901187968:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1784290443.379753:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2468abb480 x1870961901187968/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 2 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.379761:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000100:00000040:2.0:1784290443.379764:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2468abb480 x1870961901187968/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.379773:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 10000000:01000000:2.0:1784290443.379778:0:96622:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1784290443.379801:0:96622:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00000020:00000040:2.0:1784290443.379805:0:96622:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c24414b9400 refcount=3 00010000:00010000:2.0:1784290443.379809:0:96622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c24414b9400/0x5953bbf6b307583d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075844 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290443.379816:0:96622:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c24414b9400/0x5953bbf6b307583d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3075844 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290443.379834:0:96622:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c234479f800 10000000:01000000:2.0:1784290443.379838:0:96622:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00000020:00000040:2.0:1784290443.379841:0:96622:0:(genops.c:889:class_export_get()) GET export ffff9c2447ca9800 refcount=18 10000000:00000040:2.0:1784290443.379843:0:96622:0:(mgc_request.c:108:config_log_get()) log nodemap (ffff9c246d500200) refs 4 10000000:01000000:2.0:1784290443.379844:0:96622:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1784290443.379846:0:96622:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:2.0:1784290443.379848:0:96622:0:(genops.c:889:class_export_get()) GET export ffff9c2447ca9800 refcount=19 10000000:01000000:2.0:1784290443.379851:0:96622:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1784290443.379854:0:96622:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000020:00000040:2.0:1784290443.379857:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00010000:00000040:2.0:1784290443.379883:0:96622:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c246de62000 count: 8 00000020:00000040:2.0:1784290443.379889:0:96622:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c23450ab000 with handle 0x5953bbf6b3076223 to hash 00010000:00010000:2.0:1784290443.379893:0:96622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3076223 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290443.379899:0:96622:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3076223 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290443.379908:0:96622:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3076223 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784290443.379916:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2468abb480 x1870961901188096/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.379932:0:96622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901188096:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1784290443.379943:0:96622:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2468abb480 x1870961901188096/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290459 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.379948:0:96622:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290443.379965:0:96622:0:(events.c:337:request_in_callback()) incoming req@ffff9c246dde1c50 x1870961901188096 msgsize 328 00000100:00100000:2.0:1784290443.379968:0:96622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784290443.379969:0:96622:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784290443.379985:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2468abb480 x1870961901188096/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290459 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.379993:0:96622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345844600 going to sleep for 11 seconds 00000100:00100000:1.0:1784290443.380024:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901188096 00000100:00100000:1.0:1784290443.380031:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901188096 00000020:00000040:1.0:1784290443.380033:0:94059:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:1.0:1784290443.380037:0:94059:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=21 00000100:00000040:1.0:1784290443.380048:0:94059:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784290443.380074:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00000040:1.0:1784290443.380078:0:94059:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:1.0:1784290443.380086:0:94059:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246dde1c50 x1870961901188096/t0(0) o101->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 328/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.380097:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dde1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+21:96622:x1870961901188096:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784290443.380115:0:94059:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:1.0:1784290443.380125:0:94059:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c2461f23300 count: 10 00000020:00000040:1.0:1784290443.380133:0:94059:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2474ea4200 with handle 0x5953bbf6b307622a to hash 00010000:00010000:1.0:1784290443.380139:0:94059:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c2474ea4200/0x5953bbf6b307622a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3076223 expref: -99 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784290443.380148:0:94059:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9c2475c4c800 : new locks_count 16 00000020:00000040:1.0:1784290443.380150:0:94059:0:(genops.c:889:class_export_get()) GET export ffff9c2475c4c800 refcount=22 00010000:00000040:1.0:1784290443.380168:0:94059:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9c2461f23300) refcount = 10 00010000:00000040:1.0:1784290443.380173:0:94059:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1784290443.380178:0:94059:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c234236ca00/0x5953bbf6b3075844 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307583d expref: 22 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784290443.380191:0:94059:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b307581a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075813 expref: 22 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784290443.380201:0:94059:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c234236d400/0x5953bbf6b307580c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075805 expref: 22 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784290443.380211:0:94059:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c23450ab200/0x5953bbf6b30757fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30757f7 expref: 22 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784290443.380222:0:94059:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c234236dc00/0x5953bbf6b30757f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30757e9 expref: 22 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784290443.380232:0:94059:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c246dd26800/0x5953bbf6b30757e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30757db expref: 22 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784290443.380243:0:94059:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c234236d600/0x5953bbf6b30757d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30757cd expref: 22 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784290443.380258:0:94059:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c24414b8200/0x5953bbf6b30757c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b260e expref: 9 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784290443.380279:0:94059:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c234236d200/0x5953bbf6b30757bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2607 expref: 9 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290443.380286:0:94059:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2474ea4200/0x5953bbf6b307622a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3076223 expref: 22 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290443.380298:0:94059:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c2474ea4200/0x5953bbf6b307622a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3076223 expref: 22 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290443.380307:0:94059:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c2474ea4200, rc 0) 00010000:00000040:1.0:1784290443.380310:0:94059:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901188096 00000100:00000040:1.0:1784290443.380316:0:94059:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 52 to 0@lo 00000100:00000040:1.0:1784290443.380320:0:94059:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290443.380382:0:94059:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9c2468abb480 x1870961901188096/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.380407:0:94059:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 51 to 0@lo 00000100:00000040:1.0:1784290443.380413:0:94059:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246dde1c50 x1870961901188096/t0(0) o101->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 328/344 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.380427:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dde1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:96622:x1870961901188096:12345-0@lo:101:mount.lustre.0 Request processed in 327us (455us total) trans 0 rc 0/0 00000100:00000040:2.0:1784290443.380432:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2468abb480 x1870961901188096/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.380452:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00000040:2.0:1784290443.380465:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468abb480 x1870961901188096/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290459 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.380466:0:94059:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000100:00100000:2.0:1784290443.380484:0:96622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901188096:0@lo:101:mount.lustre.0 00000020:00000040:1.0:1784290443.380485:0:94059:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 21 00000100:00000040:2.0:1784290443.380505:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2468abb480 x1870961901188096/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290459 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.380515:0:96622:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c23450ab000 refcount=4 00010000:00000040:2.0:1784290443.380519:0:96622:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9c23450ab000, remote cookie: 0x5953bbf6b307622a, flags: 0x0 00010000:00000040:2.0:1784290443.380526:0:96622:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9c246de62000) refcount = 8 00010000:00000040:2.0:1784290443.380529:0:96622:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1784290443.380532:0:96622:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.106@tcp lock: ffff9c24414b9400/0x5953bbf6b307583d lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075844 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784290443.380537:0:96622:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.106@tcp lock: ffff9c24414b9a00/0x5953bbf6b3075813 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307581a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784290443.380552:0:96622:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.106@tcp lock: ffff9c24414b8e00/0x5953bbf6b3075805 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307580c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784290443.380557:0:96622:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.106@tcp lock: ffff9c24414b9800/0x5953bbf6b30757f7 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30757fe expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784290443.380561:0:96622:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.106@tcp lock: ffff9c24414b9000/0x5953bbf6b30757e9 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30757f0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784290443.380564:0:96622:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.106@tcp lock: ffff9c24414b8c00/0x5953bbf6b30757db lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30757e2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784290443.380568:0:96622:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.106@tcp lock: ffff9c24414b9e00/0x5953bbf6b30757cd lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30757d4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290443.380572:0:96622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3076223 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307622a expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290443.380580:0:96622:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3076223 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307622a expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784290443.380587:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2468abb480 x1870961901188096/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.380592:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 10000000:00000040:2.0:1784290443.380596:0:96622:0:(mgc_request.c:108:config_log_get()) log lustre-OST0000 (ffff9c246873b400) refs 2 00000020:00000040:2.0:1784290443.380598:0:96622:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c23450ab000 refcount=3 10000000:00000040:2.0:1784290443.380613:0:96622:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c24587c6e40 : new refcount 2 10000000:00000040:2.0:1784290443.380615:0:96622:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c23422e1780 : new refcount 2 10000000:00000040:2.0:1784290443.380616:0:96622:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.202.106@tcp: copy local log lustre-OST0000 00000040:00080000:2.0:1784290443.380715:0:96622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1784290443.380948:0:96622:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784290443.381826:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1784290443.381847:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1784290443.381856:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1784290443.381879:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1784290443.381889:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1784290443.381898:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1784290443.381910:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1784290443.381913:0:96622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000020:00000040:2.0:1784290443.381938:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:2.0:1784290443.381941:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=5 obd=MGC192.168.202.106@tcp 00000100:00000040:2.0:1784290443.381954:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2468abb480 x1870961901188224/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.381961:0:96622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901188224:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1784290443.381972:0:96622:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2468abb480 x1870961901188224/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.381977:0:96622:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290443.381993:0:96622:0:(events.c:337:request_in_callback()) incoming req@ffff9c246dde2050 x1870961901188224 msgsize 512 00000100:00100000:2.0:1784290443.381997:0:96622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784290443.381998:0:96622:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784290443.382013:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2468abb480 x1870961901188224/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.382026:0:96622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345844900 going to sleep for 11 seconds 00000100:00100000:1.0:1784290443.382071:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901188224 00000100:00100000:1.0:1784290443.382080:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901188224 00000020:00000040:1.0:1784290443.382082:0:94058:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:1.0:1784290443.382086:0:94058:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=22 00000100:00000040:1.0:1784290443.382102:0:94058:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784290443.382151:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00000040:1.0:1784290443.382157:0:94058:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:1.0:1784290443.382166:0:94058:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246dde2050 x1870961901188224/t0(0) o501->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 512/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.382188:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dde2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:96622:x1870961901188224:12345-0@lo:501:mount.lustre.0 00000040:00000040:1.0:1784290443.382206:0:94058:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-OST0000 00000040:00000040:1.0:1784290443.382208:0:94058:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c247d2fc6c0 : new refcount 2 00000040:00000040:1.0:1784290443.382266:0:94058:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9c247d2fc6c0 : new refcount 1 00000020:00000040:1.0:1784290443.382276:0:94058:0:(genops.c:889:class_export_get()) GET export ffff9c2475c4c800 refcount=23 00000020:00000040:1.0:1784290443.382280:0:94058:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 22 00010000:00000040:1.0:1784290443.382286:0:94058:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901188224 00000100:00000040:1.0:1784290443.382294:0:94058:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 52 to 0@lo 00000100:00000040:1.0:1784290443.382301:0:94058:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290443.382336:0:94058:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9c2468abb480 x1870961901188224/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.382430:0:94058:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 51 to 0@lo 00000100:00000040:1.0:1784290443.382443:0:94058:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246dde2050 x1870961901188224/t0(0) o501->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 512/272 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.382458:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dde2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:96622:x1870961901188224:12345-0@lo:501:mount.lustre.0 Request processed in 271us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290443.382469:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00000040:1.0:1784290443.382472:0:94058:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000020:00000040:1.0:1784290443.382492:0:94058:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 21 00000100:00000040:2.0:1784290443.382538:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2468abb480 x1870961901188224/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.382548:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468abb480 x1870961901188224/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.382554:0:96622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901188224:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1784290443.382567:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2468abb480 x1870961901188224/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.382575:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000100:00000040:2.0:1784290443.382578:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2468abb480 x1870961901188224/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.382583:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 00000020:00000040:2.0:1784290443.382589:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:2.0:1784290443.382592:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=5 obd=MGC192.168.202.106@tcp 00000100:00000040:2.0:1784290443.382602:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2468abb480 x1870961901188352/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.382608:0:96622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901188352:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1784290443.382630:0:96622:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2468abb480 x1870961901188352/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784290459 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.382635:0:96622:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290443.382652:0:96622:0:(events.c:337:request_in_callback()) incoming req@ffff9c246dde0450 x1870961901188352 msgsize 272 00000100:00100000:2.0:1784290443.382655:0:96622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784290443.382656:0:96622:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784290443.382672:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2468abb480 x1870961901188352/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784290459 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.382685:0:96622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345844900 going to sleep for 11 seconds 00000100:00100000:1.0:1784290443.382725:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901188352 00000100:00100000:1.0:1784290443.382734:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901188352 00000020:00000040:1.0:1784290443.382737:0:94062:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:1.0:1784290443.382742:0:94062:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=22 00000100:00000040:1.0:1784290443.382759:0:94062:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784290443.382796:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00000040:1.0:1784290443.382809:0:94062:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:1.0:1784290443.382817:0:94062:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246dde0450 x1870961901188352/t0(0) o503->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 272/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.382830:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dde0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:96622:x1870961901188352:12345-0@lo:503:mount.lustre.0 00000040:00000040:1.0:1784290443.382855:0:94062:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c247d2fc6c0 : new refcount 2 00000040:00000040:1.0:1784290443.382905:0:94062:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9c247d2fc6c0 : new refcount 1 00010000:00000040:1.0:1784290443.382909:0:94062:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901188352 00000100:00000040:1.0:1784290443.382916:0:94062:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 52 to 0@lo 00000100:00000040:1.0:1784290443.382920:0:94062:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290443.382948:0:94062:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff9c2468abb480 x1870961901188352/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.382979:0:94062:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 51 to 0@lo 00000100:00000040:1.0:1784290443.382987:0:94062:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246dde0450 x1870961901188352/t0(0) o503->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 272/8416 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.382995:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2468abb480 x1870961901188352/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.383000:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dde0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:96622:x1870961901188352:12345-0@lo:503:mount.lustre.0 Request processed in 169us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290443.383030:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00000040:2.0:1784290443.383034:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468abb480 x1870961901188352/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784290459 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.383037:0:94062:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000100:00100000:2.0:1784290443.383052:0:96622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901188352:0@lo:503:mount.lustre.0 00000020:00000040:1.0:1784290443.383054:0:94062:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 21 00000100:00000040:2.0:1784290443.383074:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2468abb480 x1870961901188352/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784290459 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.383094:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2468abb480 x1870961901188352/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.383109:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:2.0:1784290443.383114:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 00000040:00080000:2.0:1784290443.383297:0:96622:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:2.0:1784290443.383318:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:2.0:1784290443.383321:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=5 obd=MGC192.168.202.106@tcp 00000100:00000040:2.0:1784290443.383333:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2468abb480 x1870961901188480/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.383359:0:96622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901188480:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1784290443.383378:0:96622:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2468abb480 x1870961901188480/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.383383:0:96622:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290443.383399:0:96622:0:(events.c:337:request_in_callback()) incoming req@ffff9c246dde1050 x1870961901188480 msgsize 272 00000100:00100000:2.0:1784290443.383402:0:96622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784290443.383403:0:96622:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784290443.383418:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2468abb480 x1870961901188480/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.383430:0:96622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345844600 going to sleep for 11 seconds 00000100:00100000:1.0:1784290443.383462:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901188480 00000100:00100000:1.0:1784290443.383470:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901188480 00000020:00000040:1.0:1784290443.383472:0:94060:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:1.0:1784290443.383475:0:94060:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=22 00000100:00000040:1.0:1784290443.383487:0:94060:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784290443.383512:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00000040:1.0:1784290443.383516:0:94060:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:1.0:1784290443.383522:0:94060:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246dde1050 x1870961901188480/t0(0) o502->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 272/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.383547:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dde1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:96622:x1870961901188480:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1784290443.383566:0:94060:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c247d2fc6c0 : new refcount 2 00000040:00000040:1.0:1784290443.383886:0:94060:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9c247d2fc6c0 : new refcount 1 00010000:00000040:1.0:1784290443.383891:0:94060:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901188480 00000100:00000040:1.0:1784290443.383897:0:94060:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 52 to 0@lo 00000100:00000040:1.0:1784290443.383901:0:94060:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290443.383928:0:94060:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9c2468abb480 x1870961901188480/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.383953:0:94060:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 51 to 0@lo 00000100:00000040:1.0:1784290443.383958:0:94060:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246dde1050 x1870961901188480/t0(0) o502->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 272/8472 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.383971:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dde1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:96622:x1870961901188480:12345-0@lo:502:mount.lustre.0 Request processed in 423us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290443.383982:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00000040:1.0:1784290443.383985:0:94060:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000100:00000040:2.0:1784290443.383992:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2468abb480 x1870961901188480/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784290443.383994:0:94060:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 21 00000100:00000040:2.0:1784290443.384012:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468abb480 x1870961901188480/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.384019:0:96622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901188480:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1784290443.384034:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2468abb480 x1870961901188480/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.384057:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2468abb480 x1870961901188480/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.384068:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:2.0:1784290443.384072:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 00000040:00080000:2.0:1784290443.384156:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1784290443.384173:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1784290443.384182:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1784290443.384193:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1784290443.384202:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1784290443.384210:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1784290443.384218:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1784290443.384227:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1784290443.384235:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1784290443.384243:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1784290443.384251:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1784290443.384259:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000020:00000040:2.0:1784290443.384264:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:2.0:1784290443.384266:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=5 obd=MGC192.168.202.106@tcp 00000100:00000040:2.0:1784290443.384277:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2468abb480 x1870961901188608/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.384284:0:96622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901188608:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1784290443.384301:0:96622:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2468abb480 x1870961901188608/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.384306:0:96622:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290443.384322:0:96622:0:(events.c:337:request_in_callback()) incoming req@ffff9c246dde3050 x1870961901188608 msgsize 272 00000100:00100000:2.0:1784290443.384324:0:96622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784290443.384326:0:96622:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784290443.384362:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2468abb480 x1870961901188608/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.384401:0:96622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345844600 going to sleep for 11 seconds 00000100:00100000:1.0:1784290443.384404:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901188608 00000100:00100000:1.0:1784290443.384414:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901188608 00000020:00000040:1.0:1784290443.384417:0:94059:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:1.0:1784290443.384421:0:94059:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=22 00000100:00000040:1.0:1784290443.384439:0:94059:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784290443.384471:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00000040:1.0:1784290443.384475:0:94059:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:1.0:1784290443.384482:0:94059:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246dde3050 x1870961901188608/t0(0) o502->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 272/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.384493:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dde3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:96622:x1870961901188608:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1784290443.384521:0:94059:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c247d2fc6c0 : new refcount 2 00000040:00000040:1.0:1784290443.384544:0:94059:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9c247d2fc6c0 : new refcount 1 00010000:00000040:1.0:1784290443.384547:0:94059:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901188608 00000100:00000040:1.0:1784290443.384553:0:94059:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 52 to 0@lo 00000100:00000040:1.0:1784290443.384557:0:94059:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290443.384584:0:94059:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9c2468abb480 x1870961901188608/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.384608:0:94059:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 51 to 0@lo 00000100:00000040:1.0:1784290443.384614:0:94059:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246dde3050 x1870961901188608/t0(0) o502->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 272/8472 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.384624:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dde3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:96622:x1870961901188608:12345-0@lo:502:mount.lustre.0 Request processed in 132us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290443.384631:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00000040:1.0:1784290443.384635:0:94059:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000100:00000040:2.0:1784290443.384639:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2468abb480 x1870961901188608/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784290443.384646:0:94059:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 21 00000100:00000040:2.0:1784290443.384650:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468abb480 x1870961901188608/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.384659:0:96622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901188608:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1784290443.384664:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2468abb480 x1870961901188608/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.384677:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2468abb480 x1870961901188608/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.384693:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:2.0:1784290443.384698:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 00000040:00080000:2.0:1784290443.384716:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1784290443.384721:0:96622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 10000000:00000040:2.0:1784290443.384825:0:96622:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9c24587c6e40 : new refcount 1 00000020:00000040:2.0:1784290443.384829:0:96622:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-OST0000 00000020:01000000:2.0:1784290443.385063:0:96626:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784290443.385069:0:96626:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1784290443.385075:0:96626:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290443.385077:0:96626:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1784290443.385081:0:96626:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784290443.385093:0:96626:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c2445c14d40) 00000020:00000040:2.0:1784290443.385098:0:96626:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c234687a000 with handle 0x5953bbf6b3076231 to hash 00000020:00000040:2.0:1784290443.385102:0:96626:0:(genops.c:900:class_export_put()) PUTting export ffff9c234687a000 : new refcount 1 00000020:00000040:2.0:1784290443.385110:0:96626:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2445c14d40) now 2 - obd_device_list 00000020:00000080:2.0:1784290443.385114:0:96626:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000040:2.0:1784290443.385117:0:96626:0:(obd_config.c:1948:class_config_llog_handler()) For 1.8 interoperability, set this index to '0' 00000020:00000080:2.0:1784290443.385124:0:96626:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784290443.385184:0:96626:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c234479f800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1784290443.385189:0:96626:0:(osd_handler.c:8932:osd_obd_connect()) connect #1 00000020:00000040:2.0:1784290443.385192:0:96626:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c246dce3000 with handle 0x5953bbf6b3076238 to hash 00000020:00000040:2.0:1784290443.385194:0:96626:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9c247d26cd40) now 5 - export 00000020:00000040:2.0:1784290443.385196:0:96626:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce3000 : new refcount 1 00000020:00000080:2.0:1784290443.385198:0:96626:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5953bbf6b3076238 00000020:00000040:2.0:1784290443.385199:0:96626:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3076238 00000020:00000040:2.0:1784290443.385201:0:96626:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce3000 refcount=2 00010000:00010000:2.0:1784290443.387934:0:96626:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00000040:2.0:1784290443.387942:0:96626:0:(obd_cksum.c:33:obd_cksum_types_supported_server()) lustre-OST0000: checksum speed: crc 1935, crc32c 12575, adler 1683, t10ip512 7643, t10ip4k 8271, t10crc512 1663, t10crc4k 1915 00002000:00000040:2.0:1784290443.387970:0:96626:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xb:0x0] 00000001:00000040:2.0:1784290443.387995:0:96626:0:(tgt_lastrcvd.c:685:tgt_server_data_read()) lustre-OST0000: read last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968631: rc = 0 00000001:00000040:2.0:1784290443.387999:0:96626:0:(tgt_lastrcvd.c:1991:tgt_server_data_init()) lustre-OST0000: restored maximum client count: 0 00000001:00000040:2.0:1784290443.388005:0:96626:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8320 uuid = lustre-MDT0001-mdtlov_UUID, last_transno = 4294968631, last_xid = 1870961901127424, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:2.0:1784290443.388010:0:96626:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 0 lr: 4294968631 srv lr: 4294968631 lx: 1870961901127424 gen 0 00000020:00000040:2.0:1784290443.388014:0:96626:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c246dce1000 with handle 0x5953bbf6b307623f to hash 00000020:00000040:2.0:1784290443.388028:0:96626:0:(genops.c:889:class_export_get()) GET export ffff9c246dce1000 refcount=3 00000020:00000040:2.0:1784290443.388031:0:96626:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2445c14d40) now 3 - export 00000001:00000040:2.0:1784290443.388035:0:96626:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 0 with UUID 'lustre-MDT0001-mdtlov_UUID' added, generation 0 00000020:00000040:2.0:1784290443.388037:0:96626:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce1000 : new refcount 2 00000001:00000040:2.0:1784290443.388041:0:96626:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8448 uuid = lustre-MDT0000-mdtlov_UUID, last_transno = 4294968649, last_xid = 1870961901182336, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:2.0:1784290443.388044:0:96626:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 1 lr: 4294968649 srv lr: 4294968631 lx: 1870961901182336 gen 0 00000020:00000040:2.0:1784290443.388048:0:96626:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c246dce2000 with handle 0x5953bbf6b3076246 to hash 00000020:00000040:2.0:1784290443.388055:0:96626:0:(genops.c:889:class_export_get()) GET export ffff9c246dce2000 refcount=3 00000020:00000040:2.0:1784290443.388056:0:96626:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2445c14d40) now 4 - export 00000001:00000040:2.0:1784290443.388062:0:96626:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 1 with UUID 'lustre-MDT0000-mdtlov_UUID' added, generation 0 00000020:00000040:2.0:1784290443.388064:0:96626:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce2000 : new refcount 2 00000001:00000040:2.0:1784290443.388067:0:96626:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8576 uuid = , last_transno = 0, last_xid = 0, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00000040:2.0:1784290443.388070:0:96626:0:(tgt_lastrcvd.c:1736:tgt_clients_data_init()) skipping zeroed client at offset 2 00000001:00000040:2.0:1784290443.388072:0:96626:0:(tgt_lastrcvd.c:525:tgt_client_data_read()) lustre-OST0000: read lcd @8704 uuid = 711f3c77-e791-4aa8-86ee-bc854fd0bcc5, last_transno = 4294968653, last_xid = 1870961896306432, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:2.0:1784290443.388075:0:96626:0:(tgt_lastrcvd.c:1748:tgt_clients_data_init()) RCVRNG CLIENT uuid: 711f3c77-e791-4aa8-86ee-bc854fd0bcc5 idx: 3 lr: 4294968653 srv lr: 4294968631 lx: 1870961896306432 gen 0 00000020:00000040:2.0:1784290443.388079:0:96626:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c246dce7800 with handle 0x5953bbf6b307624d to hash 00000020:00000040:2.0:1784290443.388086:0:96626:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=3 00000020:00000040:2.0:1784290443.388087:0:96626:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2445c14d40) now 5 - export 00000001:00000040:2.0:1784290443.388089:0:96626:0:(tgt_lastrcvd.c:1172:tgt_client_add()) lustre-OST0000: client at idx 3 with UUID '711f3c77-e791-4aa8-86ee-bc854fd0bcc5' added, generation 0 00000020:00000040:2.0:1784290443.388090:0:96626:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 2 00000001:00000004:2.0:1784290443.388093:0:96626:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294968653 00000001:00000040:2.0:1784290443.388109:0:96626:0:(tgt_lastrcvd.c:707:tgt_server_data_write()) lustre-OST0000: write last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968653: rc = 0 00000001:00000040:2.0:1784290443.388116:0:96626:0:(tgt_lastrcvd.c:761:tgt_server_data_update()) lustre-OST0000: update last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294968653: rc = 0 00002000:00000040:2.0:1784290443.388127:0:96626:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x5:0x0] 40000000:00000040:2.0:1784290443.388148:0:96626:0:(fid_store.c:167:seq_store_read()) srv-lustre-OST0000: Space - [0x0000000280000402-0x00000002c0000400]:0:ost 40000000:00000040:2.0:1784290443.388193:0:96626:0:(fid_handler.c:58:seq_server_set_cli()) srv-lustre-OST0000: Attached sequence controller cli-lustre-OST0000-super 80000000:00000040:2.0:1784290443.388200:0:96626:0:(fld_cache.c:66:fld_cache_init()) srv-lustre-OST0000: FLD cache - Size: 74898, Threshold: 7489 00002000:00000040:2.0:1784290443.388205:0:96626:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x3:0x0] 80000000:00000040:2.0:1784290443.388231:0:96626:0:(fld_cache.c:417:fld_cache_insert_nolock()) insert range [0x0000000280000400-0x00000002c0000400]:0:ost 80000000:00000040:2.0:1784290443.388239:0:96626:0:(fld_handler.c:101:fld_name_to_index()) get index from srv-lustre-OST0000 00002000:00000040:2.0:1784290443.388267:0:96626:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x1018:0x0] 00002000:00000040:2.0:1784290443.388277:0:96626:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x101e:0x0] 00002000:00000040:2.0:1784290443.388300:0:96626:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xd:0x0] 00000001:00000040:2.0:1784290443.388321:0:96626:0:(nodemap_storage.c:303:nodemap_cache_find_create()) removing old index, creating new one 00002000:00000040:2.0:1784290443.388334:0:96626:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x2:0x0] 00002000:00000040:2.0:1784290443.388458:0:96626:0:(ofd_dev.c:466:ofd_object_free()) object free, fid = [0x200000003:0x2:0x0] 00080000:10000000:2.0:1784290443.388578:0:96626:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000040:2.0:1784290443.389258:0:96626:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2445c14d40) now 6 - setup 00000020:00000080:2.0:1784290443.389261:0:96626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1784290443.389264:0:96626:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784290443.389268:0:96626:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290443.389269:0:96626:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1784290443.389272:0:96626:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784290443.389274:0:96626:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1784290443.389275:0:96626:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784290443.389276:0:96626:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784290443.389277:0:96626:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784290443.389279:0:96626:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290443.389279:0:96626:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784290443.389281:0:96626:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784290443.389282:0:96626:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290443.389283:0:96626:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784290443.389285:0:96626:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784290443.389286:0:96626:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784290443.389288:0:96626:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784290443.389289:0:96626:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290443.389290:0:96626:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784290443.389291:0:96626:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784290443.389293:0:96626:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290443.389294:0:96626:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784290443.389295:0:96626:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1784290443.389306:0:96626:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784290443.389308:0:96626:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784290443.389309:0:96626:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784290443.389311:0:96626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1784290443.389401:0:96622:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1784290443.389473:0:96622:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00000020:00000040:1.0:1784290443.389490:0:96622:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c23450ab000 refcount=3 00010000:00010000:1.0:1784290443.389499:0:96622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3076223 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307622a expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290443.389515:0:96622:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3076223 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307622a expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290443.389530:0:96622:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9c234479f800 from 1 10000000:01000000:1.0:1784290443.389534:0:96622:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000020:00000040:1.0:1784290443.389544:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00010000:00000040:1.0:1784290443.389569:0:96622:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c244ab48100 count: 4 00000020:00000040:1.0:1784290443.389591:0:96622:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2474ea4000 with handle 0x5953bbf6b3076254 to hash 00010000:00010000:1.0:1784290443.389598:0:96622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2474ea4000/0x5953bbf6b3076254 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290443.389606:0:96622:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c2474ea4000/0x5953bbf6b3076254 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290443.389615:0:96622:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c2474ea4000/0x5953bbf6b3076254 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1784290443.389634:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c24483ce680 x1870961901188736/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.389648:0:96622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901188736:0@lo:101:mount.lustre.0 00000100:00000040:1.0:1784290443.389668:0:96622:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c24483ce680 x1870961901188736/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290459 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.389681:0:96622:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290443.389704:0:96622:0:(events.c:337:request_in_callback()) incoming req@ffff9c2474e89c50 x1870961901188736 msgsize 328 00000100:00100000:1.0:1784290443.389709:0:96622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784290443.389711:0:96622:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1784290443.389733:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c24483ce680 x1870961901188736/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290459 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.389749:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901188736 00000100:00100000:2.0:1784290443.389756:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901188736 00000020:00000040:2.0:1784290443.389758:0:94058:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:2.0:1784290443.389762:0:94058:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=22 00000100:00100000:1.0:1784290443.389769:0:96622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341713900 going to sleep for 11 seconds 00000100:00000040:2.0:1784290443.389779:0:94058:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784290443.389813:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00000040:2.0:1784290443.389817:0:94058:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:2.0:1784290443.389823:0:94058:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2474e89c50 x1870961901188736/t0(0) o101->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 328/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.389836:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:96622:x1870961901188736:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784290443.389848:0:94058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:2.0:1784290443.389855:0:94058:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c2442ffec00 count: 5 00000020:00000040:2.0:1784290443.389876:0:94058:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c23450aa200 with handle 0x5953bbf6b307625b to hash 00010000:00010000:2.0:1784290443.389881:0:94058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c23450aa200/0x5953bbf6b307625b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3076254 expref: -99 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784290443.389890:0:94058:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9c2475c4c800 : new locks_count 17 00000020:00000040:2.0:1784290443.389893:0:94058:0:(genops.c:889:class_export_get()) GET export ffff9c2475c4c800 refcount=23 00010000:00000040:2.0:1784290443.389907:0:94058:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff9c2442ffec00) refcount = 5 00010000:00000040:2.0:1784290443.389910:0:94058:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1784290443.389917:0:94058:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2482045800/0x5953bbf6b307543f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b25a5 expref: 9 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784290443.389926:0:94058:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c247f8caa00/0x5953bbf6b30753dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30753d6 expref: 23 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784290443.389935:0:94058:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2345ebf400/0x5953bbf6b30753b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30753ac expref: 23 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784290443.389942:0:94058:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c234236de00/0x5953bbf6b307533c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075335 expref: 23 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290443.389947:0:94058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c23450aa200/0x5953bbf6b307625b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3076254 expref: 23 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290443.389955:0:94058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c23450aa200/0x5953bbf6b307625b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3076254 expref: 23 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290443.389969:0:94058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aa200, rc 0) 00010000:00000040:2.0:1784290443.389972:0:94058:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901188736 00000100:00000040:2.0:1784290443.389979:0:94058:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 52 to 0@lo 00000100:00000040:2.0:1784290443.389983:0:94058:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290443.390006:0:94058:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9c24483ce680 x1870961901188736/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.390027:0:94058:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 51 to 0@lo 00000100:00000040:2.0:1784290443.390031:0:94058:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2474e89c50 x1870961901188736/t0(0) o101->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 328/344 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.390038:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:96622:x1870961901188736:12345-0@lo:101:mount.lustre.0 Request processed in 206us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290443.390045:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00000040:2.0:1784290443.390048:0:94058:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000020:00000040:2.0:1784290443.390055:0:94058:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 22 00000100:00000040:1.0:1784290443.390088:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c24483ce680 x1870961901188736/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.390099:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c24483ce680 x1870961901188736/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290459 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.390106:0:96622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901188736:0@lo:101:mount.lustre.0 00000100:00000040:1.0:1784290443.390114:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c24483ce680 x1870961901188736/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290459 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784290443.390134:0:96622:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2474ea4000 refcount=4 00010000:00000040:1.0:1784290443.390140:0:96622:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9c2474ea4000, remote cookie: 0x5953bbf6b307625b, flags: 0x0 00010000:00000040:1.0:1784290443.390146:0:96622:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff9c244ab48100) refcount = 4 00010000:00000040:1.0:1784290443.390148:0:96622:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1784290443.390151:0:96622:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.106@tcp lock: ffff9c247d2ffa00/0x5953bbf6b30753d6 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30753dd expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784290443.390158:0:96622:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe600/0x5953bbf6b30753ac lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30753b3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784290443.390164:0:96622:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe800/0x5953bbf6b3075335 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307533c expref: -99 pid: 94052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290443.390170:0:96622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c2474ea4000/0x5953bbf6b3076254 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307625b expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290443.390179:0:96622:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c2474ea4000/0x5953bbf6b3076254 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307625b expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1784290443.390187:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c24483ce680 x1870961901188736/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784290443.390196:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 10000000:00000040:1.0:1784290443.390204:0:96622:0:(mgc_request.c:108:config_log_get()) log params (ffff9c246873a800) refs 2 00000020:00000040:1.0:1784290443.390206:0:96622:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2474ea4000 refcount=3 10000000:00000040:1.0:1784290443.390248:0:96622:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c24587c6e40 : new refcount 2 10000000:00000040:1.0:1784290443.390253:0:96622:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c23422e1780 : new refcount 2 10000000:00000040:1.0:1784290443.390257:0:96622:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.202.106@tcp: copy local log params 00000040:00080000:1.0:1784290443.390482:0:96622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1784290443.390813:0:96622:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784290443.391095:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1784290443.391132:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1784290443.391153:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1784290443.391159:0:96622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000020:00000040:1.0:1784290443.391201:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:1.0:1784290443.391206:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=5 obd=MGC192.168.202.106@tcp 00000100:00000040:1.0:1784290443.391231:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c24483ce680 x1870961901188864/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.391245:0:96622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901188864:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1784290443.391275:0:96622:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c24483ce680 x1870961901188864/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1784290459 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.391287:0:96622:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290443.391323:0:96622:0:(events.c:337:request_in_callback()) incoming req@ffff9c2474e88450 x1870961901188864 msgsize 504 00000100:00100000:1.0:1784290443.391331:0:96622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784290443.391333:0:96622:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1784290443.391396:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c24483ce680 x1870961901188864/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1784290459 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.391425:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901188864 00000100:00100000:1.0:1784290443.391434:0:96622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341713c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784290443.391436:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901188864 00000020:00000040:3.0:1784290443.391442:0:94062:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:3.0:1784290443.391447:0:94062:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=23 00000100:00000040:3.0:1784290443.391470:0:94062:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784290443.391509:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00000040:3.0:1784290443.391514:0:94062:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:3.0:1784290443.391522:0:94062:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2474e88450 x1870961901188864/t0(0) o501->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 504/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.391541:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:96622:x1870961901188864:12345-0@lo:501:mount.lustre.0 00000040:00000040:3.0:1784290443.391558:0:94062:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log params 00000040:00000040:3.0:1784290443.391562:0:94062:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c247d2fc6c0 : new refcount 2 00000040:00000040:3.0:1784290443.391616:0:94062:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9c247d2fc6c0 : new refcount 1 00010000:00000040:3.0:1784290443.391623:0:94062:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901188864 00000100:00000040:3.0:1784290443.391630:0:94062:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 52 to 0@lo 00000100:00000040:3.0:1784290443.391636:0:94062:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784290443.391668:0:94062:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9c24483ce680 x1870961901188864/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290443.391700:0:94062:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 51 to 0@lo 00000100:00000040:3.0:1784290443.391710:0:94062:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2474e88450 x1870961901188864/t0(0) o501->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 504/272 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.391722:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:96622:x1870961901188864:12345-0@lo:501:mount.lustre.0 Request processed in 188us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290443.391734:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00000040:3.0:1784290443.391738:0:94062:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000020:00000040:3.0:1784290443.391751:0:94062:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 22 00000100:00000040:1.0:1784290443.391751:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c24483ce680 x1870961901188864/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.391775:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c24483ce680 x1870961901188864/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1784290459 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.391786:0:96622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901188864:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1784290443.391799:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c24483ce680 x1870961901188864/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1784290459 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784290443.391814:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000100:00000040:1.0:1784290443.391820:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c24483ce680 x1870961901188864/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784290443.391855:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 00000020:00000040:1.0:1784290443.391884:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:1.0:1784290443.391890:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=5 obd=MGC192.168.202.106@tcp 00000100:00000040:1.0:1784290443.391912:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c24483ce680 x1870961901188992/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.391924:0:96622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901188992:0@lo:503:mount.lustre.0 00000100:00000040:1.0:1784290443.391957:0:96622:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c24483ce680 x1870961901188992/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784290459 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.391964:0:96622:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290443.391989:0:96622:0:(events.c:337:request_in_callback()) incoming req@ffff9c246999f050 x1870961901188992 msgsize 272 00000100:00100000:1.0:1784290443.392001:0:96622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784290443.392003:0:96622:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1784290443.392032:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c24483ce680 x1870961901188992/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784290459 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.392046:0:96622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341713c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784290443.392076:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901188992 00000100:00100000:3.0:1784290443.392086:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901188992 00000020:00000040:3.0:1784290443.392090:0:94060:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:3.0:1784290443.392093:0:94060:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=23 00000100:00000040:3.0:1784290443.392107:0:94060:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784290443.392135:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00000040:3.0:1784290443.392138:0:94060:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:3.0:1784290443.392145:0:94060:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246999f050 x1870961901188992/t0(0) o503->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 272/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.392163:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:96622:x1870961901188992:12345-0@lo:503:mount.lustre.0 00000040:00000040:3.0:1784290443.392185:0:94060:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c247d2fc6c0 : new refcount 2 00000040:00000040:3.0:1784290443.392213:0:94060:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9c247d2fc6c0 : new refcount 1 00010000:00000040:3.0:1784290443.392216:0:94060:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901188992 00000100:00000040:3.0:1784290443.392221:0:94060:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 52 to 0@lo 00000100:00000040:3.0:1784290443.392227:0:94060:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784290443.392254:0:94060:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff9c24483ce680 x1870961901188992/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290443.392275:0:94060:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 51 to 0@lo 00000100:00000040:3.0:1784290443.392278:0:94060:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246999f050 x1870961901188992/t0(0) o503->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 272/8416 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.392285:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:96622:x1870961901188992:12345-0@lo:503:mount.lustre.0 Request processed in 126us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290443.392292:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00000040:3.0:1784290443.392295:0:94060:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000020:00000040:3.0:1784290443.392301:0:94060:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 22 00000100:00000040:1.0:1784290443.392390:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c24483ce680 x1870961901188992/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.392403:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c24483ce680 x1870961901188992/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784290459 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.392410:0:96622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901188992:0@lo:503:mount.lustre.0 00000100:00000040:1.0:1784290443.392426:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c24483ce680 x1870961901188992/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784290459 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.392442:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c24483ce680 x1870961901188992/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784290443.392468:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:1.0:1784290443.392486:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 00000040:00080000:1.0:1784290443.392833:0:96622:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:1.0:1784290443.392892:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:1.0:1784290443.392896:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=5 obd=MGC192.168.202.106@tcp 00000100:00000040:1.0:1784290443.392914:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c24483ce680 x1870961901189120/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.392923:0:96622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901189120:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1784290443.392948:0:96622:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c24483ce680 x1870961901189120/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.392955:0:96622:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290443.392977:0:96622:0:(events.c:337:request_in_callback()) incoming req@ffff9c246999cc50 x1870961901189120 msgsize 272 00000100:00100000:1.0:1784290443.392982:0:96622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784290443.392984:0:96622:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1784290443.393009:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c24483ce680 x1870961901189120/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.393041:0:96622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341713900 going to sleep for 11 seconds 00000100:00100000:3.0:1784290443.393061:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901189120 00000100:00100000:3.0:1784290443.393070:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901189120 00000020:00000040:3.0:1784290443.393074:0:94059:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:3.0:1784290443.393077:0:94059:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=23 00000100:00000040:3.0:1784290443.393093:0:94059:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784290443.393125:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00000040:3.0:1784290443.393128:0:94059:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:3.0:1784290443.393134:0:94059:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246999cc50 x1870961901189120/t0(0) o502->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 272/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.393147:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:96622:x1870961901189120:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1784290443.393178:0:94059:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c247d2fc6c0 : new refcount 2 00000040:00000040:3.0:1784290443.393204:0:94059:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9c247d2fc6c0 : new refcount 1 00010000:00000040:3.0:1784290443.393208:0:94059:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901189120 00000100:00000040:3.0:1784290443.393216:0:94059:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 52 to 0@lo 00000100:00000040:3.0:1784290443.393220:0:94059:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784290443.393253:0:94059:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9c24483ce680 x1870961901189120/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290443.393282:0:94059:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 51 to 0@lo 00000100:00000040:3.0:1784290443.393287:0:94059:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246999cc50 x1870961901189120/t0(0) o502->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 272/8472 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.393295:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:96622:x1870961901189120:12345-0@lo:502:mount.lustre.0 Request processed in 151us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290443.393302:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00000040:3.0:1784290443.393304:0:94059:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000020:00000040:3.0:1784290443.393318:0:94059:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 22 00000100:00000040:1.0:1784290443.393404:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c24483ce680 x1870961901189120/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.393422:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c24483ce680 x1870961901189120/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.393436:0:96622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901189120:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1784290443.393458:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c24483ce680 x1870961901189120/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.393483:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c24483ce680 x1870961901189120/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784290443.393505:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:1.0:1784290443.393516:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 00000040:00080000:1.0:1784290443.393693:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1784290443.393720:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1784290443.393739:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1784290443.393774:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1784290443.393804:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000020:00000040:1.0:1784290443.393821:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:1.0:1784290443.393825:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=5 obd=MGC192.168.202.106@tcp 00000100:00000040:1.0:1784290443.393848:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c24483ce680 x1870961901189248/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.393879:0:96622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901189248:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1784290443.393912:0:96622:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c24483ce680 x1870961901189248/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.393928:0:96622:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290443.393962:0:96622:0:(events.c:337:request_in_callback()) incoming req@ffff9c246999e450 x1870961901189248 msgsize 272 00000100:00100000:1.0:1784290443.393973:0:96622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784290443.393977:0:96622:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1784290443.394013:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c24483ce680 x1870961901189248/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.394014:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901189248 00000100:00100000:2.0:1784290443.394024:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901189248 00000020:00000040:2.0:1784290443.394033:0:94058:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:2.0:1784290443.394038:0:94058:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=23 00000100:00000040:2.0:1784290443.394062:0:94058:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784290443.394079:0:96622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2341713900 going to sleep for 11 seconds 00000100:00100000:2.0:1784290443.394109:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00000040:2.0:1784290443.394113:0:94058:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:2.0:1784290443.394119:0:94058:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246999e450 x1870961901189248/t0(0) o502->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 272/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.394131:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:96622:x1870961901189248:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1784290443.394153:0:94058:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c247d2fc6c0 : new refcount 2 00000040:00000040:2.0:1784290443.394180:0:94058:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9c247d2fc6c0 : new refcount 1 00010000:00000040:2.0:1784290443.394187:0:94058:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901189248 00000100:00000040:2.0:1784290443.394191:0:94058:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 52 to 0@lo 00000100:00000040:2.0:1784290443.394195:0:94058:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290443.394220:0:94058:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9c24483ce680 x1870961901189248/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.394242:0:94058:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 51 to 0@lo 00000100:00000040:2.0:1784290443.394247:0:94058:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246999e450 x1870961901189248/t0(0) o502->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 272/8472 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.394253:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:96622:x1870961901189248:12345-0@lo:502:mount.lustre.0 Request processed in 125us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290443.394261:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00000040:2.0:1784290443.394264:0:94058:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000020:00000040:2.0:1784290443.394273:0:94058:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 22 00000100:00000040:1.0:1784290443.394313:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c24483ce680 x1870961901189248/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.394329:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c24483ce680 x1870961901189248/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.394337:0:96622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901189248:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1784290443.394387:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c24483ce680 x1870961901189248/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.394399:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c24483ce680 x1870961901189248/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784290443.394424:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:1.0:1784290443.394430:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 00000040:00080000:1.0:1784290443.394454:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1784290443.394461:0:96622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 10000000:00000040:1.0:1784290443.394661:0:96622:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9c24587c6e40 : new refcount 1 00000020:00000040:1.0:1784290443.394665:0:96622:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog params 00000020:01000000:1.0:1784290443.394965:0:96630:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784290443.394976:0:96630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290443.394980:0:96630:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784290443.394989:0:96630:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c234479f800 00000020:00000080:1.0:1784290443.394993:0:96630:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784290443.395001:0:96630:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784290443.395003:0:96630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290443.395004:0:96630:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1784290443.395006:0:96630:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784290443.395008:0:96630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290443.395009:0:96630:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784290443.395012:0:96630:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c234479f800 00000020:00000080:1.0:1784290443.395013:0:96630:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784290443.395073:0:96630:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784290443.395077:0:96630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784290443.395078:0:96630:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784290443.395081:0:96630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000020:01000000:2.0:1784290443.395160:0:96622:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1784290443.395203:0:96622:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'params' succeeded (0). 00000020:00000040:2.0:1784290443.395221:0:96622:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2474ea4000 refcount=3 00010000:00010000:2.0:1784290443.395227:0:96622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c2474ea4000/0x5953bbf6b3076254 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307625b expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290443.395235:0:96622:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c2474ea4000/0x5953bbf6b3076254 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b307625b expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784290443.395274:0:96622:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784290443.395276:0:96622:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c234479f800 10000000:01000000:2.0:1784290443.395279:0:96622:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c234479f800 10000000:01000000:2.0:1784290443.395281:0:96622:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:2.0:1784290443.395285:0:96622:0:(genops.c:889:class_export_get()) GET export ffff9c2447ca9800 refcount=20 10000000:01000000:2.0:1784290443.395287:0:96622:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9c234479f800 from 1 10000000:01000000:2.0:1784290443.395289:0:96622:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000020:00000040:2.0:1784290443.395294:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00010000:00000040:2.0:1784290443.395309:0:96622:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c246de62000 count: 9 00000020:00000040:2.0:1784290443.395314:0:96622:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c23450aae00 with handle 0x5953bbf6b3076262 to hash 00010000:00010000:2.0:1784290443.395318:0:96622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3076262 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290443.395324:0:96622:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3076262 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290443.395329:0:96622:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3076262 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784290443.395378:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2468abb480 x1870961901189376/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.395386:0:96622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901189376:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1784290443.395398:0:96622:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2468abb480 x1870961901189376/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290459 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.395404:0:96622:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290443.395422:0:96622:0:(events.c:337:request_in_callback()) incoming req@ffff9c246999dc50 x1870961901189376 msgsize 328 00000100:00100000:2.0:1784290443.395425:0:96622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784290443.395426:0:96622:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784290443.395441:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2468abb480 x1870961901189376/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290459 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.395461:0:96622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23422e1000 going to sleep for 11 seconds 00000100:00100000:3.0:1784290443.395466:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901189376 00000100:00100000:3.0:1784290443.395472:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901189376 00000020:00000040:3.0:1784290443.395474:0:94062:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:3.0:1784290443.395477:0:94062:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=23 00000100:00000040:3.0:1784290443.395491:0:94062:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784290443.395511:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00000040:3.0:1784290443.395514:0:94062:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:3.0:1784290443.395519:0:94062:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246999dc50 x1870961901189376/t0(0) o101->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 328/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.395529:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246999dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:96622:x1870961901189376:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784290443.395537:0:94062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1784290443.395541:0:94062:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c2461f23300 count: 11 00000020:00000040:3.0:1784290443.395555:0:94062:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c247d2ff000 with handle 0x5953bbf6b3076269 to hash 00010000:00010000:3.0:1784290443.395559:0:94062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247d2ff000/0x5953bbf6b3076269 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b3076262 expref: -99 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784290443.395565:0:94062:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9c2475c4c800 : new locks_count 18 00000020:00000040:3.0:1784290443.395567:0:94062:0:(genops.c:889:class_export_get()) GET export ffff9c2475c4c800 refcount=24 00010000:00000040:3.0:1784290443.395575:0:94062:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9c2461f23300) refcount = 11 00010000:00000040:3.0:1784290443.395578:0:94062:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1784290443.395581:0:94062:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2474ea4200/0x5953bbf6b307622a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3076223 expref: 24 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784290443.395588:0:94062:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c234236ca00/0x5953bbf6b3075844 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b307583d expref: 24 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784290443.395592:0:94062:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c246dd26e00/0x5953bbf6b307581a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075813 expref: 24 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784290443.395597:0:94062:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c234236d400/0x5953bbf6b307580c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075805 expref: 24 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784290443.395602:0:94062:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c23450ab200/0x5953bbf6b30757fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30757f7 expref: 24 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784290443.395606:0:94062:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c234236dc00/0x5953bbf6b30757f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30757e9 expref: 24 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784290443.395611:0:94062:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c246dd26800/0x5953bbf6b30757e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30757db expref: 24 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784290443.395615:0:94062:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c234236d600/0x5953bbf6b30757d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30757cd expref: 24 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784290443.395621:0:94062:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c24414b8200/0x5953bbf6b30757c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b260e expref: 9 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784290443.395633:0:94062:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c234236d200/0x5953bbf6b30757bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2607 expref: 9 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290443.395638:0:94062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247d2ff000/0x5953bbf6b3076269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b3076262 expref: 24 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290443.395644:0:94062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247d2ff000/0x5953bbf6b3076269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3076262 expref: 24 pid: 94062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290443.395649:0:94062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2ff000, rc 0) 00010000:00000040:3.0:1784290443.395651:0:94062:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901189376 00000100:00000040:3.0:1784290443.395656:0:94062:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 52 to 0@lo 00000100:00000040:3.0:1784290443.395660:0:94062:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784290443.395678:0:94062:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9c2468abb480 x1870961901189376/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290443.395699:0:94062:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 51 to 0@lo 00000100:00000040:3.0:1784290443.395703:0:94062:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246999dc50 x1870961901189376/t0(0) o101->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 328/344 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.395711:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246999dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:96622:x1870961901189376:12345-0@lo:101:mount.lustre.0 Request processed in 183us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290443.395717:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00000040:3.0:1784290443.395720:0:94062:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000100:00000040:2.0:1784290443.395728:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2468abb480 x1870961901189376/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784290443.395729:0:94062:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 23 00000100:00000040:2.0:1784290443.395739:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468abb480 x1870961901189376/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290459 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.395745:0:96622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901189376:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1784290443.395758:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2468abb480 x1870961901189376/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290459 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.395765:0:96622:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c23450aae00 refcount=4 00010000:00000040:2.0:1784290443.395768:0:96622:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9c23450aae00, remote cookie: 0x5953bbf6b3076269, flags: 0x0 00010000:00000040:2.0:1784290443.395772:0:96622:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9c246de62000) refcount = 9 00010000:00000040:2.0:1784290443.395774:0:96622:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1784290443.395776:0:96622:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.106@tcp lock: ffff9c23450ab000/0x5953bbf6b3076223 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307622a expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784290443.395780:0:96622:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.106@tcp lock: ffff9c24414b9400/0x5953bbf6b307583d lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3075844 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784290443.395785:0:96622:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.106@tcp lock: ffff9c24414b9a00/0x5953bbf6b3075813 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307581a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784290443.395789:0:96622:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.106@tcp lock: ffff9c24414b8e00/0x5953bbf6b3075805 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b307580c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784290443.395792:0:96622:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.106@tcp lock: ffff9c24414b9800/0x5953bbf6b30757f7 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30757fe expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784290443.395796:0:96622:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.106@tcp lock: ffff9c24414b9000/0x5953bbf6b30757e9 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30757f0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784290443.395801:0:96622:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.106@tcp lock: ffff9c24414b8c00/0x5953bbf6b30757db lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30757e2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784290443.395804:0:96622:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.106@tcp lock: ffff9c24414b9e00/0x5953bbf6b30757cd lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30757d4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290443.395808:0:96622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3076262 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3076269 expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290443.395820:0:96622:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3076262 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b3076269 expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784290443.395825:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2468abb480 x1870961901189376/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.395831:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 10000000:00000040:2.0:1784290443.395834:0:96622:0:(mgc_request.c:108:config_log_get()) log lustre-client (ffff9c2458bf6200) refs 2 00000020:00000040:2.0:1784290443.395836:0:96622:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c23450aae00 refcount=3 10000000:00000040:2.0:1784290443.395879:0:96622:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c24587c6e40 : new refcount 2 10000000:00000040:2.0:1784290443.395883:0:96622:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c23422e1780 : new refcount 2 10000000:00000040:2.0:1784290443.395886:0:96622:0:(mgc_request_server.c:802:mgc_process_server_cfg_log()) MGC192.168.202.106@tcp: copy local log lustre-client 00000040:00080000:2.0:1784290443.396019:0:96622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1784290443.396171:0:96622:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784290443.396302:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1784290443.396323:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1784290443.396337:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1784290443.396405:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1784290443.396416:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1784290443.396426:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1784290443.396436:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1784290443.396445:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1784290443.396454:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1784290443.396464:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1784290443.396474:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1784290443.396483:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1784290443.396495:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1784290443.396509:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1784290443.396521:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1784290443.396533:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1784290443.396543:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1784290443.396565:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1784290443.396579:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1784290443.396589:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1784290443.396600:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1784290443.396609:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1784290443.396620:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1784290443.396632:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1784290443.396645:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1784290443.396679:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1784290443.396695:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1784290443.396713:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1784290443.396728:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1784290443.396743:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1784290443.396772:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1784290443.396787:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1784290443.396798:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1784290443.396809:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1784290443.396819:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1784290443.396829:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1784290443.396838:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1784290443.396851:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1784290443.396855:0:96622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000020:00000040:2.0:1784290443.396903:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:2.0:1784290443.396909:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=5 obd=MGC192.168.202.106@tcp 00000100:00000040:2.0:1784290443.396928:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2468abb480 x1870961901189504/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.396937:0:96622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901189504:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1784290443.396948:0:96622:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2468abb480 x1870961901189504/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.396954:0:96622:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290443.396976:0:96622:0:(events.c:337:request_in_callback()) incoming req@ffff9c247e456c50 x1870961901189504 msgsize 512 00000100:00100000:2.0:1784290443.396987:0:96622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784290443.396989:0:96622:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784290443.397007:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2468abb480 x1870961901189504/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.397025:0:96622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345844b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784290443.397042:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901189504 00000100:00100000:3.0:1784290443.397049:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901189504 00000020:00000040:3.0:1784290443.397051:0:94060:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:3.0:1784290443.397055:0:94060:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=24 00000100:00000040:3.0:1784290443.397074:0:94060:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784290443.397100:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00000040:3.0:1784290443.397103:0:94060:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:3.0:1784290443.397108:0:94060:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c247e456c50 x1870961901189504/t0(0) o501->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 512/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.397119:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:96622:x1870961901189504:12345-0@lo:501:mount.lustre.0 00000040:00000040:3.0:1784290443.397129:0:94060:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-client 00000040:00000040:3.0:1784290443.397131:0:94060:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c247d2fc6c0 : new refcount 2 00000040:00000040:3.0:1784290443.397157:0:94060:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9c247d2fc6c0 : new refcount 1 00000020:00000040:3.0:1784290443.397163:0:94060:0:(genops.c:889:class_export_get()) GET export ffff9c2475c4c800 refcount=25 00000020:00000040:3.0:1784290443.397166:0:94060:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 24 00010000:00000040:3.0:1784290443.397168:0:94060:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901189504 00000100:00000040:3.0:1784290443.397173:0:94060:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 52 to 0@lo 00000100:00000040:3.0:1784290443.397176:0:94060:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784290443.397192:0:94060:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9c2468abb480 x1870961901189504/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290443.397222:0:94060:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 51 to 0@lo 00000100:00000040:3.0:1784290443.397227:0:94060:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c247e456c50 x1870961901189504/t0(0) o501->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 512/272 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.397234:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:96622:x1870961901189504:12345-0@lo:501:mount.lustre.0 Request processed in 116us (255us total) trans 0 rc 0/0 00000100:00000040:2.0:1784290443.397240:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2468abb480 x1870961901189504/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.397243:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00000040:3.0:1784290443.397249:0:94060:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000100:00000040:2.0:1784290443.397254:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468abb480 x1870961901189504/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784290443.397259:0:94060:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 23 00000100:00100000:2.0:1784290443.397261:0:96622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901189504:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1784290443.397268:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2468abb480 x1870961901189504/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.397276:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000100:00000040:2.0:1784290443.397279:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2468abb480 x1870961901189504/t0(0) o501->MGC192.168.202.106@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.397286:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 00000020:00000040:2.0:1784290443.397292:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:2.0:1784290443.397295:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=5 obd=MGC192.168.202.106@tcp 00000100:00000040:2.0:1784290443.397304:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2468abb480 x1870961901189632/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.397310:0:96622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901189632:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1784290443.397336:0:96622:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2468abb480 x1870961901189632/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784290459 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.397380:0:96622:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290443.397408:0:96622:0:(events.c:337:request_in_callback()) incoming req@ffff9c247e454c50 x1870961901189632 msgsize 272 00000100:00100000:2.0:1784290443.397411:0:96622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784290443.397417:0:96622:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784290443.397434:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2468abb480 x1870961901189632/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784290459 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.397468:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901189632 00000100:00100000:3.0:1784290443.397474:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901189632 00000020:00000040:3.0:1784290443.397478:0:94059:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:3.0:1784290443.397482:0:94059:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=24 00000100:00100000:2.0:1784290443.397486:0:96622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2345844b40 going to sleep for 11 seconds 00000100:00000040:3.0:1784290443.397496:0:94059:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784290443.397516:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00000040:3.0:1784290443.397525:0:94059:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:3.0:1784290443.397531:0:94059:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c247e454c50 x1870961901189632/t0(0) o503->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 272/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.397540:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:96622:x1870961901189632:12345-0@lo:503:mount.lustre.0 00000040:00000040:3.0:1784290443.397555:0:94059:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c247d2fc6c0 : new refcount 2 00000040:00000040:3.0:1784290443.397580:0:94059:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9c247d2fc6c0 : new refcount 1 00010000:00000040:3.0:1784290443.397582:0:94059:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901189632 00000100:00000040:3.0:1784290443.397588:0:94059:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 52 to 0@lo 00000100:00000040:3.0:1784290443.397591:0:94059:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784290443.397608:0:94059:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff9c2468abb480 x1870961901189632/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290443.397627:0:94059:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 51 to 0@lo 00000100:00000040:3.0:1784290443.397631:0:94059:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c247e454c50 x1870961901189632/t0(0) o503->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 272/8416 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.397638:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:96622:x1870961901189632:12345-0@lo:503:mount.lustre.0 Request processed in 99us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290443.397645:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00000040:3.0:1784290443.397647:0:94059:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000020:00000040:3.0:1784290443.397654:0:94059:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 23 00000100:00000040:2.0:1784290443.397657:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2468abb480 x1870961901189632/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.397664:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468abb480 x1870961901189632/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784290459 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.397669:0:96622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901189632:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1784290443.397675:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2468abb480 x1870961901189632/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784290459 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.397684:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2468abb480 x1870961901189632/t0(0) o503->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.397695:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:2.0:1784290443.397699:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 00000040:00080000:2.0:1784290443.397970:0:96622:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:2.0:1784290443.398001:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:2.0:1784290443.398005:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=5 obd=MGC192.168.202.106@tcp 00000100:00000040:2.0:1784290443.398017:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2468abb480 x1870961901189760/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.398025:0:96622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901189760:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1784290443.398045:0:96622:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2468abb480 x1870961901189760/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.398051:0:96622:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290443.398069:0:96622:0:(events.c:337:request_in_callback()) incoming req@ffff9c247e455450 x1870961901189760 msgsize 272 00000100:00100000:2.0:1784290443.398075:0:96622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784290443.398076:0:96622:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784290443.398101:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2468abb480 x1870961901189760/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.398114:0:96622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23453d4900 going to sleep for 11 seconds 00000100:00100000:3.0:1784290443.398124:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901189760 00000100:00100000:3.0:1784290443.398131:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901189760 00000020:00000040:3.0:1784290443.398133:0:94058:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:3.0:1784290443.398135:0:94058:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=24 00000100:00000040:3.0:1784290443.398145:0:94058:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784290443.398166:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00000040:3.0:1784290443.398169:0:94058:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:3.0:1784290443.398174:0:94058:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c247e455450 x1870961901189760/t0(0) o502->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 272/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.398193:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:96622:x1870961901189760:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1784290443.398207:0:94058:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c247d2fc6c0 : new refcount 2 00000040:00000040:3.0:1784290443.398229:0:94058:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9c247d2fc6c0 : new refcount 1 00010000:00000040:3.0:1784290443.398231:0:94058:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901189760 00000100:00000040:3.0:1784290443.398236:0:94058:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 52 to 0@lo 00000100:00000040:3.0:1784290443.398239:0:94058:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784290443.398254:0:94058:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9c2468abb480 x1870961901189760/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290443.398280:0:94058:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 51 to 0@lo 00000100:00000040:3.0:1784290443.398288:0:94058:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c247e455450 x1870961901189760/t0(0) o502->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 272/8472 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.398296:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:96622:x1870961901189760:12345-0@lo:502:mount.lustre.0 Request processed in 104us (224us total) trans 0 rc 0/0 00000100:00000040:2.0:1784290443.398301:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2468abb480 x1870961901189760/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.398306:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00000040:3.0:1784290443.398311:0:94058:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000100:00000040:2.0:1784290443.398320:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468abb480 x1870961901189760/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784290443.398322:0:94058:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 23 00000100:00100000:2.0:1784290443.398331:0:96622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901189760:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1784290443.398361:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2468abb480 x1870961901189760/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.398373:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2468abb480 x1870961901189760/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.398392:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:2.0:1784290443.398398:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 00000040:00080000:2.0:1784290443.398501:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1784290443.398520:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1784290443.398536:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1784290443.398552:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1784290443.398567:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1784290443.398575:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1784290443.398584:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1784290443.398604:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1784290443.398618:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1784290443.398633:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1784290443.398676:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1784290443.398704:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1784290443.398719:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1784290443.398743:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1784290443.398786:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1784290443.398820:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1784290443.398838:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1784290443.398853:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1784290443.398896:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1784290443.398930:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1784290443.398959:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1784290443.398975:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1784290443.398996:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1784290443.399014:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1784290443.399033:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1784290443.399046:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1784290443.399063:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1784290443.399082:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1784290443.399100:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1784290443.399125:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1784290443.399144:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1784290443.399161:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1784290443.399176:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1784290443.399189:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1784290443.399204:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1784290443.399223:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1784290443.399242:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1784290443.399254:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1784290443.399265:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1784290443.399288:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1784290443.399304:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1784290443.399323:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1784290443.399721:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1784290443.399745:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1784290443.399761:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1784290443.399792:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1784290443.399810:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1784290443.399827:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000020:00000040:2.0:1784290443.399851:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:2.0:1784290443.399854:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=5 obd=MGC192.168.202.106@tcp 00000100:00000040:2.0:1784290443.399885:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2468abb480 x1870961901189888/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.399897:0:96622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901189888:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1784290443.399926:0:96622:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2468abb480 x1870961901189888/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.399934:0:96622:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290443.399952:0:96622:0:(events.c:337:request_in_callback()) incoming req@ffff9c247e457050 x1870961901189888 msgsize 272 00000100:00100000:2.0:1784290443.399955:0:96622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784290443.399956:0:96622:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784290443.399973:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2468abb480 x1870961901189888/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.399991:0:96622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23422e1000 going to sleep for 11 seconds 00000100:00100000:3.0:1784290443.400012:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901189888 00000100:00100000:3.0:1784290443.400020:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901189888 00000020:00000040:3.0:1784290443.400023:0:94062:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:3.0:1784290443.400027:0:94062:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=24 00000100:00000040:3.0:1784290443.400042:0:94062:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784290443.400067:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00000040:3.0:1784290443.400070:0:94062:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:3.0:1784290443.400075:0:94062:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c247e457050 x1870961901189888/t0(0) o502->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 272/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.400086:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:96622:x1870961901189888:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1784290443.400109:0:94062:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c247d2fc6c0 : new refcount 2 00000040:00000040:3.0:1784290443.400132:0:94062:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9c247d2fc6c0 : new refcount 1 00010000:00000040:3.0:1784290443.400134:0:94062:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901189888 00000100:00000040:3.0:1784290443.400139:0:94062:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 52 to 0@lo 00000100:00000040:3.0:1784290443.400143:0:94062:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784290443.400160:0:94062:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9c2468abb480 x1870961901189888/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290443.400180:0:94062:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 51 to 0@lo 00000100:00000040:3.0:1784290443.400184:0:94062:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c247e457050 x1870961901189888/t0(0) o502->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 272/8472 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.400193:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e457050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:96622:x1870961901189888:12345-0@lo:502:mount.lustre.0 Request processed in 108us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290443.400199:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00000040:3.0:1784290443.400202:0:94062:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000100:00000040:2.0:1784290443.400206:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2468abb480 x1870961901189888/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784290443.400209:0:94062:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 23 00000100:00000040:2.0:1784290443.400217:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468abb480 x1870961901189888/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.400224:0:96622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901189888:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1784290443.400232:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2468abb480 x1870961901189888/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.400243:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2468abb480 x1870961901189888/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.400256:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:2.0:1784290443.400261:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 00000040:00080000:2.0:1784290443.400370:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1784290443.400390:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000040:00080000:2.0:1784290443.400411:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1784290443.400420:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].52, 224 off17176 00000040:00080000:2.0:1784290443.400430:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].53, 112 off17288 00000040:00080000:2.0:1784290443.400440:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].54, 224 off17512 00000040:00080000:2.0:1784290443.400450:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].55, 224 off17736 00000040:00080000:2.0:1784290443.400462:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].56, 136 off17872 00000040:00080000:2.0:1784290443.400473:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].57, 224 off18096 00000040:00080000:2.0:1784290443.400483:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].58, 224 off18320 00000040:00080000:2.0:1784290443.400493:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].59, 136 off18456 00000040:00080000:2.0:1784290443.400503:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].60, 224 off18680 00000040:00080000:2.0:1784290443.400513:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].61, 224 off18904 00000040:00080000:2.0:1784290443.400524:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].62, 112 off19016 00000020:00000040:2.0:1784290443.400529:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:2.0:1784290443.400533:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=5 obd=MGC192.168.202.106@tcp 00000100:00000040:2.0:1784290443.400544:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2468abb480 x1870961901190016/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.400550:0:96622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901190016:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1784290443.400569:0:96622:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2468abb480 x1870961901190016/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.400573:0:96622:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290443.400588:0:96622:0:(events.c:337:request_in_callback()) incoming req@ffff9c247e454450 x1870961901190016 msgsize 272 00000100:00100000:2.0:1784290443.400591:0:96622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784290443.400593:0:96622:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784290443.400607:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2468abb480 x1870961901190016/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.400623:0:96622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c23453d4900 going to sleep for 11 seconds 00000100:00100000:3.0:1784290443.400641:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901190016 00000100:00100000:3.0:1784290443.400646:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901190016 00000020:00000040:3.0:1784290443.400648:0:94060:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:3.0:1784290443.400650:0:94060:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=24 00000100:00000040:3.0:1784290443.400661:0:94060:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784290443.400678:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00000040:3.0:1784290443.400681:0:94060:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:3.0:1784290443.400684:0:94060:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c247e454450 x1870961901190016/t0(0) o502->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 272/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.400693:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:96622:x1870961901190016:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1784290443.400707:0:94060:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c247d2fc6c0 : new refcount 2 00000040:00000040:3.0:1784290443.400725:0:94060:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9c247d2fc6c0 : new refcount 1 00010000:00000040:3.0:1784290443.400732:0:94060:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901190016 00000100:00000040:3.0:1784290443.400737:0:94060:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 52 to 0@lo 00000100:00000040:3.0:1784290443.400741:0:94060:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784290443.400760:0:94060:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9c2468abb480 x1870961901190016/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290443.400779:0:94060:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 51 to 0@lo 00000100:00000040:3.0:1784290443.400783:0:94060:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c247e454450 x1870961901190016/t0(0) o502->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 272/8472 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.400791:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2468abb480 x1870961901190016/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.400793:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:96622:x1870961901190016:12345-0@lo:502:mount.lustre.0 Request processed in 98us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290443.400809:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00000040:2.0:1784290443.400811:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468abb480 x1870961901190016/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290443.400813:0:94060:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000020:00000040:3.0:1784290443.400821:0:94060:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 23 00000100:00100000:2.0:1784290443.400825:0:96622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901190016:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1784290443.400833:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2468abb480 x1870961901190016/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.400843:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2468abb480 x1870961901190016/t0(0) o502->MGC192.168.202.106@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.400855:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:2.0:1784290443.400872:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 00000040:00080000:2.0:1784290443.400893:0:96622:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].63, 224 off19240 00000040:00080000:2.0:1784290443.400900:0:96622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 10000000:00000040:2.0:1784290443.401067:0:96622:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9c24587c6e40 : new refcount 1 00000020:00000040:2.0:1784290443.401071:0:96622:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-client 00000100:00000040:2.0:1784290443.401269:0:96633:0:(lustre_peer.c:130:class_add_uuid()) found uuid 192.168.202.106@tcp 192.168.202.106@tcp cnt=1 00000020:01000004:2.0:1784290443.401293:0:96633:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1784290443.401303:0:96633:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c24581b0000) 00000020:00000040:2.0:1784290443.401307:0:96633:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c245aaf4000 with handle 0x5953bbf6b3076270 to hash 00000020:00000040:2.0:1784290443.401311:0:96633:0:(genops.c:900:class_export_put()) PUTting export ffff9c245aaf4000 : new refcount 1 00000020:00000040:2.0:1784290443.401319:0:96633:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9c24581b0000) now 2 - obd_device_list 00000020:00000080:2.0:1784290443.401322:0:96633:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1784290443.401463:0:96633:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c234479f800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784290443.401467:0:96633:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c234479f800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784290443.401469:0:96633:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c234479f800 3 00000020:00000040:2.0:1784290443.401492:0:96633:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9c24581b0000) now 3 - import 00000020:00000040:2.0:1784290443.401496:0:96633:0:(genops.c:1244:class_import_put()) import ffff9c2343905800 refcount=1 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1784290443.401504:0:96633:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 52 to 0@lo 00000100:00000040:2.0:1784290443.401508:0:96633:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c247b2be100 refcount 52 to 0@lo 00000100:00000040:2.0:1784290443.401510:0:96633:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.202.106@tcp -> ffff9c247b2be100 00010000:00080000:2.0:1784290443.401515:0:96633:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2343905800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.106@tcp at head 00010000:00010000:2.0:1784290443.403477:0:96633:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000040:2.0:1784290443.403560:0:96633:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9c24581b0000) now 4 - setup 00000020:00000080:2.0:1784290443.403563:0:96633:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1784290443.403584:0:96633:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000040:2.0:1784290443.403589:0:96633:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2345f44800 with handle 0x5953bbf6b3076277 to hash 00000020:00000040:2.0:1784290443.403594:0:96633:0:(genops.c:889:class_export_get()) GET export ffff9c2345f44800 refcount=3 00000020:00000040:2.0:1784290443.403596:0:96633:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9c24581b0000) now 5 - export 00000020:00000040:2.0:1784290443.403598:0:96633:0:(genops.c:900:class_export_put()) PUTting export ffff9c2345f44800 : new refcount 2 00000020:00000080:2.0:1784290443.403600:0:96633:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5953bbf6b3076277 00000020:00000040:2.0:1784290443.403602:0:96633:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3076277 00000020:00000040:2.0:1784290443.403604:0:96633:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2345f44800 refcount=3 00000100:00080000:2.0:1784290443.403610:0:96633:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:2.0:1784290443.403614:0:96633:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 53 to 0@lo 00000020:00000040:2.0:1784290443.403616:0:96633:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3076277 00000020:00000040:2.0:1784290443.403618:0:96633:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2345f44800 refcount=4 00000100:00000040:2.0:1784290443.403620:0:96633:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 54 to 0@lo 00000020:00000040:2.0:1784290443.403621:0:96633:0:(genops.c:900:class_export_put()) PUTting export ffff9c2345f44800 : new refcount 3 00000100:00080000:2.0:1784290443.403623:0:96633:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c2343905800 using connection 192.168.202.106@tcp/0@lo 00000020:00000040:2.0:1784290443.403632:0:96633:0:(genops.c:1231:class_import_get()) import ffff9c2343905800 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:2.0:1784290443.403646:0:96633:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2468abb480 x1870961901190144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784290443.403656:0:96633:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d43bb516] to pc [ptlrpcd_rcv+-1] req@ffff9c2468abb480 x1870961901190144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.403681:0:3616:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2468abb480 x1870961901190144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.403688:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901190144:0@lo:38:llog_process_th.0 00000100:00000040:2.0:1784290443.403706:0:3616:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2468abb480 x1870961901190144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784290453 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.403713:0:3616:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290443.403734:0:3616:0:(events.c:337:request_in_callback()) incoming req@ffff9c2468ab8000 x1870961901190144 msgsize 520 00000100:00100000:2.0:1784290443.403740:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784290443.403760:0:3616:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2468abb480 x1870961901190144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784290453 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.403772:0:3616:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00100000:0.0:1784290443.403775:0:65989:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901190144 00000100:00100000:0.0:1784290443.403784:0:65989:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901190144 00000020:00000040:0.0:1784290443.403788:0:65989:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00080000:2.0:1784290443.403797:0:96633:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:00000040:2.0:1784290443.403801:0:96633:0:(genops.c:1231:class_import_get()) import ffff9c2343905800 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:0.0:1784290443.403827:0:65989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00000040:0.0:1784290443.403838:0:65989:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2468ab8000 x1870961901190144/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1784290463 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.403840:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1784290443.403875:0:65989:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1870961901190144:12345-0@lo:38:llog_process_th.0 00000020:00000040:1.0:1784290443.403878:0:83795:0:(genops.c:1231:class_import_get()) import ffff9c2342ef2800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000020:00000040:0.0:1784290443.403889:0:65989:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9c2474fd3380) now 14 - find 00000100:00000040:1.0:1784290443.403897:0:83795:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff9c24483ce680 x1870961901190272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00000040:0.0:1784290443.403913:0:65989:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-MDT0000: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:0.0:1784290443.403929:0:65989:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 2184 last 0 00000100:00000040:1.0:1784290443.403938:0:83795:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000067720b59] to pc [ptlrpcd_00_00+0] req@ffff9c24483ce680 x1870961901190272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.403939:0:96633:0:(genops.c:889:class_export_get()) GET export ffff9c2345f44800 refcount=4 00000020:00000040:0.0:1784290443.403942:0:65989:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c234479f000 with handle 0x5953bbf6b307627e to hash 00000020:00000040:2.0:1784290443.403948:0:96633:0:(genops.c:889:class_export_get()) GET export ffff9c2345f44800 refcount=5 00000100:00000040:1.0:1784290443.403988:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1784290443.403999:0:65989:0:(genops.c:889:class_export_get()) GET export ffff9c234479f000 refcount=3 00000100:00000040:2.0:1784290443.404005:0:96633:0:(lustre_peer.c:130:class_add_uuid()) found uuid 192.168.202.106@tcp 192.168.202.106@tcp cnt=1 00000020:00000040:0.0:1784290443.404007:0:65989:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9c2474fd3380) now 15 - export 00000020:00000040:1.0:1784290443.404008:0:83795:0:(genops.c:1231:class_import_get()) import ffff9c2342ef4800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000020:00000040:0.0:1784290443.404022:0:65989:0:(genops.c:900:class_export_put()) PUTting export ffff9c234479f000 : new refcount 2 00000020:01000004:2.0:1784290443.404023:0:96633:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1784290443.404027:0:65989:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5953bbf6b307627e 00000100:00000040:1.0:1784290443.404031:0:83795:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff9c2467ee4700 x1870961901190400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1784290443.404033:0:65989:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307627e 00000020:00000080:2.0:1784290443.404035:0:96633:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9c24581b19c0) 00000020:00000040:0.0:1784290443.404043:0:65989:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c234479f000 refcount=3 00000020:00000040:2.0:1784290443.404046:0:96633:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2345f41800 with handle 0x5953bbf6b3076285 to hash 00000020:00000040:2.0:1784290443.404060:0:96633:0:(genops.c:900:class_export_put()) PUTting export ffff9c2345f41800 : new refcount 1 00000001:00000040:0.0:1784290443.404064:0:65989:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.202.106@tcp 00000100:00000040:1.0:1784290443.404074:0:83795:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b79df48c] to pc [ptlrpcd_00_01+1] req@ffff9c2467ee4700 x1870961901190400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000001:00000040:0.0:1784290443.404076:0:65989:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9c2344606400) : new refcount 17 00000020:00000040:2.0:1784290443.404077:0:96633:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9c24581b19c0) now 2 - obd_device_list 00000020:00000040:0.0:1784290443.404092:0:65989:0:(genops.c:889:class_export_get()) GET export ffff9c234479f000 refcount=4 00000020:00000080:2.0:1784290443.404093:0:96633:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000001:00000040:0.0:1784290443.404103:0:65989:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9c2344606400) : new refcount 18 00000001:00000040:0.0:1784290443.404112:0:65989:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9c2344606400) : new refcount 17 00000100:00000040:1.0:1784290443.404115:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000004:00100000:0.0:1784290443.404119:0:65989:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:1.0:1784290443.404123:0:83795:0:(genops.c:1231:class_import_get()) import ffff9c246dd98000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1784290443.404135:0:83795:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff9c23443ba300 x1870961901190528/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1784290443.404138:0:65989:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9c2345582ae0 for nid 0@lo - ref 6 00000100:00000040:1.0:1784290443.404154:0:83795:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003b5c2e74] to pc [ptlrpcd_00_02+2] req@ffff9c23443ba300 x1870961901190528/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784290443.404154:0:65989:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9c2474fd3380) now 16 - import 00000020:00000040:0.0:1784290443.404170:0:65989:0:(genops.c:1244:class_import_put()) import ffff9c2344798000 refcount=1 obd=lustre-MDT0000 00000020:00000040:0.0:1784290443.404180:0:65989:0:(genops.c:889:class_export_get()) GET export ffff9c234479f000 refcount=5 00000100:00000040:0.0:1784290443.404185:0:65989:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9c234479f000 : new rpc_count 1 00000100:00080000:1.0:1784290443.404188:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1784290443.404190:0:65989:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 55 to 0@lo 00000100:00080000:1.0:1784290443.404203:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00000040:0.0:1784290443.404207:0:65989:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c247b2be100 refcount 55 to 0@lo 00000020:01000004:2.0:1784290443.404209:0:96633:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c234479f800 from lustre-OST0000, refs=3 00000100:00080000:1.0:1784290443.404210:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c2341ead000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000020:00000040:0.0:1784290443.404213:0:65989:0:(genops.c:889:class_export_get()) GET export ffff9c234479f000 refcount=6 00000020:01000004:2.0:1784290443.404223:0:96633:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c234479f800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784290443.404227:0:96633:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c234479f800 3 00000100:00000040:0.0:1784290443.404229:0:65989:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 56 to 0@lo 00000100:00080000:1.0:1784290443.404230:0:83795:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 2179 00000100:00080000:1.0:1784290443.404247:0:83795:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1784290443.404249:0:65989:0:(import.c:65:import_set_state_nolock()) ffff9c2344798000 : changing import state from RECOVER to FULL 00000020:00000040:2.0:1784290443.404250:0:96633:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9c24581b19c0) now 3 - import 00000020:00000040:0.0:1784290443.404261:0:65989:0:(genops.c:900:class_export_put()) PUTting export ffff9c234479f000 : new refcount 5 00000020:00000040:2.0:1784290443.404263:0:96633:0:(genops.c:1244:class_import_put()) import ffff9c2469a70800 refcount=1 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:1.0:1784290443.404264:0:83795:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 55 to 0@lo 00000020:00000040:0.0:1784290443.404266:0:65989:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9c2474fd3380) now 16 - find 00000100:00000040:2.0:1784290443.404273:0:96633:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 56 to 0@lo 00000100:00000040:2.0:1784290443.404283:0:96633:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c247b2be100 refcount 57 to 0@lo 00000100:00000040:1.0:1784290443.404283:0:83795:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 57 to 0@lo 00010000:00000040:0.0:1784290443.404285:0:65989:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901190144 00000100:00000040:2.0:1784290443.404290:0:96633:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.202.106@tcp -> ffff9c247b2be100 00010000:00080000:2.0:1784290443.404297:0:96633:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c2469a70800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.106@tcp at head 00000020:00000040:1.0:1784290443.404298:0:83795:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b306f19e 00000100:00000040:0.0:1784290443.404300:0:65989:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 58 to 0@lo 00000020:00000040:1.0:1784290443.404309:0:83795:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c2a800 refcount=4 00000100:00000040:0.0:1784290443.404315:0:65989:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290443.404323:0:83795:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 57 to 0@lo 00000100:00000040:1.0:1784290443.404327:0:83795:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 58 to 0@lo 00000020:00000040:1.0:1784290443.404330:0:83795:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c2a800 : new refcount 3 00000100:00080000:1.0:1784290443.404336:0:83795:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c2341ead000 using connection 192.168.202.106@tcp/0@lo 00000020:00000040:1.0:1784290443.404348:0:83795:0:(genops.c:1231:class_import_get()) import ffff9c2341ead000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1784290443.404367:0:65989:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9c2468abb480 x1870961901190144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784290453 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290443.404398:0:65989:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 57 to 0@lo 00000100:00100000:1.0:1784290443.404404:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c23443b8700 x1870961901190656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784290443.404406:0:65989:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468ab8000 x1870961901190144/t0(0) o38->lustre-MDT0000-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1784290463 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.404414:0:65989:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1870961901190144:12345-0@lo:38:llog_process_th.0 Request processed in 540us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290443.404442:0:65989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00000040:0.0:1784290443.404448:0:65989:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c234479f000 : new rpc_count 0 00000020:00000040:0.0:1784290443.404456:0:65989:0:(genops.c:900:class_export_put()) PUTting export ffff9c234479f000 : new refcount 4 00000100:00000040:1.0:1784290443.404464:0:83795:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005d2bc5b6] to pc [ptlrpcd_rcv+-1] req@ffff9c23443b8700 x1870961901190656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.404479:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1784290443.404485:0:83795:0:(genops.c:1231:class_import_get()) import ffff9c2450097000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1784290443.404488:0:3616:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c23443b8700 x1870961901190656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.404500:0:83795:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff9c23443bb100 x1870961901190784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290443.404501:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23443b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901190656:0@lo:8:kworker.0 00000100:00000040:1.0:1784290443.404531:0:83795:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005edb66b4] to pc [ptlrpcd_00_03+3] req@ffff9c23443bb100 x1870961901190784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.404541:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1784290443.404547:0:3616:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c23443b8700 x1870961901190656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784290463 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784290443.404549:0:83795:0:(genops.c:1231:class_import_get()) import ffff9c234563e800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1784290443.404571:0:3616:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290443.404572:0:83795:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff9c23443b9880 x1870961901190912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1784290443.404583:0:83795:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b711c943] to pc [ptlrpcd_00_00+0] req@ffff9c23443b9880 x1870961901190912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.404591:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1784290443.404592:0:3616:0:(events.c:337:request_in_callback()) incoming req@ffff9c246ddf1180 x1870961901190656 msgsize 520 00000020:00000040:1.0:1784290443.404597:0:83795:0:(genops.c:1231:class_import_get()) import ffff9c23458df800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00100000:0.0:1784290443.404609:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784290443.404618:0:83795:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff9c246a48dc00 x1870961901191040/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1784290443.404633:0:83795:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002a3a7a88] to pc [ptlrpcd_00_01+1] req@ffff9c246a48dc00 x1870961901191040/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290443.404638:0:3616:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c23443b8700 x1870961901190656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784290463 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784290443.404683:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1784290443.404687:0:3616:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 1385 usecs (2 jiffies) 00000100:00080000:1.0:1784290443.404690:0:83795:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1784290443.404696:0:83795:0:(import.c:65:import_set_state_nolock()) ffff9c2458110000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1784290443.404709:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:0.0:1784290443.404714:0:3616:0:(client.c:3222:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:1.0:1784290443.404719:0:83795:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 2179 00000100:00000040:0.0:1784290443.404723:0:3616:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2468abb480 x1870961901190144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784290443.404729:0:83795:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784290443.404733:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000100:00000040:1.0:1784290443.404739:0:83795:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 56 to 0@lo 00000020:00000040:0.0:1784290443.404739:0:3616:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3076277 00000020:00000040:0.0:1784290443.404746:0:3616:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2345f44800 refcount=6 00000100:00000040:1.0:1784290443.404751:0:83795:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 57 to 0@lo 00000020:00000040:1.0:1784290443.404756:0:83795:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b30752fd 00000020:00000040:1.0:1784290443.404759:0:83795:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c245fd7f800 refcount=4 00000100:00080000:0.0:1784290443.404759:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:0.0:1784290443.404774:0:3616:0:(genops.c:900:class_export_put()) PUTting export ffff9c2345f44800 : new refcount 5 00000100:00000040:1.0:1784290443.404775:0:83795:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 56 to 0@lo 00000100:00000040:1.0:1784290443.404788:0:83795:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 57 to 0@lo 00000100:00080000:0.0:1784290443.404790:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000020:00000040:1.0:1784290443.404792:0:83795:0:(genops.c:900:class_export_put()) PUTting export ffff9c245fd7f800 : new refcount 3 00000100:00080000:1.0:1784290443.404799:0:83795:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c2458110000 using connection 192.168.202.106@tcp/0@lo 00000100:00080000:0.0:1784290443.404800:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2343905800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000020:00000040:1.0:1784290443.404808:0:83795:0:(genops.c:1231:class_import_get()) import ffff9c2458110000 refcount=5 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:0.0:1784290443.404814:0:3616:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468abb480 x1870961901190144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290453 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.404823:0:83795:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246a48ce00 x1870961901191168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290443.404829:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1870961901190144:0@lo:38:llog_process_th.0 00000100:00000040:0.0:1784290443.404857:0:3616:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2468abb480 x1870961901190144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290453 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.404875:0:83795:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000785f9e7c] to pc [ptlrpcd_rcv+-1] req@ffff9c246a48ce00 x1870961901191168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784290443.404881:0:3616:0:(genops.c:1244:class_import_put()) import ffff9c2343905800 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:1.0:1784290443.404892:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1784290443.404900:0:83795:0:(genops.c:1231:class_import_get()) import ffff9c23454bb800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1784290443.404906:0:3616:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c246a48ce00 x1870961901191168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.404922:0:83795:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff9c246a48d500 x1870961901191296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290443.404934:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901191168:0@lo:8:kworker.0 00000100:00000040:1.0:1784290443.404942:0:83795:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b3aa9f7f] to pc [ptlrpcd_00_02+2] req@ffff9c246a48d500 x1870961901191296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.404952:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000040:0.0:1784290443.404957:0:3616:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c246a48ce00 x1870961901191168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784290458 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784290443.404961:0:83795:0:(genops.c:1231:class_import_get()) import ffff9c246ff64000 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1784290443.404971:0:3616:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290443.404977:0:83795:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff9c2447b90a80 x1870961901191424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784290443.404990:0:3616:0:(events.c:337:request_in_callback()) incoming req@ffff9c246ddf0380 x1870961901191168 msgsize 520 00000100:00000040:1.0:1784290443.404998:0:83795:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001f1ef20b] to pc [ptlrpcd_00_03+3] req@ffff9c2447b90a80 x1870961901191424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.405000:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784290443.405014:0:3616:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c246a48ce00 x1870961901191168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784290458 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290443.405055:0:3616:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 1916 usecs (2 jiffies) 00000100:00000040:1.0:1784290443.405066:0:83795:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (2189) 00000100:00000040:1.0:1784290443.405102:0:3617:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c24483ce680 x1870961901190272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.405104:0:26259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901190656 00000100:00100000:0.0:1784290443.405113:0:26259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901190656 00000020:00000040:0.0:1784290443.405121:0:26259:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b306f1b3 00000100:00100000:1.0:1784290443.405129:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1870961901190272:0@lo:400:kworker.0 00000100:00100000:0.0:1784290443.405154:0:26259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901191168 00000100:00100000:0.0:1784290443.405158:0:26259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901191168 00000100:00000040:1.0:1784290443.405161:0:3617:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c24483ce680 x1870961901190272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784290443.405161:0:26259:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307530b 00000100:00000040:1.0:1784290443.405180:0:3617:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1784290443.405185:0:26259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5047 00000100:00000040:0.0:1784290443.405191:0:26259:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246ddf1180 x1870961901190656/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784290463 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.405200:0:26259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ddf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3616:x1870961901190656:12345-0@lo:8:kworker.0 00000020:00000040:0.0:1784290443.405209:0:26259:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2445c14d40) now 7 - find 00010000:00000040:0.0:1784290443.405214:0:26259:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:0.0:1784290443.405217:0:26259:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9c2445c14d40) now 7 - find 00000100:00000040:1.0:1784290443.405225:0:3617:0:(events.c:337:request_in_callback()) incoming req@ffff9c2447b93b80 x1870961901190272 msgsize 224 00000100:00000040:0.0:1784290443.405228:0:26259:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 58 to 0@lo 00000100:00000040:0.0:1784290443.405240:0:26259:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c247b2be100 refcount 58 to 0@lo 00000100:00100000:1.0:1784290443.405249:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784290443.405252:0:26259:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784290443.405280:0:26259:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9c23443b8700 x1870961901190656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784290463 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.405294:0:3617:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c24483ce680 x1870961901190272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290443.405304:0:26259:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 57 to 0@lo 00000100:00000040:1.0:1784290443.405310:0:3617:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 1778 usecs (2 jiffies) 00000100:00000040:1.0:1784290443.405326:0:3617:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c23443b9880 x1870961901190912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290443.405329:0:26259:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf1180 x1870961901190656/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1784290463 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.405419:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23443b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1870961901190912:0@lo:400:kworker.0 00000100:00100000:0.0:1784290443.405420:0:26259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ddf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3616:x1870961901190656:12345-0@lo:8:kworker.0 Request processed in 218us (825us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784290443.405440:0:26259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5047 00000020:00000040:3.0:1784290443.405442:0:96635:0:(genops.c:889:class_export_get()) GET export ffff9c2345f44800 refcount=6 00000020:00000040:3.0:1784290443.405448:0:96635:0:(genops.c:889:class_export_get()) GET export ffff9c2345f44800 refcount=7 00000020:00000040:3.0:1784290443.405454:0:96635:0:(genops.c:900:class_export_put()) PUTting export ffff9c2345f44800 : new refcount 6 00000100:00000040:1.0:1784290443.405456:0:3617:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c23443b9880 x1870961901190912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.405461:0:26259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5048 00000100:00000040:0.0:1784290443.405469:0:26259:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246ddf0380 x1870961901191168/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784290463 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.405508:0:26259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ddf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3616:x1870961901191168:12345-0@lo:8:kworker.0 00000100:00000040:1.0:1784290443.405509:0:3617:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:0.0:1784290443.405522:0:26259:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2445c14d40) now 7 - find 00010000:00000040:0.0:1784290443.405528:0:26259:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:0.0:1784290443.405529:0:26259:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9c2445c14d40) now 7 - find 00000100:00000040:0.0:1784290443.405540:0:26259:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 58 to 0@lo 00000100:00000040:0.0:1784290443.405543:0:26259:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c247b2be100 refcount 58 to 0@lo 00000100:00000040:1.0:1784290443.405545:0:3617:0:(events.c:337:request_in_callback()) incoming req@ffff9c2447b95c00 x1870961901190912 msgsize 224 00000100:00000040:0.0:1784290443.405550:0:26259:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:1.0:1784290443.405559:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784290443.405584:0:26259:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9c246a48ce00 x1870961901191168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784290458 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.405585:0:3617:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c23443b9880 x1870961901190912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.405678:0:3617:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 38110 usecs (39 jiffies) 00000100:00000040:0.0:1784290443.405684:0:26259:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 57 to 0@lo 00000100:00000040:0.0:1784290443.405688:0:26259:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf0380 x1870961901191168/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1784290463 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.405691:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784290443.405706:0:26259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ddf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3616:x1870961901191168:12345-0@lo:8:kworker.0 Request processed in 200us (713us total) trans 0 rc -11/-11 00000100:00000040:1.0:1784290443.405707:0:3617:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2467ee4700 x1870961901190400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.405737:0:26259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5048 00000100:00100000:1.0:1784290443.405757:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2467ee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1870961901190400:0@lo:400:kworker.0 00000100:00100000:0.0:1784290443.405762:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901190272 00000100:00100000:0.0:1784290443.405770:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901190272 00000020:00000040:0.0:1784290443.405772:0:65990:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075454 00000100:00000040:1.0:1784290443.405778:0:3617:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2467ee4700 x1870961901190400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784290443.405780:0:65990:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2343834800 refcount=5 00000100:00000040:1.0:1784290443.405796:0:3617:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:0.0:1784290443.405803:0:65990:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9c2474fd3380) now 16 - evictor 00000100:00000040:1.0:1784290443.405815:0:3617:0:(events.c:337:request_in_callback()) incoming req@ffff9c2447b95f80 x1870961901190400 msgsize 224 00000100:00100000:1.0:1784290443.405820:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784290443.405831:0:65990:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:1.0:1784290443.405852:0:3617:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2467ee4700 x1870961901190400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.405877:0:3617:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 1720 usecs (2 jiffies) 00000100:00000040:1.0:1784290443.405886:0:3617:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c246a48dc00 x1870961901191040/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.405892:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901190912 00000100:00100000:2.0:1784290443.405897:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901190400 00000100:00100000:1.0:1784290443.405899:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901191040:0@lo:400:kworker.0 00000100:00100000:0.0:1784290443.405899:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901190912 00000100:00100000:2.0:1784290443.405906:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901190400 00000020:00000040:0.0:1784290443.405909:0:65990:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307545b 00000020:00000040:2.0:1784290443.405919:0:66004:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b306f231 00000020:00000040:0.0:1784290443.405920:0:65990:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c244c90c000 refcount=5 00000020:00000040:2.0:1784290443.405927:0:66004:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c24481c0000 refcount=5 00000100:00000040:1.0:1784290443.405930:0:3617:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c246a48dc00 x1870961901191040/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.405941:0:3617:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:2.0:1784290443.405945:0:66004:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9c24449119c0) now 10 - evictor 00000100:00100000:0.0:1784290443.405951:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00000040:0.0:1784290443.405955:0:65990:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2343834800 : new rpc_count 1 00000100:00000040:0.0:1784290443.405959:0:65990:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2447b93b80 x1870961901190272/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:464/0 lens 224/0 e 0 to 0 dl 1784290454 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.405971:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1870961901190272:12345-0@lo:400:kworker.0 00000100:00000040:1.0:1784290443.405975:0:3617:0:(events.c:337:request_in_callback()) incoming req@ffff9c2344e91180 x1870961901191040 msgsize 224 00000100:00100000:2.0:1784290443.405981:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00010000:00000040:0.0:1784290443.405984:0:65990:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901190272 00000100:00100000:1.0:1784290443.405992:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784290443.405996:0:66004:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c244c90c000 : new rpc_count 1 00000100:00000040:0.0:1784290443.406000:0:65990:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 58 to 0@lo 00000100:00000040:2.0:1784290443.406005:0:66004:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2447b95c00 x1870961901190912/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:464/0 lens 224/0 e 0 to 0 dl 1784290454 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290443.406008:0:65990:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1784290443.406027:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1870961901190912:12345-0@lo:400:kworker.0 00000100:00000040:1.0:1784290443.406035:0:3617:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c246a48dc00 x1870961901191040/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290443.406037:0:65990:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c24483ce680 x1870961901190272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1784290443.406043:0:66004:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901190912 00000100:00000040:2.0:1784290443.406057:0:66004:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 59 to 0@lo 00000100:00000040:2.0:1784290443.406074:0:66004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290443.406103:0:66004:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c23443b9880 x1870961901190912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290443.406120:0:65990:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 58 to 0@lo 00000100:00000040:1.0:1784290443.406125:0:3617:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 1598 usecs (2 jiffies) 00000100:00000040:0.0:1784290443.406128:0:65990:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2447b93b80 x1870961901190272/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:464/0 lens 224/224 e 0 to 0 dl 1784290454 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.406131:0:66004:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 57 to 0@lo 00000100:00000040:2.0:1784290443.406141:0:66004:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2447b95c00 x1870961901190912/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:464/0 lens 224/224 e 0 to 0 dl 1784290454 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.406149:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1870961901190272:12345-0@lo:400:kworker.0 Request processed in 174us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290443.406156:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1870961901190912:12345-0@lo:400:kworker.0 Request processed in 134us (606us total) trans 0 rc 0/0 00000100:00000040:1.0:1784290443.406157:0:3617:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00100000:0.0:1784290443.406162:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00000040:0.0:1784290443.406171:0:65990:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2343834800 : new rpc_count 0 00000100:00000040:1.0:1784290443.406173:0:3617:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c24483ce680 x1870961901190272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.406177:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000020:00000040:0.0:1784290443.406185:0:65990:0:(genops.c:900:class_export_put()) PUTting export ffff9c2343834800 : new refcount 4 00000100:00000040:2.0:1784290443.406187:0:66004:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c244c90c000 : new rpc_count 0 00000020:00000040:2.0:1784290443.406207:0:66004:0:(genops.c:900:class_export_put()) PUTting export ffff9c244c90c000 : new refcount 4 00000100:00000040:1.0:1784290443.406208:0:3617:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c24483ce680 x1870961901190272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.406209:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00000040:0.0:1784290443.406220:0:65990:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c24481c0000 : new rpc_count 1 00000100:00100000:1.0:1784290443.406232:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1870961901190272:0@lo:400:kworker.0 00000100:00000040:0.0:1784290443.406233:0:65990:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2447b95f80 x1870961901190400/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:464/0 lens 224/0 e 0 to 0 dl 1784290454 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.406249:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1870961901190400:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1784290443.406276:0:65990:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901190400 00000100:00000040:1.0:1784290443.406284:0:3617:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:0.0:1784290443.406284:0:65990:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 58 to 0@lo 00000100:00000040:0.0:1784290443.406292:0:65990:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290443.406300:0:3617:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c23443b9880 x1870961901190912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.406310:0:3617:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c23443b9880 x1870961901190912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290443.406319:0:65990:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c2467ee4700 x1870961901190400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.406324:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23443b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1870961901190912:0@lo:400:kworker.0 00010000:00010000:2.0:1784290443.406374:0:96633:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000100:00000040:0.0:1784290443.406377:0:65990:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 57 to 0@lo 00000100:00000040:0.0:1784290443.406386:0:65990:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2447b95f80 x1870961901190400/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:464/0 lens 224/224 e 0 to 0 dl 1784290454 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.406388:0:3617:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c24483ce680 x1870961901190272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.406438:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1870961901190400:12345-0@lo:400:kworker.0 Request processed in 190us (617us total) trans 0 rc 0/0 00000020:00000040:1.0:1784290443.406444:0:3617:0:(genops.c:1244:class_import_put()) import ffff9c2342ef2800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00100000:0.0:1784290443.406451:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00000040:0.0:1784290443.406455:0:65990:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c24481c0000 : new rpc_count 0 00000100:00000040:1.0:1784290443.406467:0:3617:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c23443b9880 x1870961901190912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784290443.406467:0:65990:0:(genops.c:900:class_export_put()) PUTting export ffff9c24481c0000 : new refcount 4 00000020:00000040:2.0:1784290443.406474:0:96633:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9c24581b19c0) now 4 - setup 00000020:00000080:2.0:1784290443.406488:0:96633:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000100:00080000:0.0:1784290443.406488:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1784290443.406498:0:3617:0:(genops.c:1244:class_import_put()) import ffff9c234563e800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000020:00000040:0.0:1784290443.406499:0:6484:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9c24449119c0) now 10 - evictor 00000100:00080000:0.0:1784290443.406512:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1784290443.406516:0:6484:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9c2474fd3380) now 16 - evictor 00000010:01000000:2.0:1784290443.406521:0:96633:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000040:2.0:1784290443.406527:0:96633:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2345f40000 with handle 0x5953bbf6b307628c to hash 00000100:00000040:1.0:1784290443.406537:0:3617:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00100000:0.0:1784290443.406538:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901191040 00000020:00000040:2.0:1784290443.406539:0:96633:0:(genops.c:889:class_export_get()) GET export ffff9c2345f40000 refcount=3 00000020:00000040:2.0:1784290443.406554:0:96633:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9c24581b19c0) now 5 - export 00000100:00100000:0.0:1784290443.406555:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901191040 00000100:00000040:1.0:1784290443.406559:0:3617:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2467ee4700 x1870961901190400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784290443.406563:0:23867:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b30752f6 00000020:00000040:2.0:1784290443.406564:0:96633:0:(genops.c:900:class_export_put()) PUTting export ffff9c2345f40000 : new refcount 2 00000020:00000080:2.0:1784290443.406572:0:96633:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x5953bbf6b307628c 00000020:00000040:0.0:1784290443.406573:0:23867:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2458116800 refcount=5 00000020:00000040:2.0:1784290443.406581:0:96633:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307628c 00000020:00000040:2.0:1784290443.406590:0:96633:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2345f40000 refcount=3 00000100:00000040:0.0:1784290443.406594:0:23867:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00000040:1.0:1784290443.406595:0:3617:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2467ee4700 x1870961901190400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784290443.406615:0:96633:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00100000:1.0:1784290443.406621:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2467ee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1870961901190400:0@lo:400:kworker.0 00000100:00000040:2.0:1784290443.406627:0:96633:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 58 to 0@lo 00000100:00100000:0.0:1784290443.406632:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3917 00000020:00000040:2.0:1784290443.406638:0:96633:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307628c 00000100:00000040:0.0:1784290443.406641:0:23867:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2458116800 : new rpc_count 1 00000020:00000040:2.0:1784290443.406642:0:96633:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2345f40000 refcount=4 00000100:00000040:1.0:1784290443.406651:0:3617:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2467ee4700 x1870961901190400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.406652:0:96633:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 59 to 0@lo 00000100:00000040:0.0:1784290443.406653:0:23867:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2344e91180 x1870961901191040/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:464/0 lens 224/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.406662:0:96633:0:(genops.c:900:class_export_put()) PUTting export ffff9c2345f40000 : new refcount 3 00000100:00080000:2.0:1784290443.406677:0:96633:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9c2469a70800 using connection 192.168.202.106@tcp/0@lo 00000020:00000040:2.0:1784290443.406696:0:96633:0:(genops.c:1231:class_import_get()) import ffff9c2469a70800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00100000:2.0:1784290443.406724:0:96633:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2468abb480 x1870961901191552/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:1.0:1784290443.406731:0:3617:0:(genops.c:1244:class_import_put()) import ffff9c2342ef4800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00100000:0.0:1784290443.406738:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344e91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3617:x1870961901191040:12345-0@lo:400:kworker.0 00000100:00000040:2.0:1784290443.406740:0:96633:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d43bb516] to pc [ptlrpcd_rcv+-1] req@ffff9c2468abb480 x1870961901191552/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784290443.406758:0:96633:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000020:00000040:2.0:1784290443.406761:0:96633:0:(genops.c:1231:class_import_get()) import ffff9c2469a70800 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00010000:00000040:0.0:1784290443.406764:0:23867:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901191040 00000100:00000040:0.0:1784290443.406783:0:23867:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 60 to 0@lo 00000100:00000040:0.0:1784290443.406791:0:23867:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290443.406810:0:3619:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c23443ba300 x1870961901190528/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290443.406817:0:23867:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c246a48dc00 x1870961901191040/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.406856:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23443ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901190528:0@lo:400:kworker.0 00000020:00000040:2.0:1784290443.406885:0:96633:0:(genops.c:889:class_export_get()) GET export ffff9c2345f40000 refcount=4 00000100:00000040:0.0:1784290443.406886:0:23867:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 59 to 0@lo 00000100:00000040:0.0:1784290443.406895:0:23867:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2344e91180 x1870961901191040/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:464/0 lens 224/224 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.406896:0:96633:0:(genops.c:889:class_export_get()) GET export ffff9c2345f40000 refcount=5 00000100:00000040:1.0:1784290443.406902:0:3619:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c23443ba300 x1870961901190528/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000040:00080000:2.0:1784290443.406946:0:96633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64 count 63 00000100:00100000:0.0:1784290443.406957:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344e91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3617:x1870961901191040:12345-0@lo:400:kworker.0 Request processed in 220us (973us total) trans 0 rc 0/0 00000100:00000040:1.0:1784290443.406966:0:3619:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1784290443.406972:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3917 00000100:00000040:0.0:1784290443.406978:0:23867:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2458116800 : new rpc_count 0 00000020:00000040:0.0:1784290443.406994:0:23867:0:(genops.c:900:class_export_put()) PUTting export ffff9c2458116800 : new refcount 4 00000100:00000040:1.0:1784290443.406996:0:3619:0:(events.c:337:request_in_callback()) incoming req@ffff9c2344e90380 x1870961901190528 msgsize 224 00000100:00100000:1.0:1784290443.407012:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290443.407046:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901190528 00000100:00000040:1.0:1784290443.407053:0:3619:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c23443ba300 x1870961901190528/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.407054:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901190528 00000020:01000000:3.0:1784290443.407057:0:96622:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 00000020:00000040:0.0:1784290443.407061:0:8413:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b30752b0 00000020:00000040:0.0:1784290443.407070:0:8413:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c247e4b0800 refcount=7 00000020:00000040:2.0:1784290443.407083:0:96636:0:(genops.c:900:class_export_put()) PUTting export ffff9c2345f40000 : new refcount 4 00000100:00000040:0.0:1784290443.407093:0:8413:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00000040:1.0:1784290443.407094:0:3619:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 2703942 usecs (2704 jiffies) 00000100:00000040:1.0:1784290443.407117:0:3619:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c246a48d500 x1870961901191296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1784290443.407122:0:96622:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:0.0:1784290443.407136:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3918 00000100:00000040:0.0:1784290443.407139:0:8413:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c247e4b0800 : new rpc_count 1 00000100:00100000:1.0:1784290443.407145:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901191296:0@lo:400:kworker.0 00000100:00000040:0.0:1784290443.407146:0:8413:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2344e90380 x1870961901190528/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:464/0 lens 224/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784290443.407148:0:96622:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c23450aae00 refcount=3 00010000:00010000:3.0:1784290443.407164:0:96622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3076262 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3076269 expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290443.407185:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3619:x1870961901190528:12345-0@lo:400:kworker.0 00010000:00010000:3.0:1784290443.407187:0:96622:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c23450aae00/0x5953bbf6b3076262 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b3076269 expref: -99 pid: 96622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1784290443.407187:0:3619:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c246a48d500 x1870961901191296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1784290443.407201:0:8413:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 115964117002, transno 0, xid 1870961901190528 00000100:00000040:0.0:1784290443.407219:0:8413:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 60 to 0@lo 00000100:00000040:0.0:1784290443.407236:0:8413:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290443.407245:0:3619:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784290443.407259:0:8413:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c23443ba300 x1870961901190528/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290443.407279:0:8413:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 59 to 0@lo 00000100:00000040:1.0:1784290443.407282:0:3619:0:(events.c:337:request_in_callback()) incoming req@ffff9c2344e93480 x1870961901191296 msgsize 224 00000020:01000004:3.0:1784290443.407291:0:96622:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000100:00000040:0.0:1784290443.407299:0:8413:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2344e90380 x1870961901190528/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:464/0 lens 224/224 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:01000004:3.0:1784290443.407301:0:96622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000100:00100000:1.0:1784290443.407308:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1784290443.407311:0:96622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784290443.407321:0:96622:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784290443.407325:0:96622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:0.0:1784290443.407327:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344e90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3619:x1870961901190528:12345-0@lo:400:kworker.0 Request processed in 148us (329us total) trans 0 rc 0/0 00000020:01000004:3.0:1784290443.407335:0:96622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000100:00100000:0.0:1784290443.407336:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3918 00000020:01000004:3.0:1784290443.407373:0:96622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784290443.407378:0:96622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784290443.407380:0:96622:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00000040:0.0:1784290443.407384:0:8413:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c247e4b0800 : new rpc_count 0 10000000:01000000:3.0:1784290443.407387:0:96622:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1784290443.407394:0:96622:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000100:00100000:2.0:1784290443.407395:0:26255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901191296 00000020:01000004:3.0:1784290443.407397:0:96622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000100:00100000:2.0:1784290443.407401:0:26255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901191296 00000020:01000004:3.0:1784290443.407402:0:96622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:00000040:0.0:1784290443.407402:0:8413:0:(genops.c:900:class_export_put()) PUTting export ffff9c247e4b0800 : new refcount 6 00000020:00000040:2.0:1784290443.407406:0:26255:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075320 00000020:01000004:3.0:1784290443.407408:0:96622:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:00000040:2.0:1784290443.407411:0:26255:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2343902000 refcount=5 00000020:01000004:3.0:1784290443.407412:0:96622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784290443.407418:0:96622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784290443.407420:0:96622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784290443.407423:0:96622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784290443.407426:0:96622:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:00000040:2.0:1784290443.407427:0:26255:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9c2342163380) now 10 - evictor 00000020:00000040:3.0:1784290443.407436:0:96622:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000100:00000040:0.0:1784290443.407446:0:3616:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2468abb480 x1870961901191552/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.407453:0:26255:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00000040:1.0:1784290443.407455:0:3619:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c246a48d500 x1870961901191296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1784290443.407457:0:96622:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1784290443.407458:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1870961901191552:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784290443.407478:0:26255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1641 00000100:00000040:3.0:1784290443.407480:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2447ccb480 x1870961901191680/t0(0) o253->MGC192.168.202.106@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.407487:0:26255:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2343902000 : new rpc_count 1 00000100:00000040:0.0:1784290443.407495:0:3616:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2468abb480 x1870961901191552/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784290453 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.407502:0:26255:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2344e93480 x1870961901191296/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:464/0 lens 224/0 e 0 to 0 dl 1784290454 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.407534:0:3619:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 2871 usecs (3 jiffies) 00000100:00100000:3.0:1784290443.407550:0:96622:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447ccb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901191680:0@lo:253:mount.lustre.0 00000100:00000040:0.0:1784290443.407559:0:3616:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1784290443.407563:0:26255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901191296:12345-0@lo:400:kworker.0 00000100:00000040:3.0:1784290443.407583:0:96622:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2447ccb480 x1870961901191680/t0(0) o253->MGC192.168.202.106@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784290459 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1784290443.407585:0:26255:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968634, transno 0, xid 1870961901191296 00000100:00000040:1.0:1784290443.407587:0:3619:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 115964117002 00000100:00000040:0.0:1784290443.407591:0:3616:0:(events.c:337:request_in_callback()) incoming req@ffff9c246ddf3480 x1870961901191552 msgsize 520 00000100:00000040:2.0:1784290443.407597:0:26255:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 60 to 0@lo 00000100:00000040:1.0:1784290443.407606:0:3619:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c23443ba300 x1870961901190528/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.407608:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784290443.407615:0:26255:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784290443.407638:0:3616:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2468abb480 x1870961901191552/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784290453 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290443.407645:0:96622:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290443.407647:0:26255:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c246a48d500 x1870961901191296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.407659:0:3619:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c23443ba300 x1870961901190528/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290443.407681:0:96622:0:(events.c:337:request_in_callback()) incoming req@ffff9c247e454050 x1870961901191680 msgsize 4848 00000100:00100000:3.0:1784290443.407717:0:96622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784290443.407717:0:3616:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00000040:2.0:1784290443.407722:0:26255:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 59 to 0@lo 00000100:00000040:3.0:1784290443.407727:0:96622:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1784290443.407743:0:26255:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2344e93480 x1870961901191296/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:464/0 lens 224/224 e 0 to 0 dl 1784290454 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.407745:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23443ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901190528:0@lo:400:kworker.0 00000100:00000040:0.0:1784290443.407754:0:3616:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294968632 00000100:00000040:3.0:1784290443.407759:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c2447ccb480 x1870961901191680/t0(0) o253->MGC192.168.202.106@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784290459 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.407771:0:26255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901191296:12345-0@lo:400:kworker.0 Request processed in 209us (484us total) trans 0 rc 0/0 00000100:00000040:0.0:1784290443.407771:0:3616:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c246a48ce00 x1870961901191168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784290458 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.407790:0:26255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1641 00000100:00000040:1.0:1784290443.407791:0:3619:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968634 00000100:00000040:2.0:1784290443.407796:0:26255:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2343902000 : new rpc_count 0 00000100:00100000:3.0:1784290443.407801:0:96622:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c246dab4000 going to sleep for 11 seconds 00000100:00080000:0.0:1784290443.407805:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2458110000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000020:00000040:2.0:1784290443.407812:0:26255:0:(genops.c:900:class_export_put()) PUTting export ffff9c2343902000 : new refcount 4 00000100:00000040:1.0:1784290443.407816:0:3619:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c246a48d500 x1870961901191296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290443.407816:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1784290443.407833:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901191680 00000100:00000040:0.0:1784290443.407835:0:3616:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246a48ce00 x1870961901191168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784290458 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.407842:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901191680 00000100:00000040:1.0:1784290443.407843:0:3619:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246a48d500 x1870961901191296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784290443.407852:0:94059:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:3.0:1784290443.407878:0:94059:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=24 00000100:00100000:0.0:1784290443.407881:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a48ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901191168:0@lo:8:kworker.0 00000100:00000040:3.0:1784290443.407903:0:94059:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784290443.407910:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a48d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901191296:0@lo:400:kworker.0 00000100:00000040:1.0:1784290443.407921:0:3619:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c23443ba300 x1870961901190528/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290443.407924:0:3616:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294968631 00000100:00000040:0.0:1784290443.407935:0:3616:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c23443b8700 x1870961901190656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784290463 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784290443.407938:0:3619:0:(genops.c:1244:class_import_put()) import ffff9c246dd98000 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00100000:3.0:1784290443.407951:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00080000:0.0:1784290443.407955:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ead000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00000040:1.0:1784290443.407957:0:3619:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c246a48d500 x1870961901191296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290443.407964:0:3616:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:3.0:1784290443.407977:0:94059:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:0.0:1784290443.407982:0:3616:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c23443b8700 x1870961901190656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784290463 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784290443.407992:0:3619:0:(genops.c:1244:class_import_put()) import ffff9c23454bb800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1784290443.408000:0:94059:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c247e454050 x1870961901191680/t0(0) o253->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 4848/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.408006:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23443b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901190656:0@lo:8:kworker.0 00000100:00100000:1.0:1784290443.408008:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00000040:0.0:1784290443.408028:0:3616:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c246a48ce00 x1870961901191168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784290458 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.408034:0:3619:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c23443bb100 x1870961901190784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.408037:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:96622:x1870961901191680:12345-0@lo:253:mount.lustre.0 00000020:00000040:0.0:1784290443.408062:0:3616:0:(genops.c:1244:class_import_put()) import ffff9c2458110000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:0.0:1784290443.408076:0:3616:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c23443b8700 x1870961901190656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1784290463 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 20000000:01000000:3.0:1784290443.408079:0:94059:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:1.0:1784290443.408081:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c23443bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901190784:0@lo:400:kworker.0 20000000:01000000:3.0:1784290443.408098:0:94059:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:00000040:0.0:1784290443.408101:0:3616:0:(genops.c:1244:class_import_put()) import ffff9c2341ead000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1784290443.408117:0:3619:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c23443bb100 x1870961901190784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.408130:0:3619:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1784290443.408132:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901191552 00000100:00100000:0.0:1784290443.408136:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901191552 00000020:00000040:0.0:1784290443.408138:0:66004:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00000040:1.0:1784290443.408156:0:3619:0:(events.c:337:request_in_callback()) incoming req@ffff9c2475eba450 x1870961901190784 msgsize 224 00000100:00100000:1.0:1784290443.408170:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784290443.408173:0:3619:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:0.0:1784290443.408175:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00000040:0.0:1784290443.408184:0:66004:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246ddf3480 x1870961901191552/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1784290463 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.408195:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ddf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1870961901191552:12345-0@lo:38:llog_process_th.0 00000100:00000040:1.0:1784290443.408201:0:3619:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c23443bb100 x1870961901190784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784290443.408203:0:66004:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9c24449119c0) now 10 - find 00010000:00000040:0.0:1784290443.408219:0:66004:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-MDT0001: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00000100:00000040:1.0:1784290443.408227:0:3619:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 1356 usecs (2 jiffies) 00010000:00080000:0.0:1784290443.408228:0:66004:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 2184 last 0 00000020:00000040:0.0:1784290443.408237:0:66004:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2475c48000 with handle 0x5953bbf6b3076293 to hash 00000100:00000040:1.0:1784290443.408239:0:3619:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2447b90a80 x1870961901191424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.408256:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1870961901191424:0@lo:400:kworker.0 00000020:00000040:0.0:1784290443.408261:0:66004:0:(genops.c:889:class_export_get()) GET export ffff9c2475c48000 refcount=3 00000020:00000040:0.0:1784290443.408272:0:66004:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9c24449119c0) now 11 - export 00000020:00000040:0.0:1784290443.408276:0:66004:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c48000 : new refcount 2 00000020:00000080:0.0:1784290443.408278:0:66004:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x5953bbf6b3076293 00000020:00000040:0.0:1784290443.408280:0:66004:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3076293 00000020:00000040:0.0:1784290443.408282:0:66004:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c48000 refcount=3 00000001:00000040:0.0:1784290443.408289:0:66004:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.202.106@tcp 00000001:00000040:0.0:1784290443.408292:0:66004:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9c2344606400) : new refcount 18 00000100:00000040:1.0:1784290443.408296:0:3619:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2447b90a80 x1870961901191424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784290443.408298:0:66004:0:(genops.c:889:class_export_get()) GET export ffff9c2475c48000 refcount=4 00000001:00000040:0.0:1784290443.408307:0:66004:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9c2344606400) : new refcount 19 00000001:00000040:0.0:1784290443.408318:0:66004:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9c2344606400) : new refcount 18 00000004:00100000:0.0:1784290443.408334:0:66004:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00000040:1.0:1784290443.408335:0:3619:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:0.0:1784290443.408409:0:66004:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9c2345ff1ae0 for nid 0@lo - ref 4 00000020:00000040:0.0:1784290443.408423:0:66004:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9c24449119c0) now 12 - import 00000020:00000040:0.0:1784290443.408441:0:66004:0:(genops.c:1244:class_import_put()) import ffff9c2475c4d000 refcount=1 obd=lustre-MDT0001 00000100:00000040:1.0:1784290443.408442:0:3619:0:(events.c:337:request_in_callback()) incoming req@ffff9c2344e91880 x1870961901191424 msgsize 224 00000020:00000040:0.0:1784290443.408448:0:66004:0:(genops.c:889:class_export_get()) GET export ffff9c2475c48000 refcount=5 00000100:00000040:0.0:1784290443.408456:0:66004:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9c2475c48000 : new rpc_count 1 00000100:00000040:2.0:1784290443.408460:0:83795:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (2189) 00000100:00100000:1.0:1784290443.408467:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784290443.408468:0:66004:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 60 to 0@lo 00000100:00000040:0.0:1784290443.408479:0:66004:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c247b2be100 refcount 60 to 0@lo 00000020:00000040:0.0:1784290443.408484:0:66004:0:(genops.c:889:class_export_get()) GET export ffff9c2475c48000 refcount=6 00000100:00000040:0.0:1784290443.408493:0:66004:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 61 to 0@lo 00000100:00000040:1.0:1784290443.408498:0:3619:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2447b90a80 x1870961901191424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290443.408500:0:66004:0:(import.c:65:import_set_state_nolock()) ffff9c2475c4d000 : changing import state from RECOVER to FULL 00000020:00000040:0.0:1784290443.408510:0:66004:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c48000 : new refcount 5 00000020:00000040:0.0:1784290443.408520:0:66004:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9c24449119c0) now 12 - find 00000100:00000040:1.0:1784290443.408524:0:3619:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 4406 usecs (5 jiffies) 00010000:00000040:0.0:1784290443.408530:0:66004:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901191552 00000100:00000040:0.0:1784290443.408540:0:66004:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 62 to 0@lo 00000100:00000040:0.0:1784290443.408546:0:66004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784290443.408575:0:66004:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9c2468abb480 x1870961901191552/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784290453 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290443.408595:0:66004:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 61 to 0@lo 00000100:00000040:0.0:1784290443.408598:0:66004:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf3480 x1870961901191552/t0(0) o38->lustre-MDT0001-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1784290463 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.408612:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ddf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1870961901191552:12345-0@lo:38:llog_process_th.0 Request processed in 420us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290443.408618:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00000040:0.0:1784290443.408620:0:66004:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c48000 : new rpc_count 0 00000020:00000040:0.0:1784290443.408630:0:66004:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c48000 : new refcount 4 00000100:00100000:0.0:1784290443.408638:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901191424 00000100:00100000:0.0:1784290443.408641:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901191424 00000020:00000040:0.0:1784290443.408643:0:66004:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075462 00000020:00000040:0.0:1784290443.408645:0:66004:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2342c83800 refcount=5 00000100:00000040:0.0:1784290443.408653:0:66004:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1784290443.408671:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00000040:0.0:1784290443.408673:0:66004:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2342c83800 : new rpc_count 1 00000100:00000040:0.0:1784290443.408677:0:66004:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2344e91880 x1870961901191424/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:464/0 lens 224/0 e 0 to 0 dl 1784290454 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.408686:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1870961901191424:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1784290443.408695:0:66004:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901191424 00000100:00000040:0.0:1784290443.408699:0:66004:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 62 to 0@lo 00000100:00000040:0.0:1784290443.408701:0:66004:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784290443.408715:0:66004:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c2447b90a80 x1870961901191424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290443.408736:0:66004:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 61 to 0@lo 00000100:00000040:0.0:1784290443.408744:0:66004:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2344e91880 x1870961901191424/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:464/0 lens 224/224 e 0 to 0 dl 1784290454 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.408753:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344e91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1870961901191424:12345-0@lo:400:kworker.0 Request processed in 68us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290443.408763:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00000040:1.0:1784290443.408766:0:3619:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:1.0:1784290443.408777:0:3619:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2447b90a80 x1870961901191424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290443.408780:0:66004:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2342c83800 : new rpc_count 0 00000100:00000040:1.0:1784290443.408796:0:3619:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2447b90a80 x1870961901191424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784290443.408800:0:66004:0:(genops.c:900:class_export_put()) PUTting export ffff9c2342c83800 : new refcount 4 00000100:00100000:1.0:1784290443.408811:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1870961901191424:0@lo:400:kworker.0 00000100:00000040:1.0:1784290443.408821:0:3619:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2447b90a80 x1870961901191424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784290443.408832:0:3619:0:(genops.c:1244:class_import_put()) import ffff9c246ff64000 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00100000:0.0:1784290443.408838:0:15642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901190784 00000100:00100000:0.0:1784290443.408844:0:15642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901190784 00000020:00000040:0.0:1784290443.408846:0:15642:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b306f1c1 00000020:00000040:0.0:1784290443.408850:0:15642:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2342c84000 refcount=5 00000100:00000040:0.0:1784290443.408873:0:15642:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:0.0:1784290443.408896:0:15642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1642 00000100:00000040:0.0:1784290443.408910:0:15642:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2342c84000 : new rpc_count 1 00000100:00000040:0.0:1784290443.408916:0:15642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2475eba450 x1870961901190784/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:464/0 lens 224/0 e 0 to 0 dl 1784290454 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.408927:0:15642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901190784:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1784290443.408939:0:15642:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968618, transno 0, xid 1870961901190784 00000100:00000040:0.0:1784290443.408943:0:15642:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 62 to 0@lo 00000100:00000040:0.0:1784290443.408946:0:15642:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784290443.408965:0:15642:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c23443bb100 x1870961901190784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290443.408984:0:15642:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 61 to 0@lo 00000100:00000040:0.0:1784290443.408987:0:15642:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2475eba450 x1870961901190784/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:464/0 lens 224/224 e 0 to 0 dl 1784290454 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.408996:0:15642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475eba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3619:x1870961901190784:12345-0@lo:400:kworker.0 Request processed in 70us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290443.409005:0:15642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1642 00000100:00000040:0.0:1784290443.409008:0:15642:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2342c84000 : new rpc_count 0 00000020:00000040:0.0:1784290443.409023:0:15642:0:(genops.c:900:class_export_put()) PUTting export ffff9c2342c84000 : new refcount 4 00000100:00000040:1.0:1784290443.409031:0:3619:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294968618 00000100:00000040:1.0:1784290443.409040:0:3619:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c23443bb100 x1870961901190784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.409052:0:3619:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c23443bb100 x1870961901190784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.409061:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c23443bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1870961901190784:0@lo:400:kworker.0 00000100:00000040:1.0:1784290443.409077:0:3619:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c23443bb100 x1870961901190784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784290443.409099:0:3619:0:(genops.c:1244:class_import_put()) import ffff9c2450097000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00080000:0.0:1784290443.409227:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1784290443.409231:0:6484:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9c2342163380) now 10 - evictor 00000100:00100000:0.0:1784290443.409252:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:0.0:1784290443.409254:0:3616:0:(client.c:3222:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:0.0:1784290443.409266:0:3616:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2468abb480 x1870961901191552/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290443.409273:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 19 00000020:00000040:0.0:1784290443.409275:0:3616:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307628c 00000020:00000040:0.0:1784290443.409278:0:3616:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2345f40000 refcount=5 00000100:00080000:0.0:1784290443.409282:0:3616:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:0.0:1784290443.409284:0:3616:0:(genops.c:900:class_export_put()) PUTting export ffff9c2345f40000 : new refcount 4 00000100:00080000:0.0:1784290443.409286:0:3616:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1784290443.409289:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2469a70800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00000040:0.0:1784290443.409295:0:3616:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468abb480 x1870961901191552/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290453 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.409301:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1870961901191552:0@lo:38:llog_process_th.0 00000100:00000040:0.0:1784290443.409308:0:3616:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2468abb480 x1870961901191552/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784290453 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784290443.409315:0:3616:0:(genops.c:1244:class_import_put()) import ffff9c2469a70800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:0.0:1784290443.409337:0:3617:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1784290443.409365:0:3617:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c246a48dc00 x1870961901191040/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290443.409374:0:3617:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246a48dc00 x1870961901191040/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.409382:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a48dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901191040:0@lo:400:kworker.0 00000100:00000040:0.0:1784290443.409390:0:3617:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c246a48dc00 x1870961901191040/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1784290459 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784290443.409398:0:3617:0:(genops.c:1244:class_import_put()) import ffff9c23458df800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 20000000:01000000:0.0:1784290443.410633:0:94059:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784290443.410652:0:94059:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1784290443.410667:0:94061:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1784290443.410672:0:94061:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00000040:1.0:1784290443.410679:0:94061:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c2475800100 count: 4 00000020:00000040:1.0:1784290443.410685:0:94061:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c2474ea5a00 with handle 0x5953bbf6b307629a to hash 00010000:00010000:1.0:1784290443.410690:0:94061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c2474ea5a00/0x5953bbf6b307629a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290443.410702:0:94061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b307536d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075366 expref: 24 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290443.410710:0:94061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c247d2ff400/0x5953bbf6b3075389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b3075382 expref: 24 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290443.410718:0:94061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c247f8cae00/0x5953bbf6b3075431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2597 expref: 9 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290443.410724:0:94061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c2474ea5a00/0x5953bbf6b307629a lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784290443.410730:0:94061:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9c2475800100) refcount = 4 00010000:00000040:1.0:1784290443.410732:0:94061:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1784290443.410735:0:94061:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c247f8cae00/0x5953bbf6b3075431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2597 expref: 9 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784290443.410742:0:94061:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c247d2ff400/0x5953bbf6b3075389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x5953bbf6b3075382 expref: 24 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784290443.410747:0:94061:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b307536d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x5953bbf6b3075366 expref: 24 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1784290443.410761:0:94061:0:(ldlm_resource.c:1894:ldlm_resource_dump()) Waiting locks: 00010000:00000040:1.0:1784290443.410764:0:94061:0:(ldlm_resource.c:1896:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c2474ea5a00/0x5953bbf6b307629a lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1784290443.410777:0:94061:0:(genops.c:1231:class_import_get()) import ffff9c2474cc0800 refcount=2 obd=MGS 00010000:00010000:1.0:1784290443.410788:0:94061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c247f8cae00/0x5953bbf6b3075431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2597 expref: 9 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290443.410800:0:94061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c247f8cae00/0x5953bbf6b3075431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2597 expref: 9 pid: 94060 timeout: 2284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1784290443.410811:0:94061:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2344e90a80 x1870961901191808/t0(0) o104->MGS@192.168.202.6@tcp:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784290443.410819:0:94061:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2344e90a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94061:1870961901191808:192.168.202.6@tcp:104: 00000100:00000040:1.0:1784290443.410836:0:94061:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff9c2344e90a80 x1870961901191808/t0(0) o104->MGS@192.168.202.6@tcp:15/16 lens 328/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00000040:0.0:1784290443.410837:0:94059:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901191680 00000100:00000040:0.0:1784290443.410854:0:94059:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 62 to 0@lo 00000100:00000040:1.0:1784290443.410875:0:94061:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290443.410879:0:94059:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784290443.410914:0:94059:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff9c2447ccb480 x1870961901191680/t0(0) o253->MGC192.168.202.106@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290443.410956:0:94059:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 61 to 0@lo 00000020:00000040:1.0:1784290443.410957:0:94061:0:(genops.c:1231:class_import_get()) import ffff9c2474ebb800 refcount=2 obd=MGS 00000100:00000040:3.0:1784290443.410981:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2447ccb480 x1870961901191680/t0(0) o253->MGC192.168.202.106@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784290459 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290443.410981:0:94059:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c247e454050 x1870961901191680/t0(0) o253->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 4848/4768 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1784290443.410987:0:94061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c247d2ff400/0x5953bbf6b3075389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3075382 expref: 24 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1784290443.411048:0:96622:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2447ccb480 x1870961901191680/t0(0) o253->MGC192.168.202.106@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784290459 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1784290443.411051:0:94061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c247d2ff400/0x5953bbf6b3075389 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3075382 expref: 24 pid: 94060 timeout: 2284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784290443.411053:0:3612:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2344e90a80 x1870961901191808/t0(0) o104->MGS@192.168.202.6@tcp:15/16 lens 328/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290443.411053:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:96622:x1870961901191680:12345-0@lo:253:mount.lustre.0 Request processed in 3015us (3360us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290443.411101:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00000040:0.0:1784290443.411115:0:94059:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000100:00000040:1.0:1784290443.411121:0:94061:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2344e93b80 x1870961901191936/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784290443.411133:0:94061:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2344e93b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94061:1870961901191936:0@lo:104: 00000020:00000040:0.0:1784290443.411133:0:94059:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 23 00000100:00000040:1.0:1784290443.411162:0:94061:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff9c2344e93b80 x1870961901191936/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1784290443.411175:0:94061:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1784290443.411195:0:96622:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447ccb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2e54cd1c-9dbd-4e31-b60e-998135d46053:96622:1870961901191680:0@lo:253:mount.lustre.0 00000100:00000040:1.0:1784290443.411196:0:94061:0:(events.c:337:request_in_callback()) incoming req@ffff9c246a473050 x1870961901191936 msgsize 328 00000100:00100000:1.0:1784290443.411211:0:94061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784290443.411214:0:94061:0:(events.c:349:request_in_callback()) Buffer complete: 0 buffers still posted 00000100:00000040:3.0:1784290443.411226:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2447ccb480 x1870961901191680/t0(0) o253->MGC192.168.202.106@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784290459 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.411241:0:94061:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2344e93b80 x1870961901191936/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:3.0:1784290443.411243:0:96622:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1784290443.411250:0:96622:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784290443.411258:0:96622:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000100:00100000:0.0:1784290443.411262:0:6517:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000020:01000004:3.0:1784290443.411263:0:96622:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784290443.411269:0:96622:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784290443.411273:0:96622:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784290443.411276:0:96622:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784290443.411278:0:96622:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784290443.411281:0:96622:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:0.0:1784290443.411282:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901191936 00000020:01000004:3.0:1784290443.411283:0:96622:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:00000040:1.0:1784290443.411286:0:94061:0:(genops.c:1231:class_import_get()) import ffff9c2474ebb800 refcount=3 obd=MGS 00000100:00100000:0.0:1784290443.411289:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901191936 00000100:00000040:3.0:1784290443.411294:0:96622:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2447ccb480 x1870961901191680/t0(0) o253->MGC192.168.202.106@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784290443.411295:0:6517:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b30300fd 00000020:00000040:0.0:1784290443.411299:0:6517:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2450096800 refcount=3 00010000:00010000:1.0:1784290443.411306:0:94061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b307536d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5953bbf6b3075366 expref: 23 pid: 94059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1784290443.411315:0:6517:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_cbd at +6s 00000100:00100000:0.0:1784290443.411373:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00010000:00010000:1.0:1784290443.411374:0:94061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b307536d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5953bbf6b3075366 expref: 23 pid: 94059 timeout: 2284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1784290443.411386:0:6517:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2450096800 : new rpc_count 1 00000100:00000040:0.0:1784290443.411401:0:6517:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246a473050 x1870961901191936/t0(0) o104->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 328/0 e 0 to 0 dl 1784290454 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1784290443.411406:0:94061:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2344e92a00 x1870961901192064/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290443.411449:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a473050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:94061:x1870961901191936:12345-0@lo:104: 00000020:00000040:3.0:1784290443.411453:0:96622:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 00000100:00100000:1.0:1784290443.411454:0:94061:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2344e92a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94061:1870961901192064:0@lo:104: 00000020:02000000:3.0:1784290443.411476:0:96622:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00000040:0.0:1784290443.411477:0:6517:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c234236d800 refcount=2 00000100:00000040:1.0:1784290443.411484:0:94061:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff9c2344e92a00 x1870961901192064/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1784290443.411491:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c234236d800/0x5953bbf6b3075382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3075389 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1784290443.411492:0:94061:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290443.411511:0:94061:0:(events.c:337:request_in_callback()) incoming req@ffff9c2344e90000 x1870961901192064 msgsize 328 00000100:00100000:1.0:1784290443.411524:0:94061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784290443.411549:0:6517:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 62 to 0@lo 00000100:00000040:0.0:1784290443.411559:0:6517:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290443.411561:0:94061:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2344e92a00 x1870961901192064/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290443.411567:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901192064 00000100:00100000:2.0:1784290443.411577:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901192064 00000020:00000040:2.0:1784290443.411580:0:6471:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b30300fd 00000020:00000040:2.0:1784290443.411585:0:6471:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2450096800 refcount=4 00000100:00000040:0.0:1784290443.411593:0:6517:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff9c2344e93b80 x1870961901191936/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784290443.411627:0:94061:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2461c15c00 going to sleep for 11 seconds 00000100:00000040:0.0:1784290443.411629:0:6517:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 61 to 0@lo 00000100:00100000:2.0:1784290443.411636:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00000040:2.0:1784290443.411642:0:6471:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2450096800 : new rpc_count 2 00000100:00000040:2.0:1784290443.411651:0:6471:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2344e90000 x1870961901192064/t0(0) o104->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 328/0 e 0 to 0 dl 1784290454 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1784290443.411652:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00000040:1.0:1784290443.411661:0:94061:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2344e93b80 x1870961901191936/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784290443.411668:0:6517:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246a473050 x1870961901191936/t0(0) o104->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 328/224 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00002000:00000040:3.0:1784290443.411695:0:96622:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x3:0x0] 00000100:00100000:2.0:1784290443.411717:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344e90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:94061:x1870961901192064:12345-0@lo:104: 00002000:00000040:3.0:1784290443.411725:0:96622:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0xf:0x0] 00000020:00000040:2.0:1784290443.411740:0:6471:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c247d2fe400 refcount=2 00000100:00000040:1.0:1784290443.411745:0:94061:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2344e93b80 x1870961901191936/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784290459 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784290443.411747:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a473050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2e54cd1c-9dbd-4e31-b60e-998135d46053+4:94061:x1870961901191936:12345-0@lo:104: Request processed in 299us (544us total) trans 0 rc 0/0 00010000:00010000:2.0:1784290443.411751:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe400/0x5953bbf6b3075366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b307536d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784290443.411786:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00000040:0.0:1784290443.411798:0:6517:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2450096800 : new rpc_count 1 00002000:00000040:3.0:1784290443.411803:0:96622:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x4:0x0] 00000100:00000040:2.0:1784290443.411807:0:6471:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 62 to 0@lo 00000100:00100000:1.0:1784290443.411808:0:94061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2344e93b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94061:1870961901191936:0@lo:104: 00000020:00000040:0.0:1784290443.411810:0:6517:0:(genops.c:900:class_export_put()) PUTting export ffff9c2450096800 : new refcount 3 00000100:00000040:2.0:1784290443.411814:0:6471:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290443.411844:0:6471:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff9c2344e92a00 x1870961901192064/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1784290443.411879:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00000040:3.0:1784290443.411883:0:96622:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x1:0x0] 00000100:00000040:2.0:1784290443.411884:0:6471:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 61 to 0@lo 00010000:00010000:0.0:1784290443.411888:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c234236d800/0x5953bbf6b3075382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b3075389 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290443.411898:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c234236d800 already unused, calling callback (ffffffffc14a9c20) 10000000:00010000:0.0:1784290443.411913:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c234236d800/0x5953bbf6b3075382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b3075389 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290443.411919:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000020:00000040:0.0:1784290443.411920:0:7429:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c234236d800 refcount=3 00000100:00000040:1.0:1784290443.411927:0:94061:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2344e92a00 x1870961901192064/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784290443.411929:0:6471:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2344e90000 x1870961901192064/t0(0) o104->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 328/224 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1784290443.411930:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c234236d800/0x5953bbf6b3075382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b3075389 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000040:3.0:1784290443.411948:0:96622:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x10:0x0] 10000000:00010000:0.0:1784290443.411978:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c234236d800/0x5953bbf6b3075382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b3075389 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000040:3.0:1784290443.412006:0:96622:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x5:0x0] 00000100:00100000:2.0:1784290443.412009:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344e90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2e54cd1c-9dbd-4e31-b60e-998135d46053+3:94061:x1870961901192064:12345-0@lo:104: Request processed in 300us (490us total) trans 0 rc 0/0 00000100:00000040:1.0:1784290443.412010:0:94061:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2344e92a00 x1870961901192064/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784290459 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290443.412051:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00000040:2.0:1784290443.412065:0:6471:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2450096800 : new rpc_count 0 10000000:01000000:0.0:1784290443.412072:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1784290443.412075:0:94061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2344e92a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94061:1870961901192064:0@lo:104: 00000020:00000040:2.0:1784290443.412078:0:6471:0:(genops.c:900:class_export_put()) PUTting export ffff9c2450096800 : new refcount 2 10000000:00000040:0.0:1784290443.412079:0:7429:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=1) 10000000:00000040:0.0:1784290443.412091:0:7429:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:0.0:1784290443.412109:0:7429:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9c2470e22c00) refs 2 00000020:00000040:0.0:1784290443.412117:0:7429:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9c234236d800 with handle 0x5953bbf6b3075382 from hash 00010000:00010000:1.0:1784290443.412121:0:19681:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00000040:0.0:1784290443.412128:0:7429:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00010000:00010000:1.0:1784290443.412131:0:19681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe400/0x5953bbf6b3075366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5953bbf6b307536d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290443.412141:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c234236d800/0x5953bbf6b3075382 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075389 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290443.412143:0:19681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c247d2fe400 already unused, calling callback (ffffffffc14a9c20) 00002000:00000040:3.0:1784290443.412145:0:96622:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x2:0x0] 00010000:00010000:0.0:1784290443.412158:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1784290443.412160:0:19681:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe400/0x5953bbf6b3075366 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5953bbf6b307536d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1784290443.412171:0:7429:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000099b8f715] to pc [ptlrpcd_00_00+0] req@ffff9c246ddf1c00 x1870961901192192/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784290443.412174:0:19681:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c247d2fe400 refcount=3 00010000:00010000:1.0:1784290443.412186:0:19681:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe400/0x5953bbf6b3075366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5953bbf6b307536d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000040:3.0:1784290443.412197:0:96622:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x16:0x0] 00010000:00010000:0.0:1784290443.412214:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c234236d800/0x5953bbf6b3075382 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075389 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784290443.412215:0:19681:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe400/0x5953bbf6b3075366 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5953bbf6b307536d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784290443.412224:0:3617:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c246ddf1c00 x1870961901192192/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00002000:00000040:3.0:1784290443.412252:0:96622:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000003:0x6:0x0] 00010000:00010000:0.0:1784290443.412265:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c234236d800/0x5953bbf6b3075382 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b3075389 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784290443.412274:0:19681:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:2.0:1784290443.412278:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246ddf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901192192:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784290443.412282:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784290443.412290:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00000040:1.0:1784290443.412292:0:19681:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=3) 00010000:00010000:0.0:1784290443.412294:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00000040:1.0:1784290443.412302:0:19681:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 00000100:00000040:2.0:1784290443.412306:0:3617:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c246ddf1c00 x1870961901192192/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1784290443.412308:0:19681:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9c247b202600) refs 2 00002000:00000040:3.0:1784290443.412319:0:96622:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000005:0x3:0x0] 00000100:00000040:2.0:1784290443.412326:0:3617:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:1.0:1784290443.412327:0:19681:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9c247d2fe400 with handle 0x5953bbf6b3075366 from hash 00000020:00000040:1.0:1784290443.412341:0:19681:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=5 obd=MGC192.168.202.106@tcp 00000100:00000040:2.0:1784290443.412374:0:3617:0:(events.c:337:request_in_callback()) incoming req@ffff9c2468abb480 x1870961901192192 msgsize 328 00000100:00100000:2.0:1784290443.412381:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784290443.412401:0:19681:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe400/0x5953bbf6b3075366 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307536d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290443.412408:0:19681:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:0.0:1784290443.412426:0:3611:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff9c2344e90a80 x1870961901191808/t0(0) o104->MGS@192.168.202.6@tcp:15/16 lens 328/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1784290443.412427:0:3617:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c246ddf1c00 x1870961901192192/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290443.412428:0:19681:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e0e2bfec] to pc [ptlrpcd_00_01+1] req@ffff9c2344e92300 x1870961901192320/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1784290443.412529:0:19681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe400/0x5953bbf6b3075366 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307536d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290443.412540:0:19681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.106@tcp lock: ffff9c247d2fe400/0x5953bbf6b3075366 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5953bbf6b307536d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290443.412546:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00000040:1.0:1784290443.412547:0:19681:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff9c244ab48300 count: 0 00000100:00000040:2.0:1784290443.412556:0:3617:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2344e92300 x1870961901192320/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290443.412578:0:3611:0:(events.c:337:request_in_callback()) incoming req@ffff9c246ddf1180 x1870961896338688 msgsize 328 00000100:00100000:2.0:1784290443.412580:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2344e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901192320:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290443.412582:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290443.412597:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784290443.412604:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784290443.412610:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901192192 00000100:00100000:0.0:1784290443.412613:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00000040:2.0:1784290443.412615:0:3617:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2344e92300 x1870961901192320/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.412618:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901192192 00000020:00000040:3.0:1784290443.412624:0:19592:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000100:00000040:2.0:1784290443.412626:0:3617:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:3.0:1784290443.412632:0:19592:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=24 00000100:00000040:2.0:1784290443.412647:0:3617:0:(events.c:337:request_in_callback()) incoming req@ffff9c2468abbb80 x1870961901192320 msgsize 328 00000100:00100000:2.0:1784290443.412656:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784290443.412672:0:3617:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2344e92300 x1870961901192320/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784290459 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290443.412692:0:94061:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2344e90a80 x1870961901191808/t0(0) o104->MGS@192.168.202.6@tcp:15/16 lens 328/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784290443.412696:0:10356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896338688 00000100:00000040:3.0:1784290443.412701:0:19592:0:(service.c:1432:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000100:00100000:2.0:1784290443.412702:0:10356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896338688 00000100:00000040:0.0:1784290443.412704:0:94061:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2344e90a80 x1870961901191808/t0(0) o104->MGS@192.168.202.6@tcp:15/16 lens 328/224 e 0 to 0 dl 1784290459 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1784290443.412706:0:10356:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307542a 00000020:00000040:2.0:1784290443.412709:0:10356:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2474cc5000 refcount=10 00000020:00000040:3.0:1784290443.412712:0:19592:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c247d2ff400 refcount=4 00010000:00010000:3.0:1784290443.412723:0:19592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c247d2ff400/0x5953bbf6b3075389 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075382 expref: 24 pid: 94060 timeout: 2284 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1784290443.412725:0:10356:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c247f8cae00 refcount=4 00000100:00100000:0.0:1784290443.412726:0:94061:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2344e90a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:94061:1870961901191808:192.168.202.6@tcp:104: 00010000:00010000:2.0:1784290443.412736:0:10356:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c247f8cae00/0x5953bbf6b3075431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2597 expref: 10 pid: 94060 timeout: 2284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1784290443.412741:0:94061:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2344e93b80 x1870961901191936/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:0.0:1784290443.412758:0:94061:0:(genops.c:1244:class_import_put()) import ffff9c2474ebb800 refcount=2 obd=MGS 00000100:00100000:3.0:1784290443.412766:0:19592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901192320 00000100:00100000:3.0:1784290443.412772:0:19592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901192320 00000100:00000040:0.0:1784290443.412773:0:94061:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2344e92a00 x1870961901192064/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:3.0:1784290443.412775:0:19592:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:3.0:1784290443.412780:0:19592:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=25 00000100:00100000:2.0:1784290443.412787:0:10356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2637 00000100:00000040:2.0:1784290443.412794:0:10356:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000020:00000040:0.0:1784290443.412796:0:94061:0:(genops.c:1244:class_import_put()) import ffff9c2474ebb800 refcount=1 obd=MGS 00000020:00000040:3.0:1784290443.412797:0:19592:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2345ebe000 refcount=4 00000100:00000040:2.0:1784290443.412802:0:10356:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2468abb480 x1870961901192192/t0(0) o103->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 328/0 e 0 to 0 dl 1784290454 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1784290443.412812:0:19592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b307536d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075366 expref: 25 pid: 94059 timeout: 2284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784290443.412812:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 2638 00000100:00000040:0.0:1784290443.412814:0:94061:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2344e90a80 x1870961901191808/t0(0) o104->MGS@192.168.202.6@tcp:15/16 lens 328/224 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1784290443.412828:0:9491:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2474cc5000 : new rpc_count 1 00000100:00000040:1.0:1784290443.412844:0:9491:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246ddf1180 x1870961896338688/t0(0) o103->fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f@192.168.202.6@tcp:464/0 lens 328/0 e 0 to 0 dl 1784290454 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784290443.412882:0:94061:0:(genops.c:1244:class_import_put()) import ffff9c2474cc0800 refcount=1 obd=MGS 00000100:00100000:2.0:1784290443.412883:0:10356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468abb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2e54cd1c-9dbd-4e31-b60e-998135d46053+25:3617:x1870961901192192:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784290443.412899:0:19592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639 00010000:00010000:0.0:1784290443.412903:0:94061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c2474ea5a00/0x5953bbf6b307629a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1784290443.412904:0:19592:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 2 00010000:00010000:2.0:1784290443.412908:0:10356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1784290443.412915:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ddf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2400:x1870961896338688:12345-192.168.202.6@tcp:103:ldlm_bl.0 00000100:00000040:3.0:1784290443.412917:0:19592:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2468abbb80 x1870961901192320/t0(0) o103->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 328/0 e 0 to 0 dl 1784290454 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.412917:0:10356:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c247d2ff400 refcount=4 00010000:00000040:2.0:1784290443.412927:0:10356:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c2475800100 count: 6 00010000:00010000:2.0:1784290443.412939:0:10356:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c247d2ff400/0x5953bbf6b3075389 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075382 expref: 25 pid: 94060 timeout: 2284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290443.412951:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:1.0:1784290443.412961:0:9491:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c247f8cae00 refcount=4 00000100:00100000:3.0:1784290443.412973:0:19592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+25:3617:x1870961901192320:12345-0@lo:103:ldlm_bl.0 00010000:00000040:1.0:1784290443.412975:0:9491:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c2475800100 count: 7 00010000:00010000:2.0:1784290443.412984:0:10356:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c247d2ff400/0x5953bbf6b3075389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3075382 expref: 25 pid: 94060 timeout: 2284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290443.412990:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c247f8cae00/0x5953bbf6b3075431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2597 expref: 10 pid: 94060 timeout: 2284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290443.412995:0:19592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:2.0:1784290443.413001:0:10356:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9c247d2ff400 with handle 0x5953bbf6b3075389 from hash 00010000:00010000:2.0:1784290443.413009:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247d2ff400/0x5953bbf6b3075389 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3075382 expref: 25 pid: 94060 timeout: 2284 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1784290443.413010:0:19592:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2345ebe000 refcount=4 00010000:00000040:3.0:1784290443.413018:0:19592:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c2475800100 count: 9 00010000:00010000:1.0:1784290443.413022:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c247f8cae00/0x5953bbf6b3075431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2597 expref: 10 pid: 94060 timeout: 2284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784290443.413023:0:10356:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff9c2475c4c800 : new locks_count 17 00010000:00010000:3.0:1784290443.413030:0:19592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b307536d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5953bbf6b3075366 expref: 25 pid: 94059 timeout: 2284 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1784290443.413032:0:10356:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 24 00010000:00000040:2.0:1784290443.413064:0:10356:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff9c2474ea5a00 00010000:00010000:2.0:1784290443.413070:0:10356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:2.0:1784290443.413075:0:10356:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 62 to 0@lo 00000020:00000040:1.0:1784290443.413079:0:9491:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9c247f8cae00 with handle 0x5953bbf6b3075431 from hash 00000100:00000040:2.0:1784290443.413085:0:10356:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00010000:1.0:1784290443.413094:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c247f8cae00/0x5953bbf6b3075431 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2597 expref: 10 pid: 94060 timeout: 2284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290443.413102:0:19592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b307536d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5953bbf6b3075366 expref: 24 pid: 94059 timeout: 2284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784290443.413106:0:10356:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c246ddf1c00 x1870961901192192/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784290443.413155:0:19592:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9c2345ebe000 with handle 0x5953bbf6b307536d from hash 00010000:00000040:1.0:1784290443.413158:0:9491:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff9c2474cc5000 : new locks_count 3 00000020:00000040:1.0:1784290443.413165:0:9491:0:(genops.c:900:class_export_put()) PUTting export ffff9c2474cc5000 : new refcount 9 00010000:00010000:3.0:1784290443.413172:0:19592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2345ebe000/0x5953bbf6b307536d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5953bbf6b3075366 expref: 24 pid: 94059 timeout: 2284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784290443.413176:0:10356:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 61 to 0@lo 00010000:00000040:1.0:1784290443.413177:0:9491:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff9c2474ea5a00 00000100:00000040:2.0:1784290443.413190:0:10356:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468abb480 x1870961901192192/t0(0) o103->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 328/224 e 0 to 0 dl 1784290454 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1784290443.413190:0:9491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c2474ea5a00/0x5953bbf6b307629a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784290443.413193:0:19592:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff9c2475c4c800 : new locks_count 16 00000020:00000040:3.0:1784290443.413205:0:19592:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 23 00000100:00100000:2.0:1784290443.413240:0:10356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468abb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:3617:x1870961901192192:12345-0@lo:103:ldlm_bl.0 Request processed in 383us (864us total) trans 0 rc 0/0 00010000:00000040:1.0:1784290443.413240:0:9491:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9c2475800100) refcount = 3 00000100:00100000:2.0:1784290443.413259:0:10356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2637 00010000:00010000:1.0:1784290443.413260:0:9491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c2474ea5a00/0x5953bbf6b307629a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784290443.413262:0:10356:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 1 00010000:00010000:3.0:1784290443.413276:0:19592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000040:2.0:1784290443.413276:0:10356:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 22 00000100:00000040:3.0:1784290443.413286:0:19592:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 62 to 0@lo 20000000:01000000:1.0:1784290443.413288:0:9491:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002613964s 00000020:00000040:1.0:1784290443.413294:0:9491:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2474ea5a00 refcount=5 00000100:00000040:3.0:1784290443.413295:0:19592:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00010000:1.0:1784290443.413306:0:9491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2474ea5a00/0x5953bbf6b307629a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784290443.413307:0:3617:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c246ddf1c00 x1870961901192192/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290443.413328:0:19592:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9c2344e92300 x1870961901192320/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.413369:0:3617:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf1c00 x1870961901192192/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784290459 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.413386:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246ddf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901192192:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784290443.413401:0:9491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c2474ea5a00/0x5953bbf6b307629a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784290443.413408:0:3617:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c246ddf1c00 x1870961901192192/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290443.413416:0:19592:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 61 to 0@lo 00010000:00010000:1.0:1784290443.413426:0:9491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c2474ea5a00/0x5953bbf6b307629a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1784290443.413427:0:19592:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468abbb80 x1870961901192320/t0(0) o103->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:464/0 lens 328/224 e 0 to 0 dl 1784290454 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290443.413430:0:3617:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000100:00000040:2.0:1784290443.413455:0:3617:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2344e92300 x1870961901192320/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1784290443.413466:0:9491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c2474ea5a00/0x5953bbf6b307629a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784290443.413475:0:3617:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2344e92300 x1870961901192320/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784290459 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.413476:0:19592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:3617:x1870961901192320:12345-0@lo:103:ldlm_bl.0 Request processed in 509us (820us total) trans 0 rc 0/0 00010000:00010000:1.0:1784290443.413505:0:9491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c2474ea5a00 already unused, calling callback (ffffffffc0ec3230) 00000100:00100000:3.0:1784290443.413517:0:19592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639 00010000:00010000:1.0:1784290443.413519:0:9491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c2474ea5a00/0x5953bbf6b307629a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1784290443.413522:0:19592:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000100:00100000:2.0:1784290443.413523:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2344e92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901192320:0@lo:103:ldlm_bl.0 00000020:00000040:3.0:1784290443.413538:0:19592:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 21 00000100:00000040:2.0:1784290443.413544:0:3617:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2344e92300 x1870961901192320/t0(0) o103->MGC192.168.202.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784290443.413560:0:9491:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c2474ea5a00 refcount=6 00000020:00000040:2.0:1784290443.413566:0:3617:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 00010000:00010000:1.0:1784290443.413568:0:9491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c2474ea5a00/0x5953bbf6b307629a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1784290443.413601:0:9491:0:(lustre_handles.c:107:class_handle_unhash_nolock()) removing object ffff9c2474ea5a00 with handle 0x5953bbf6b307629a from hash 00010000:00010000:1.0:1784290443.413609:0:9491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c2474ea5a00/0x5953bbf6b307629a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290443.413615:0:94061:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c2474ea5a00/0x5953bbf6b307629a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784290443.413619:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:1.0:1784290443.413629:0:9491:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 9 to 192.168.202.6@tcp 00000100:00000040:1.0:1784290443.413649:0:9491:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00010000:00010000:3.0:1784290443.413657:0:94061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c2474ea5a00/0x5953bbf6b307629a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290443.413665:0:94061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c2474ea5a00/0x5953bbf6b307629a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784290443.413670:0:94061:0:(ldlm_resource.c:1704:ldlm_resource_putref()) putref res: ffff9c2475800100 count: 0 00000100:00000040:1.0:1784290443.413687:0:9491:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 8 to 192.168.202.6@tcp 00000100:00000040:1.0:1784290443.413698:0:9491:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf1180 x1870961896338688/t0(0) o103->fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f@192.168.202.6@tcp:464/0 lens 328/224 e 0 to 0 dl 1784290454 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290443.413707:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ddf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:2400:x1870961896338688:12345-192.168.202.6@tcp:103:ldlm_bl.0 Request processed in 810us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290443.413715:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 2638 00000100:00000040:1.0:1784290443.413719:0:9491:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2474cc5000 : new rpc_count 0 00000020:00000040:1.0:1784290443.413734:0:9491:0:(genops.c:900:class_export_put()) PUTting export ffff9c2474cc5000 : new refcount 8 00002000:00000040:2.0:1784290443.414494:0:96622:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x200000001:0x12:0x0] 00010000:00080000:2.0:1784290443.414603:0:96622:0:(ldlm_lib.c:3053:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 4294968653 00010000:00080000:2.0:1784290443.415207:0:96639:0:(ldlm_lib.c:2853:target_recovery_thread()) lustre-OST0000: started recovery thread pid 96639 00010000:02000000:2.0:1784290443.415217:0:96639:0:(ldlm_lib.c:2335:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00000020:01000004:2.0:1784290443.415277:0:96622:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:00000040:2.0:1784290443.415283:0:96622:0:(lustre_log.h:387:llog_ctxt_get()) GETting ctxt ffff9c23422e1780 : new refcount 2 00000040:00000040:2.0:1784290443.415289:0:96622:0:(lustre_log.h:402:llog_ctxt_put()) PUTting ctxt ffff9c23422e1780 : new refcount 1 00000020:00000040:2.0:1784290443.415329:0:96622:0:(genops.c:900:class_export_put()) PUTting export ffff9c234479d800 : new refcount 1 00000020:00000040:2.0:1784290443.415384:0:96622:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.202.106@tcp (ffff9c2480260000) now 6 - mgc_fs 10000000:01000000:2.0:1784290443.415388:0:96622:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784290443.415419:0:96622:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1784290443.415438:0:96622:0:(super25.c:181:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1784290443.416748:0:96622:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1784290443.417272:0:96622:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:2.0:1784290443.417540:0:96639:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:2.0:1784290443.417545:0:96639:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000020:00000040:2.0:1784290443.432037:0:94069:0:(genops.c:1231:class_import_get()) import ffff9c23458df800 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1784290443.432066:0:94069:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005795946f] to pc [ptlrpcd_00_02+2] req@ffff9c2468abb800 x1870961901192448/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.432127:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:2.0:1784290443.432143:0:3620:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2468abb800 x1870961901192448/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.432154:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901192448:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1784290443.432179:0:3620:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2468abb800 x1870961901192448/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784290459 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.432189:0:3620:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290443.432227:0:3620:0:(events.c:337:request_in_callback()) incoming req@ffff9c2475c7fb80 x1870961901192448 msgsize 224 00000100:00100000:2.0:1784290443.432240:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784290443.432270:0:3620:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2468abb800 x1870961901192448/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784290459 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.432283:0:3620:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 1862 usecs (2 jiffies) 00000020:00000040:2.0:1784290443.432315:0:75393:0:(genops.c:1231:class_import_get()) import ffff9c246dd98000 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1784290443.432328:0:75393:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006367a552] to pc [ptlrpcd_00_03+3] req@ffff9c2475818a80 x1870961901192576/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.432389:0:3620:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2475818a80 x1870961901192576/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784290443.432402:0:94073:0:(genops.c:1231:class_import_get()) import ffff9c23454bb800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00100000:2.0:1784290443.432402:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901192576:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1784290443.432423:0:3620:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2475818a80 x1870961901192576/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784290459 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290443.432428:0:94073:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b372070d] to pc [ptlrpcd_00_00+0] req@ffff9c2447ccb480 x1870961901192704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.432436:0:3620:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290443.432451:0:3620:0:(events.c:337:request_in_callback()) incoming req@ffff9c2475818700 x1870961901192576 msgsize 224 00000100:00100000:2.0:1784290443.432461:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1784290443.432482:0:3620:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2475818a80 x1870961901192576/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784290459 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290443.432483:0:3617:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2447ccb480 x1870961901192704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.432502:0:3620:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 2690962 usecs (2691 jiffies) 00000100:00100000:0.0:1784290443.432503:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901192448 00000100:00100000:3.0:1784290443.432504:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2447ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901192704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784290443.432513:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901192448 00000020:00000040:0.0:1784290443.432517:0:23867:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b30752f6 00000020:00000040:0.0:1784290443.432521:0:23867:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2458116800 refcount=5 00000100:00000040:3.0:1784290443.432529:0:3617:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2447ccb480 x1870961901192704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784290459 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290443.432538:0:3617:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784290443.432542:0:23867:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00000040:3.0:1784290443.432562:0:3617:0:(events.c:337:request_in_callback()) incoming req@ffff9c2447cc9880 x1870961901192704 msgsize 224 00000100:00100000:0.0:1784290443.432576:0:23867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901192576 00000100:00100000:3.0:1784290443.432580:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290443.432582:0:23867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901192576 00000020:00000040:0.0:1784290443.432585:0:23867:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b30752b0 00000100:00100000:2.0:1784290443.432589:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3919 00000020:00000040:0.0:1784290443.432589:0:23867:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c247e4b0800 refcount=7 00000100:00000040:2.0:1784290443.432595:0:8413:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2458116800 : new rpc_count 1 00000100:00000040:2.0:1784290443.432602:0:8413:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2475c7fb80 x1870961901192448/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:464/0 lens 224/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290443.432604:0:3617:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2447ccb480 x1870961901192704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784290459 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.432622:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3920 00000100:00100000:2.0:1784290443.432629:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901192448:12345-0@lo:41:osp-pre-1-0.0 00000100:00000040:0.0:1784290443.432630:0:23867:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c247e4b0800 : new rpc_count 1 00000100:00000040:3.0:1784290443.432637:0:3617:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 2915 usecs (3 jiffies) 00000100:00000040:0.0:1784290443.432644:0:23867:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2475818700 x1870961901192576/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:464/0 lens 224/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290443.432660:0:23867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3620:x1870961901192576:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1784290443.432667:0:17967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901192704 00000100:00100000:3.0:1784290443.432672:0:17967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901192704 00000004:00000024:2.0:1784290443.432672:0:8413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445097472 avail 1298857984 00000020:00000040:3.0:1784290443.432677:0:17967:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075320 00000004:00000024:0.0:1784290443.432679:0:23867:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444581376 avail 1298341888 00000020:00000040:3.0:1784290443.432681:0:17967:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2343902000 refcount=5 00010000:00000040:2.0:1784290443.432687:0:8413:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901192448 00000100:00000040:2.0:1784290443.432698:0:8413:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 62 to 0@lo 00010000:00000040:0.0:1784290443.432700:0:23867:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 115964117002, transno 0, xid 1870961901192576 00000100:00000040:3.0:1784290443.432706:0:17967:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00000040:2.0:1784290443.432711:0:8413:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784290443.432712:0:23867:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 63 to 0@lo 00000100:00000040:0.0:1784290443.432719:0:23867:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1784290443.432736:0:17967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00000040:2.0:1784290443.432739:0:8413:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9c2468abb800 x1870961901192448/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290443.432741:0:17967:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2343902000 : new rpc_count 1 00000100:00000040:0.0:1784290443.432747:0:23867:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9c2475818a80 x1870961901192576/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290443.432758:0:17967:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2447cc9880 x1870961901192704/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:464/0 lens 224/0 e 0 to 0 dl 1784290454 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.432769:0:8413:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 62 to 0@lo 00000100:00000040:2.0:1784290443.432775:0:8413:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2475c7fb80 x1870961901192448/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:464/0 lens 224/368 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.432780:0:17967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1870961901192704:12345-0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1784290443.432791:0:23867:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 61 to 0@lo 00000100:00100000:2.0:1784290443.432797:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901192448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 171us (566us total) trans 0 rc 0/0 00002000:00000024:3.0:1784290443.432807:0:17967:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00000040:0.0:1784290443.432808:0:23867:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2475818700 x1870961901192576/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:464/0 lens 224/368 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.432812:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3919 00000100:00000040:2.0:1784290443.432819:0:8413:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2458116800 : new rpc_count 0 00010000:00000040:3.0:1784290443.432821:0:17967:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968634, transno 0, xid 1870961901192704 00000100:00000040:3.0:1784290443.432831:0:17967:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 62 to 0@lo 00000100:00100000:0.0:1784290443.432832:0:23867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3620:x1870961901192576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 172us (372us total) trans 0 rc 0/0 00000020:00000040:2.0:1784290443.432833:0:8413:0:(genops.c:900:class_export_put()) PUTting export ffff9c2458116800 : new refcount 4 00000100:00000040:3.0:1784290443.432841:0:17967:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1784290443.432847:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3920 00000100:00000040:0.0:1784290443.432853:0:23867:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c247e4b0800 : new rpc_count 0 00000020:00000040:0.0:1784290443.432876:0:23867:0:(genops.c:900:class_export_put()) PUTting export ffff9c247e4b0800 : new refcount 6 00000100:00000040:3.0:1784290443.432887:0:17967:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9c2447ccb480 x1870961901192704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.432890:0:3620:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 115964117002 00000100:00000040:2.0:1784290443.432900:0:3620:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2475818a80 x1870961901192576/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1784290443.432911:0:3620:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352681 avail=316978 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023556 state=0: rc = 0 00000100:00000040:3.0:1784290443.432914:0:17967:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 61 to 0@lo 00000100:00000040:3.0:1784290443.432921:0:17967:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2447cc9880 x1870961901192704/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:464/0 lens 224/368 e 0 to 0 dl 1784290454 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290443.432928:0:3620:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2475818a80 x1870961901192576/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784290459 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.432933:0:17967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1870961901192704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290443.432948:0:17967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:2.0:1784290443.432949:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2475818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901192576:0@lo:41:osp-pre-0-1.0 00000100:00000040:3.0:1784290443.432954:0:17967:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2343902000 : new rpc_count 0 00000020:00000040:3.0:1784290443.432964:0:17967:0:(genops.c:900:class_export_put()) PUTting export ffff9c2343902000 : new refcount 4 00000100:00000040:2.0:1784290443.432965:0:3620:0:(client.c:3108:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1784290443.432970:0:3620:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2468abb800 x1870961901192448/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1784290443.432975:0:3620:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352807 avail=317104 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023681 state=0: rc = 0 00000100:00000040:2.0:1784290443.432982:0:3620:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468abb800 x1870961901192448/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784290459 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290443.432988:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901192448:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1784290443.432996:0:3620:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2475818a80 x1870961901192576/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290443.432999:0:3617:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294968634 00000020:00000040:2.0:1784290443.433004:0:3620:0:(genops.c:1244:class_import_put()) import ffff9c246dd98000 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1784290443.433005:0:3617:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2447ccb480 x1870961901192704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1784290443.433015:0:3617:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000100:00000040:2.0:1784290443.433018:0:3620:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2468abb800 x1870961901192448/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1784290443.433019:0:3617:0:(osp_precreate.c:1081:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957637 avail=901062 avail_mb=3519 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000020:00000040:2.0:1784290443.433036:0:3620:0:(genops.c:1244:class_import_put()) import ffff9c23458df800 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1784290443.433037:0:3617:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2447ccb480 x1870961901192704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784290459 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290443.433048:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2447ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1870961901192704:0@lo:13:osp-pre-1-0.0 00000100:00000040:3.0:1784290443.433064:0:3617:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2447ccb480 x1870961901192704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784290459 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784290443.433075:0:3617:0:(genops.c:1244:class_import_put()) import ffff9c23454bb800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000020:00000004:0.0:1784290443.774403:0:96688:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784290443.774694:0:96688:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1784290443.943529:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:00000040:3.0:1784290444.229929:0:96736:0:(lproc_fid.c:547:ldebugfs_client_fid_width_seq_write()) cli-lustre-OST0000-super: Sequence size: 65536 00000020:00000040:1.0:1784290444.594107:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osd (ffff9c2474fd19c0) now 12 - health_check_show 00000020:00000040:1.0:1784290444.594119:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osd (ffff9c2474fd19c0) now 12 - health_check_show 00000020:00000040:1.0:1784290444.594122:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osd (ffff9c2458b9b380) now 10 - health_check_show 00000020:00000040:1.0:1784290444.594126:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osd (ffff9c2458b9b380) now 10 - health_check_show 00000020:00000040:1.0:1784290444.594128:0:96785:0:(obd_config.c:994:class_incref()) incref MGC192.168.202.106@tcp (ffff9c2480260000) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594131:0:96785:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.202.106@tcp (ffff9c2480260000) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594134:0:96785:0:(obd_config.c:994:class_incref()) incref MGS (ffff9c23440d0000) now 8 - health_check_show 00000020:00000040:1.0:1784290444.594138:0:96785:0:(obd_config.c:1022:class_decref()) Decref MGS (ffff9c23440d0000) now 8 - health_check_show 00000020:00000040:1.0:1784290444.594141:0:96785:0:(obd_config.c:994:class_incref()) incref MDS (ffff9c2444910000) now 4 - health_check_show 00000020:00000040:1.0:1784290444.594147:0:96785:0:(obd_config.c:1022:class_decref()) Decref MDS (ffff9c2444910000) now 4 - health_check_show 00000020:00000040:1.0:1784290444.594149:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-mdtlov (ffff9c2341ea0000) now 5 - health_check_show 00000020:00000040:1.0:1784290444.594152:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-mdtlov (ffff9c2341ea0000) now 5 - health_check_show 00000020:00000040:1.0:1784290444.594159:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9c24449119c0) now 12 - health_check_show 00000020:00000040:1.0:1784290444.594162:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9c24449119c0) now 12 - health_check_show 00000020:00000040:1.0:1784290444.594164:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-MDD0001 (ffff9c2445c10000) now 5 - health_check_show 00000020:00000040:1.0:1784290444.594166:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0001 (ffff9c2445c10000) now 5 - health_check_show 00000020:00000040:1.0:1784290444.594168:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osp-MDT0001 (ffff9c2445c119c0) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594171:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osp-MDT0001 (ffff9c2445c119c0) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594173:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0001 (ffff9c2480263380) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594175:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0001 (ffff9c2480263380) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594177:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0001 (ffff9c2480264d40) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594178:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0001 (ffff9c2480264d40) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594181:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0001 (ffff9c246ff699c0) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594183:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0001 (ffff9c246ff699c0) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594185:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-mdtlov (ffff9c2474fd0000) now 5 - health_check_show 00000020:00000040:1.0:1784290444.594187:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-mdtlov (ffff9c2474fd0000) now 5 - health_check_show 00000020:00000040:1.0:1784290444.594188:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9c2474fd3380) now 16 - health_check_show 00000020:00000040:1.0:1784290444.594190:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9c2474fd3380) now 16 - health_check_show 00000020:00000040:1.0:1784290444.594192:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-MDD0000 (ffff9c2474fd4d40) now 5 - health_check_show 00000020:00000040:1.0:1784290444.594194:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0000 (ffff9c2474fd4d40) now 5 - health_check_show 00000020:00000040:1.0:1784290444.594196:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-QMT0000 (ffff9c2445c13380) now 5 - health_check_show 00000020:00000040:1.0:1784290444.594198:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-QMT0000 (ffff9c2445c13380) now 5 - health_check_show 00000020:00000040:1.0:1784290444.594201:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9c247d26cd40) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594204:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osd (ffff9c247d26cd40) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594206:0:96785:0:(obd_config.c:994:class_incref()) incref OSS (ffff9c2458b999c0) now 4 - health_check_show 00000020:00000040:1.0:1784290444.594211:0:96785:0:(obd_config.c:1022:class_decref()) Decref OSS (ffff9c2458b999c0) now 4 - health_check_show 00000020:00000040:1.0:1784290444.594213:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2445c14d40) now 7 - health_check_show 00000020:00000040:1.0:1784290444.594275:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9c2445c14d40) now 7 - health_check_show 00000020:00000040:1.0:1784290444.594278:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff9c24581b0000) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594280:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0000 (ffff9c24581b0000) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594286:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9c24581b19c0) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594288:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0000 (ffff9c24581b19c0) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594291:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osp-MDT0000 (ffff9c23446b4d40) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594292:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osp-MDT0000 (ffff9c23446b4d40) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594295:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0000 (ffff9c23446b0000) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594296:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0000 (ffff9c23446b0000) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594299:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osd (ffff9c2342160000) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594302:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osd (ffff9c2342160000) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594304:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9c2342163380) now 10 - health_check_show 00000020:00000040:1.0:1784290444.594325:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9c2342163380) now 10 - health_check_show 00000020:00000040:1.0:1784290444.594327:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0001 (ffff9c23421619c0) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594329:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0001 (ffff9c23421619c0) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594331:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0001 (ffff9c2342164d40) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594333:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0001 (ffff9c2342164d40) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594335:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0000 (ffff9c23446b19c0) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594337:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0000 (ffff9c23446b19c0) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594362:0:96785:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0000 (ffff9c247d26b380) now 6 - health_check_show 00000020:00000040:1.0:1784290444.594370:0:96785:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0000 (ffff9c247d26b380) now 6 - health_check_show 00000100:00000040:2.0:1784290444.613294:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c247e455c50 x1870961896338816 msgsize 328 00000100:00100000:2.0:1784290444.613309:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00000040:2.0:1784290444.613312:0:3612:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:3.0:1784290444.613408:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896338816 00000100:00100000:3.0:1784290444.613422:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896338816 00000020:00000040:3.0:1784290444.613426:0:94058:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307542a 00000020:00000040:3.0:1784290444.613433:0:94058:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2474cc5000 refcount=9 00000100:00000040:3.0:1784290444.613461:0:94058:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784290444.613508:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 191 00000100:00000040:3.0:1784290444.613513:0:94058:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2474cc5000 : new rpc_count 1 00000100:00000040:3.0:1784290444.613523:0:94058:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c247e455c50 x1870961896338816/t0(0) o101->fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290444.613538:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247e455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+9:70750:x1870961896338816:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784290444.613559:0:94058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00000040:3.0:1784290444.613586:0:94058:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c247d2ffe00 with handle 0x5953bbf6b30762a1 to hash 00010000:00010000:3.0:1784290444.613594:0:94058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c247d2ffe00/0x5953bbf6b30762a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6643efc96c5b2917 expref: -99 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1784290444.613605:0:94058:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9c2474cc5000 : new locks_count 4 00000020:00000040:3.0:1784290444.613608:0:94058:0:(genops.c:889:class_export_get()) GET export ffff9c2474cc5000 refcount=10 00010000:00000040:3.0:1784290444.613637:0:94058:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9c2447160c00) refcount = 1 00010000:00010000:3.0:1784290444.613643:0:94058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c247d2ffe00/0x5953bbf6b30762a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2917 expref: 10 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290444.613654:0:94058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c247d2ffe00/0x5953bbf6b30762a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2917 expref: 10 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784290444.613675:0:94058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c247d2ffe00, rc 0) 00010000:00000040:3.0:1784290444.613680:0:94058:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961896338816 00000100:00000040:3.0:1784290444.613694:0:94058:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 9 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290444.613702:0:94058:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:3.0:1784290444.613759:0:94058:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 8 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290444.613767:0:94058:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c247e455c50 x1870961896338816/t0(0) o101->fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f@192.168.202.6@tcp:465/0 lens 328/344 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290444.613780:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247e455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70750:x1870961896338816:12345-192.168.202.6@tcp:101:ll_cfg_requeue.0 Request processed in 244us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290444.613790:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 191 00000100:00000040:3.0:1784290444.613796:0:94058:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2474cc5000 : new rpc_count 0 00000020:00000040:3.0:1784290444.613812:0:94058:0:(genops.c:900:class_export_put()) PUTting export ffff9c2474cc5000 : new refcount 9 00000100:00000040:2.0:1784290444.614875:0:3610:0:(events.c:337:request_in_callback()) incoming req@ffff9c2445d0a450 x1870961896338944 msgsize 304 00000100:00100000:2.0:1784290444.614883:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00000040:2.0:1784290444.614886:0:3610:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:3.0:1784290444.614924:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896338944 00000100:00100000:3.0:1784290444.614929:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896338944 00000020:00000040:3.0:1784290444.614931:0:94062:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307542a 00000020:00000040:3.0:1784290444.614933:0:94062:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2474cc5000 refcount=10 00000100:00000040:3.0:1784290444.614946:0:94062:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784290444.614971:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 192 00000100:00000040:3.0:1784290444.614974:0:94062:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2474cc5000 : new rpc_count 1 00000100:00000040:3.0:1784290444.614978:0:94062:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2445d0a450 x1870961896338944/t0(0) o256->fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f@192.168.202.6@tcp:465/0 lens 304/0 e 0 to 0 dl 1784290455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290444.614998:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70750:x1870961896338944:12345-192.168.202.6@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784290444.615015:0:94062:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:00000040:3.0:1784290444.615029:0:94062:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:3.0:1784290444.615037:0:94062:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784290444.615040:0:94062:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000020:00000040:3.0:1784290444.615052:0:94062:0:(genops.c:889:class_export_get()) GET export ffff9c2474cc5000 refcount=11 00000020:00000040:3.0:1784290444.615937:0:94062:0:(genops.c:900:class_export_put()) PUTting export ffff9c2474cc5000 : new refcount 10 00010000:00000040:3.0:1784290444.615958:0:94062:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961896338944 00000100:00000040:3.0:1784290444.615966:0:94062:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 9 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290444.615972:0:94062:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:3.0:1784290444.616009:0:94062:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 8 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290444.616016:0:94062:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2445d0a450 x1870961896338944/t0(0) o256->fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f@192.168.202.6@tcp:465/0 lens 304/240 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290444.616028:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:70750:x1870961896338944:12345-192.168.202.6@tcp:256:ll_cfg_requeue.0 Request processed in 1039us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290444.616038:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 192 00000100:00000040:3.0:1784290444.616042:0:94062:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2474cc5000 : new rpc_count 0 00000020:00000040:3.0:1784290444.616053:0:94062:0:(genops.c:900:class_export_put()) PUTting export ffff9c2474cc5000 : new refcount 9 00000100:00000040:2.0:1784290444.616969:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c2475818a80 x1870961896339072 msgsize 520 00000100:00100000:2.0:1784290444.616975:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290444.617071:0:26250:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896339072 00000100:00100000:1.0:1784290444.617086:0:26250:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896339072 00000020:00000040:1.0:1784290444.617091:0:26250:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075493 00000100:00100000:1.0:1784290444.617163:0:26250:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5049 00000100:00000040:1.0:1784290444.617175:0:26250:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2475818a80 x1870961896339072/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784290464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290444.617193:0:26250:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2396:x1870961896339072:12345-192.168.202.6@tcp:8:ll_cfg_requeue.0 00000020:00000040:1.0:1784290444.617214:0:26250:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2445c14d40) now 7 - find 00010000:00000040:1.0:1784290444.617230:0:26250:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa0467af2e3640038 tmp_exp_old_falloc: 0 00010000:00080000:1.0:1784290444.617253:0:26250:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID '711f3c77-e791-4aa8-86ee-bc854fd0bcc5' at ffff9c246dce7800, cookie 0x5953bbf6b307624d 00010000:00080000:1.0:1784290444.617261:0:26250:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp recovering/t4294968633 exp ffff9c246dce7800 cur 2185 last 1784290443 00010000:02000400:1.0:1784290444.617272:0:26250:0:(ldlm_lib.c:2036:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00010000:00080000:1.0:1784290444.617280:0:26250:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00000001:00000040:1.0:1784290444.617291:0:26250:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9c2344606400) : new refcount 19 00000020:00000040:1.0:1784290444.617299:0:26250:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=4 00000001:00000040:1.0:1784290444.617302:0:26250:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9c2344606400) : new refcount 20 00000001:00000040:1.0:1784290444.617308:0:26250:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9c2344606400) : new refcount 19 00002000:00100000:1.0:1784290444.617313:0:26250:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 711f3c77-e791-4aa8-86ee-bc854fd0bcc5/ffff9c246dce7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136ad ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784290444.617327:0:26250:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000040:1.0:1784290444.617389:0:26250:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9c2341dee480 for nid 192.168.202.6@tcp - ref 2 00000020:00000040:1.0:1784290444.617720:0:26250:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2445c14d40) now 8 - import 00000020:00000040:1.0:1784290444.617730:0:26250:0:(genops.c:1244:class_import_put()) import ffff9c247e402800 refcount=1 obd=lustre-OST0000 00000020:00000040:1.0:1784290444.617743:0:26250:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=5 00000100:00000040:1.0:1784290444.617747:0:26250:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:1.0:1784290444.617761:0:26250:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 9 to 192.168.202.6@tcp 00000100:00000040:1.0:1784290444.617766:0:26250:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c2341df1780 refcount 9 to 192.168.202.6@tcp 00000020:00000040:1.0:1784290444.617769:0:26250:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=6 00000100:00000040:1.0:1784290444.617777:0:26250:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00000100:00080000:1.0:1784290444.617788:0:26250:0:(import.c:65:import_set_state_nolock()) ffff9c247e402800 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1784290444.617797:0:26250:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 5 00000020:00000040:1.0:1784290444.617801:0:26250:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9c2445c14d40) now 8 - find 00010000:00000040:1.0:1784290444.617817:0:26250:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 0, xid 1870961896339072 00000100:00000040:1.0:1784290444.617829:0:26250:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:1.0:1784290444.617837:0:26250:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:1.0:1784290444.617916:0:26250:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00000100:00000040:1.0:1784290444.617927:0:26250:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2475818a80 x1870961896339072/t0(0) o8->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:0/0 lens 520/416 e 0 to 0 dl 1784290464 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290444.617958:0:26250:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2396:x1870961896339072:12345-192.168.202.6@tcp:8:ll_cfg_requeue.0 Request processed in 762us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290444.617979:0:26250:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5049 00000100:00000040:1.0:1784290444.617987:0:26250:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:1.0:1784290444.618011:0:26250:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 4 00000100:00000040:3.0:1784290444.619083:0:3610:0:(events.c:337:request_in_callback()) incoming req@ffff9c2447ccb480 x1870961896310528 msgsize 440 00000100:00100000:3.0:1784290444.619094:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290444.619145:0:25102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896310528 00000100:00100000:0.0:1784290444.619152:0:25102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896310528 00000020:00000040:0.0:1784290444.619154:0:25102:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:0.0:1784290444.619158:0:25102:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=5 00000100:00000040:0.0:1784290444.619176:0:25102:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784290444.619216:0:25102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 398 00000100:00000040:0.0:1784290444.619219:0:25102:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:0.0:1784290444.619224:0:25102:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2447ccb480 x1870961896310528/t0(4294968654) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.619236:0:25102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2396:x1870961896310528:12345-192.168.202.6@tcp:10:dd.0 00000020:00000040:0.0:1784290444.619247:0:25102:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2447ccb480 x1870961896310528/t0(4294968654) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784290444.619257:0:25102:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968654, current: 4294968654, replaying 00010000:00000040:0.0:1784290444.619268:0:25102:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:0.0:1784290444.619292:0:25102:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2447ccb480 x1870961896310528/t0(4294968654) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.619300:0:25102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+5:2396:x1870961896310528:12345-192.168.202.6@tcp:10:dd.0 Request processed in 67us (217us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784290444.619306:0:25102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 398 00000100:00000040:0.0:1784290444.619309:0:25102:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:3.0:1784290444.619322:0:96639:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 10000000:00000040:0.0:1784290444.647403:0:6485:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9c247b202600) refs 2 10000000:01000000:0.0:1784290444.647412:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784290444.647416:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9c247e403000 from 125 10000000:01000000:0.0:1784290444.647419:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:0.0:1784290444.647429:0:6485:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:0.0:1784290444.647466:0:6485:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c246dd27200 with handle 0x5953bbf6b30762a8 to hash 00010000:00010000:0.0:1784290444.647477:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246dd27200/0x5953bbf6b30762a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290444.647488:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c246dd27200/0x5953bbf6b30762a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290444.647499:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c246dd27200/0x5953bbf6b30762a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1784290444.647525:0:6485:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c246ddf0380 x1870961901192832/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290444.647541:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246ddf0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901192832:0@lo:101:ll_cfg_requeue.0 00000100:00000040:0.0:1784290444.647567:0:6485:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c246ddf0380 x1870961901192832/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290460 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290444.647575:0:6485:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784290444.647621:0:6485:0:(events.c:337:request_in_callback()) incoming req@ffff9c2468f40050 x1870961901192832 msgsize 328 00000100:00100000:0.0:1784290444.647624:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784290444.647626:0:6485:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1784290444.647652:0:6485:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c246ddf0380 x1870961901192832/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290460 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290444.647667:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901192832 00000100:00100000:2.0:1784290444.647681:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901192832 00000100:00100000:0.0:1784290444.647682:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24581e73c0 going to sleep for 11 seconds 00000020:00000040:2.0:1784290444.647684:0:94060:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:2.0:1784290444.647689:0:94060:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=22 00000100:00000040:2.0:1784290444.647711:0:94060:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784290444.647740:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00000040:2.0:1784290444.647744:0:94060:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:2.0:1784290444.647749:0:94060:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2468f40050 x1870961901192832/t0(0) o101->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290444.647761:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+22:6485:x1870961901192832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784290444.647774:0:94060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:2.0:1784290444.647784:0:94060:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c2447160c00 count: 2 00000020:00000040:2.0:1784290444.647789:0:94060:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c23450aa400 with handle 0x5953bbf6b30762af to hash 00010000:00010000:2.0:1784290444.647793:0:94060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c23450aa400/0x5953bbf6b30762af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30762a8 expref: -99 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784290444.647799:0:94060:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9c2475c4c800 : new locks_count 17 00000020:00000040:2.0:1784290444.647801:0:94060:0:(genops.c:889:class_export_get()) GET export ffff9c2475c4c800 refcount=23 00010000:00000040:2.0:1784290444.647820:0:94060:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9c2447160c00) refcount = 2 00010000:00000040:2.0:1784290444.647823:0:94060:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1784290444.647829:0:94060:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c247d2ffe00/0x5953bbf6b30762a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2917 expref: 9 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290444.647834:0:94060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c23450aa400/0x5953bbf6b30762af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30762a8 expref: 23 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290444.647842:0:94060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c23450aa400/0x5953bbf6b30762af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30762a8 expref: 23 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290444.647864:0:94060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aa400, rc 0) 00010000:00000040:2.0:1784290444.647867:0:94060:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901192832 00000100:00000040:2.0:1784290444.647880:0:94060:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 62 to 0@lo 00000100:00000040:2.0:1784290444.647884:0:94060:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290444.647903:0:94060:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9c246ddf0380 x1870961901192832/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290460 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290444.647925:0:94060:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 61 to 0@lo 00000100:00000040:2.0:1784290444.647929:0:94060:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468f40050 x1870961901192832/t0(0) o101->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:465/0 lens 328/344 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290444.647937:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f40050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901192832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290444.647942:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00000040:2.0:1784290444.647944:0:94060:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000020:00000040:2.0:1784290444.647954:0:94060:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 22 00000100:00000040:0.0:1784290444.647963:0:6485:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c246ddf0380 x1870961901192832/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290460 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290444.647973:0:6485:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf0380 x1870961901192832/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290460 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290444.647979:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246ddf0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901192832:0@lo:101:ll_cfg_requeue.0 00000100:00000040:0.0:1784290444.647985:0:6485:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c246ddf0380 x1870961901192832/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290460 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784290444.647994:0:6485:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c246dd27200 refcount=4 00010000:00000040:0.0:1784290444.647998:0:6485:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9c246dd27200, remote cookie: 0x5953bbf6b30762af, flags: 0x0 00010000:00000040:0.0:1784290444.648003:0:6485:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9c2345ca4d00) refcount = 1 00010000:00010000:0.0:1784290444.648006:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c246dd27200/0x5953bbf6b30762a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30762af expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290444.648014:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c246dd27200/0x5953bbf6b30762a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30762af expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1784290444.648019:0:6485:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c246ddf0380 x1870961901192832/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290460 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784290444.648028:0:6485:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 10000000:00000040:0.0:1784290444.648034:0:6485:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9c247b202600) refs 3 00000020:00000040:0.0:1784290444.648036:0:6485:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c246dd27200 refcount=3 00000020:00000040:0.0:1784290444.648050:0:6485:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:0.0:1784290444.648063:0:6485:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=5 obd=MGC192.168.202.106@tcp 00000100:00000040:0.0:1784290444.648071:0:6485:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c246ddf0380 x1870961901192960/t0(0) o256->MGC192.168.202.106@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290444.648078:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246ddf0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901192960:0@lo:256:ll_cfg_requeue.0 00000100:00000040:0.0:1784290444.648095:0:6485:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c246ddf0380 x1870961901192960/t0(0) o256->MGC192.168.202.106@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784290460 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290444.648100:0:6485:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1784290444.648114:0:6485:0:(events.c:337:request_in_callback()) incoming req@ffff9c2468f41450 x1870961901192960 msgsize 304 00000100:00100000:0.0:1784290444.648117:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784290444.648118:0:6485:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1784290444.648133:0:6485:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c246ddf0380 x1870961901192960/t0(0) o256->MGC192.168.202.106@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784290460 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290444.648141:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c24581e73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784290444.648213:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901192960 00000100:00100000:1.0:1784290444.648226:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901192960 00000020:00000040:1.0:1784290444.648229:0:94059:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:1.0:1784290444.648234:0:94059:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=23 00000100:00000040:1.0:1784290444.648259:0:94059:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1784290444.648298:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00000040:1.0:1784290444.648303:0:94059:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:1.0:1784290444.648312:0:94059:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2468f41450 x1870961901192960/t0(0) o256->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:465/0 lens 304/0 e 0 to 0 dl 1784290455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290444.648331:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901192960:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784290444.648404:0:94059:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:1.0:1784290444.648424:0:94059:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:1.0:1784290444.648434:0:94059:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784290444.648437:0:94059:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000020:00000040:1.0:1784290444.648448:0:94059:0:(genops.c:889:class_export_get()) GET export ffff9c2475c4c800 refcount=24 00000020:00000040:1.0:1784290444.648552:0:94059:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 23 00010000:00000040:1.0:1784290444.648571:0:94059:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901192960 00000100:00000040:1.0:1784290444.648581:0:94059:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 62 to 0@lo 00000100:00000040:1.0:1784290444.648587:0:94059:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290444.648611:0:94059:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff9c246ddf0380 x1870961901192960/t0(0) o256->MGC192.168.202.106@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784290460 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290444.648647:0:94059:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 61 to 0@lo 00000100:00000040:0.0:1784290444.648672:0:6485:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff9c246ddf0380 x1870961901192960/t0(0) o256->MGC192.168.202.106@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784290460 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290444.648673:0:94059:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468f41450 x1870961901192960/t0(0) o256->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:465/0 lens 304/240 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290444.648784:0:6485:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff9c246ddf0380 x1870961901192960/t0(0) o256->MGC192.168.202.106@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784290460 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290444.648786:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f41450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901192960:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 448us (658us total) trans 0 rc 0/0 00000100:00000040:0.0:1784290444.648825:0:6485:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf0380 x1870961901192960/t0(0) o256->MGC192.168.202.106@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784290460 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290444.648827:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00000040:1.0:1784290444.648846:0:94059:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000100:00100000:0.0:1784290444.648863:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246ddf0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901192960:0@lo:256:ll_cfg_requeue.0 00000100:00000040:0.0:1784290444.648871:0:6485:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c246ddf0380 x1870961901192960/t0(0) o256->MGC192.168.202.106@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784290460 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:0.0:1784290444.648895:0:6485:0:(mgc_request.c:1599:mgc_process_recover_log()) Latest version 125, more 0. 00000020:00000040:1.0:1784290444.648896:0:94059:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 22 10000000:00000040:0.0:1784290444.648913:0:6485:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0000 00000100:00000040:0.0:1784290444.648931:0:6485:0:(lustre_peer.c:232:class_check_uuid()) check if uuid 192.168.202.106@tcp has 192.168.202.106@tcp. 10000000:00000040:0.0:1784290444.648954:0:6485:0:(mgc_request.c:1469:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0000 target is obsoleted(1/2), reconnect 00000100:00080000:0.0:1784290444.648965:0:6485:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9c2458110000 already not connected (conn 3, was 0): DISCONN 00000100:00000040:0.0:1784290444.648979:0:6485:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 62 to 0@lo 00000100:00000040:0.0:1784290444.648981:0:6485:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c247b2be100 refcount 62 to 0@lo 00000100:00000040:0.0:1784290444.648983:0:6485:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.202.106@tcp -> ffff9c247b2be100 00010000:00080000:0.0:1784290444.648987:0:6485:0:(ldlm_lib.c:85:import_set_conn()) imp ffff9c2458110000@lustre-OST0000-osc-MDT0000: found existing conn 192.168.202.106@tcp, moved to head 00010000:00000040:0.0:1784290444.648990:0:6485:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 61 to 0@lo 00000100:00080000:0.0:1784290444.648995:0:6485:0:(import.c:65:import_set_state_nolock()) ffff9c2458110000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:0.0:1784290444.649000:0:6485:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 60 to 0@lo 00000100:00000040:0.0:1784290444.649002:0:6485:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 61 to 0@lo 00000020:00000040:0.0:1784290444.649004:0:6485:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b30752fd 00000020:00000040:0.0:1784290444.649007:0:6485:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c245fd7f800 refcount=4 00000100:00000040:0.0:1784290444.649009:0:6485:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 60 to 0@lo 00000100:00000040:0.0:1784290444.649011:0:6485:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 61 to 0@lo 00000020:00000040:0.0:1784290444.649013:0:6485:0:(genops.c:900:class_export_put()) PUTting export ffff9c245fd7f800 : new refcount 3 00000100:00080000:0.0:1784290444.649015:0:6485:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c2458110000 using connection 192.168.202.106@tcp/0@lo 00000020:00000040:0.0:1784290444.649027:0:6485:0:(genops.c:1231:class_import_get()) import ffff9c2458110000 refcount=5 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:0.0:1784290444.649040:0:6485:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c246ddf1880 x1870961901193088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1784290444.649050:0:6485:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000028097fa6] to pc [ptlrpcd_rcv+-1] req@ffff9c246ddf1880 x1870961901193088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:0.0:1784290444.649071:0:6485:0:(mgc_request.c:1486:mgc_apply_recover_logs()) ir apply logs 125/125 for lustre-OST0000-osc-MDT0000 00000100:00000040:0.0:1784290444.649076:0:6485:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c246ddf0380 x1870961901192960/t0(0) o256->MGC192.168.202.106@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784290460 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784290444.649082:0:6485:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:0.0:1784290444.649085:0:6485:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 10000000:01000000:0.0:1784290444.649100:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:0.0:1784290444.649105:0:6485:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c246dd27200 refcount=3 00000100:00000040:2.0:1784290444.649109:0:3616:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c246ddf1880 x1870961901193088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1784290444.649111:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246dd27200/0x5953bbf6b30762a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30762af expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290444.649137:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c246dd27200/0x5953bbf6b30762a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30762af expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784290444.649141:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246ddf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901193088:0@lo:8:ll_cfg_requeue.0 10000000:00000040:0.0:1784290444.649149:0:6485:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9c2470e22c00) refs 2 10000000:00000040:0.0:1784290444.649153:0:6485:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9c247b202600) refs 3 10000000:01000000:0.0:1784290444.649154:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784290444.649156:0:6485:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9c23452c5000 from 125 10000000:01000000:0.0:1784290444.649158:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:0.0:1784290444.649162:0:6485:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000100:00000040:2.0:1784290444.649169:0:3616:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c246ddf1880 x1870961901193088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784290459 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1784290444.649170:0:6485:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c2345ca4d00 count: 2 00000020:00000040:0.0:1784290444.649177:0:6485:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c246dd26200 with handle 0x5953bbf6b30762b6 to hash 00000100:00000040:2.0:1784290444.649182:0:3616:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00010000:0.0:1784290444.649183:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246dd26200/0x5953bbf6b30762b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290444.649189:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.106@tcp lock: ffff9c246dd26200/0x5953bbf6b30762b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290444.649195:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.106@tcp lock: ffff9c246dd26200/0x5953bbf6b30762b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784290444.649204:0:3616:0:(events.c:337:request_in_callback()) incoming req@ffff9c2475819f80 x1870961901193088 msgsize 520 00000100:00000040:0.0:1784290444.649208:0:6485:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c246ddf0380 x1870961901193216/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290444.649215:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290444.649225:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246ddf0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901193216:0@lo:101:ll_cfg_requeue.0 00000100:00000040:0.0:1784290444.649239:0:6485:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c246ddf0380 x1870961901193216/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290460 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290444.649243:0:3616:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c246ddf1880 x1870961901193088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784290459 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290444.649252:0:6485:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290444.649264:0:3616:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 2027 usecs (3 jiffies) 00000100:00000040:0.0:1784290444.649281:0:6485:0:(events.c:337:request_in_callback()) incoming req@ffff9c2468f43850 x1870961901193216 msgsize 328 00000100:00100000:3.0:1784290444.649288:0:8999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901193088 00000100:00100000:0.0:1784290444.649289:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290444.649297:0:8999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901193088 00000100:00000040:0.0:1784290444.649298:0:6485:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000020:00000040:3.0:1784290444.649302:0:8999:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307530b 00000100:00000040:0.0:1784290444.649325:0:6485:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c246ddf0380 x1870961901193216/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290460 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290444.649332:0:94058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901193216 00000100:00100000:2.0:1784290444.649337:0:94058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901193216 00000020:00000040:2.0:1784290444.649356:0:94058:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:2.0:1784290444.649360:0:94058:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=23 00000100:00000040:2.0:1784290444.649374:0:94058:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1784290444.649380:0:8999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5050 00000100:00100000:0.0:1784290444.649380:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2448c8fb40 going to sleep for 11 seconds 00000100:00000040:3.0:1784290444.649392:0:8999:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2475819f80 x1870961901193088/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784290464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290444.649402:0:94058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00000040:2.0:1784290444.649408:0:94058:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:2.0:1784290444.649415:0:94058:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2468f43850 x1870961901193216/t0(0) o101->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290444.649416:0:8999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2475819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3616:x1870961901193088:12345-0@lo:8:ll_cfg_requeue.0 00000100:00100000:2.0:1784290444.649435:0:94058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+23:6485:x1870961901193216:12345-0@lo:101:ll_cfg_requeue.0 00000020:00000040:3.0:1784290444.649442:0:8999:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2445c14d40) now 8 - find 00010000:00010000:2.0:1784290444.649444:0:94058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:2.0:1784290444.649452:0:94058:0:(ldlm_resource.c:1656:ldlm_resource_getref()) getref res: ffff9c2447160c00 count: 3 00010000:00000040:3.0:1784290444.649458:0:8999:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00000020:00000040:2.0:1784290444.649460:0:94058:0:(lustre_handles.c:93:class_handle_hash()) added object ffff9c23450aa800 with handle 0x5953bbf6b30762bd to hash 00010000:00010000:2.0:1784290444.649465:0:94058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c23450aa800/0x5953bbf6b30762bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5953bbf6b30762b6 expref: -99 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1784290444.649471:0:8999:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff9c246dce2000, cookie 0x5953bbf6b3076246 00010000:00000040:2.0:1784290444.649472:0:94058:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9c2475c4c800 : new locks_count 18 00000020:00000040:2.0:1784290444.649476:0:94058:0:(genops.c:889:class_export_get()) GET export ffff9c2475c4c800 refcount=24 00010000:00080000:3.0:1784290444.649483:0:8999:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t4294968649 exp ffff9c246dce2000 cur 2185 last 1784290443 00010000:00000040:2.0:1784290444.649488:0:94058:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9c2447160c00) refcount = 3 00010000:00000040:2.0:1784290444.649491:0:94058:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1784290444.649494:0:94058:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c23450aa400/0x5953bbf6b30762af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30762a8 expref: 24 pid: 94060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1784290444.649509:0:94058:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9c247d2ffe00/0x5953bbf6b30762a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.6@tcp remote: 0x6643efc96c5b2917 expref: 9 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290444.649513:0:94058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c23450aa800/0x5953bbf6b30762bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5953bbf6b30762b6 expref: 24 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784290444.649521:0:94058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c23450aa800/0x5953bbf6b30762bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5953bbf6b30762b6 expref: 24 pid: 94058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000040:3.0:1784290444.649522:0:8999:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.202.106@tcp 00010000:00010000:2.0:1784290444.649530:0:94058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c23450aa800, rc 0) 00000001:00000040:3.0:1784290444.649531:0:8999:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9c2344606400) : new refcount 20 00010000:00000040:2.0:1784290444.649533:0:94058:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901193216 00000020:00000040:3.0:1784290444.649540:0:8999:0:(genops.c:889:class_export_get()) GET export ffff9c246dce2000 refcount=4 00000100:00000040:2.0:1784290444.649541:0:94058:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 62 to 0@lo 00000001:00000040:3.0:1784290444.649546:0:8999:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9c2344606400) : new refcount 21 00000100:00000040:2.0:1784290444.649554:0:94058:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000001:00000040:3.0:1784290444.649555:0:8999:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9c2344606400) : new refcount 20 00002000:00100000:3.0:1784290444.649562:0:8999:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c246dce2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ad ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1784290444.649568:0:8999:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000100:00000040:2.0:1784290444.649572:0:94058:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9c246ddf0380 x1870961901193216/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290460 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00002000:00100000:3.0:1784290444.649574:0:8999:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:3.0:1784290444.649590:0:8999:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9c247d337cc0 for nid 0@lo - ref 2 00000100:00000040:2.0:1784290444.649597:0:94058:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 61 to 0@lo 00000100:00000040:2.0:1784290444.649602:0:94058:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468f43850 x1870961901193216/t0(0) o101->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:465/0 lens 328/344 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290444.649609:0:94058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f43850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901193216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290444.649615:0:94058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00000040:2.0:1784290444.649618:0:94058:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000020:00000040:2.0:1784290444.649626:0:94058:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 23 00000100:00000040:0.0:1784290444.649628:0:6485:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c246ddf0380 x1870961901193216/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290460 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290444.649637:0:6485:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf0380 x1870961901193216/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290460 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290444.649643:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246ddf0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901193216:0@lo:101:ll_cfg_requeue.0 00000100:00000040:0.0:1784290444.649651:0:6485:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c246ddf0380 x1870961901193216/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290460 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784290444.649658:0:6485:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c246dd26200 refcount=4 00010000:00000040:0.0:1784290444.649661:0:6485:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff9c246dd26200, remote cookie: 0x5953bbf6b30762bd, flags: 0x0 00010000:00000040:0.0:1784290444.649665:0:6485:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff9c2345ca4d00) refcount = 2 00010000:00000040:0.0:1784290444.649667:0:6485:0:(ldlm_resource.c:1879:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1784290444.649669:0:6485:0:(ldlm_resource.c:1882:ldlm_resource_dump()) ### ### ns: MGC192.168.202.106@tcp lock: ffff9c246dd27200/0x5953bbf6b30762a8 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30762af expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290444.649674:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.106@tcp lock: ffff9c246dd26200/0x5953bbf6b30762b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30762bd expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784290444.649681:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.106@tcp lock: ffff9c246dd26200/0x5953bbf6b30762b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5953bbf6b30762bd expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1784290444.649687:0:6485:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c246ddf0380 x1870961901193216/t0(0) o101->MGC192.168.202.106@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1784290460 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784290444.649693:0:6485:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 10000000:00000040:0.0:1784290444.649697:0:6485:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff9c2470e22c00) refs 3 00000020:00000040:0.0:1784290444.649704:0:6485:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c246dd26200 refcount=3 00000020:00000040:0.0:1784290444.649717:0:6485:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:0.0:1784290444.649726:0:6485:0:(genops.c:1231:class_import_get()) import ffff9c2447cad800 refcount=5 obd=MGC192.168.202.106@tcp 00000020:00000040:3.0:1784290444.649731:0:8999:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2445c14d40) now 9 - import 00000100:00000040:0.0:1784290444.649737:0:6485:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c246ddf0380 x1870961901193344/t0(0) o256->MGC192.168.202.106@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784290444.649741:0:8999:0:(genops.c:1244:class_import_put()) import ffff9c24753b9000 refcount=1 obd=lustre-OST0000 00000100:00100000:0.0:1784290444.649748:0:6485:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246ddf0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901193344:0@lo:256:ll_cfg_requeue.0 00000020:00000040:3.0:1784290444.649753:0:8999:0:(genops.c:889:class_export_get()) GET export ffff9c246dce2000 refcount=5 00000100:00000040:3.0:1784290444.649757:0:8999:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9c246dce2000 : new rpc_count 1 00000100:00000040:3.0:1784290444.649762:0:8999:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 62 to 0@lo 00000100:00000040:0.0:1784290444.649765:0:6485:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c246ddf0380 x1870961901193344/t0(0) o256->MGC192.168.202.106@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784290460 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290444.649771:0:8999:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c247b2be100 refcount 62 to 0@lo 00000100:00000040:0.0:1784290444.649778:0:6485:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:3.0:1784290444.649779:0:8999:0:(genops.c:889:class_export_get()) GET export ffff9c246dce2000 refcount=6 00000100:00000040:3.0:1784290444.649788:0:8999:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 63 to 0@lo 00000100:00000040:0.0:1784290444.649796:0:6485:0:(events.c:337:request_in_callback()) incoming req@ffff9c2468f40850 x1870961901193344 msgsize 304 00000100:00080000:3.0:1784290444.649798:0:8999:0:(import.c:65:import_set_state_nolock()) ffff9c24753b9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784290444.649804:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1784290444.649806:0:6485:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000020:00000040:3.0:1784290444.649810:0:8999:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce2000 : new refcount 5 00000020:00000040:3.0:1784290444.649815:0:8999:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9c2445c14d40) now 9 - find 00000100:00000040:0.0:1784290444.649823:0:6485:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9c246ddf0380 x1870961901193344/t0(0) o256->MGC192.168.202.106@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784290460 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1784290444.649826:0:8999:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968649, transno 0, xid 1870961901193088 00000100:00000040:3.0:1784290444.649835:0:8999:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 64 to 0@lo 00000100:00000040:3.0:1784290444.649842:0:8999:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1784290444.649843:0:6485:0:(client.c:2702:ptlrpc_set_wait()) set ffff9c2448c8fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784290444.649860:0:94062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901193344 00000100:00100000:2.0:1784290444.649866:0:94062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901193344 00000020:00000040:2.0:1784290444.649867:0:94062:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3075247 00000020:00000040:2.0:1784290444.649870:0:94062:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c4c800 refcount=24 00000100:00000040:3.0:1784290444.649880:0:8999:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9c246ddf1880 x1870961901193088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290444.649880:0:94062:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1784290444.649907:0:94062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00000040:3.0:1784290444.649908:0:8999:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 63 to 0@lo 00000100:00000040:2.0:1784290444.649910:0:94062:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c2475c4c800 : new rpc_count 1 00000100:00000040:3.0:1784290444.649915:0:8999:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2475819f80 x1870961901193088/t0(0) o8->lustre-MDT0000-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1784290464 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290444.649917:0:94062:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2468f40850 x1870961901193344/t0(0) o256->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:465/0 lens 304/0 e 0 to 0 dl 1784290455 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1784290444.649926:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c246ddf1880 x1870961901193088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290444.649955:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968649 gen 2 00000100:00100000:2.0:1784290444.649957:0:94062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901193344:12345-0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784290444.649973:0:8999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2475819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1870961901193088:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 552us (757us total) trans 0 rc 0/0 20000000:01000000:2.0:1784290444.649974:0:94062:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 00000100:00000040:0.0:1784290444.649974:0:3616:0:(client.c:3168:ptlrpc_free_committed()) @@@ commit (last_committed 4294968649) req@ffff9c247f977480 x1870961901182336/t4294968649(4294968649) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784290446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 20000000:00000040:2.0:1784290444.649990:0:94062:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 00000100:00100000:3.0:1784290444.649992:0:8999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5050 00000100:00000040:0.0:1784290444.649994:0:3616:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c247f977480 x1870961901182336/t4294968649(4294968649) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784290446 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290444.649998:0:8999:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce2000 : new rpc_count 0 20000000:01000000:2.0:1784290444.649998:0:94062:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 00000020:00000040:0.0:1784290444.650004:0:3616:0:(genops.c:1244:class_import_put()) import ffff9c2458110000 refcount=4 obd=lustre-OST0000-osc-MDT0000 20000000:01000000:2.0:1784290444.650005:0:94062:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000020:00000040:3.0:1784290444.650012:0:8999:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce2000 : new refcount 4 00000020:00000040:2.0:1784290444.650013:0:94062:0:(genops.c:889:class_export_get()) GET export ffff9c2475c4c800 refcount=25 00000100:00000040:0.0:1784290444.650016:0:3616:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=1 replay=1/1 committed=0/0 00000100:00000040:0.0:1784290444.650022:0:3616:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c246ddf1880 x1870961901193088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784290459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784290444.650031:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000020:00000040:0.0:1784290444.650039:0:3616:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b30752fd 00000020:00000040:0.0:1784290444.650042:0:3616:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c245fd7f800 refcount=4 00000020:00000040:0.0:1784290444.650049:0:3616:0:(genops.c:900:class_export_put()) PUTting export ffff9c245fd7f800 : new refcount 3 00000100:00080000:0.0:1784290444.650054:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2458110000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1784290444.650059:0:3616:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1784290444.650062:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968649 gen 2 00000100:00000040:0.0:1784290444.650065:0:3616:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=0 replay=0/0 committed=0/0 00000020:00000040:2.0:1784290444.650066:0:94062:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 24 00000100:00080000:0.0:1784290444.650068:0:3616:0:(recover.c:53:ptlrpc_replay_next()) import ffff9c2458110000 from lustre-OST0000_UUID committed 4294968649 last 0 00000100:00080000:0.0:1784290444.650072:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2458110000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:0.0:1784290444.650076:0:3616:0:(genops.c:1231:class_import_get()) import ffff9c2458110000 refcount=5 obd=lustre-OST0000-osc-MDT0000 00010000:00000040:2.0:1784290444.650081:0:94062:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 0, transno 0, xid 1870961901193344 00000100:00000040:2.0:1784290444.650088:0:94062:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 64 to 0@lo 00000100:00000040:2.0:1784290444.650097:0:94062:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1784290444.650115:0:94062:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff9c246ddf0380 x1870961901193344/t0(0) o256->MGC192.168.202.106@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784290460 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290444.650133:0:94062:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 63 to 0@lo 00000100:00000040:2.0:1784290444.650138:0:94062:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468f40850 x1870961901193344/t0(0) o256->2e54cd1c-9dbd-4e31-b60e-998135d46053@0@lo:465/0 lens 304/240 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290444.650148:0:94062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:6485:x1870961901193344:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 197us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290444.650153:0:94062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00000040:2.0:1784290444.650156:0:94062:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c2475c4c800 : new rpc_count 0 00000020:00000040:2.0:1784290444.650163:0:94062:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c4c800 : new refcount 23 00000100:00000040:1.0:1784290444.650180:0:6485:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff9c246ddf0380 x1870961901193344/t0(0) o256->MGC192.168.202.106@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784290460 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290444.650199:0:6485:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff9c246ddf0380 x1870961901193344/t0(0) o256->MGC192.168.202.106@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784290460 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290444.650214:0:6485:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf0380 x1870961901193344/t0(0) o256->MGC192.168.202.106@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784290460 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290444.650225:0:6485:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246ddf0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2e54cd1c-9dbd-4e31-b60e-998135d46053:6485:1870961901193344:0@lo:256:ll_cfg_requeue.0 00000100:00000040:1.0:1784290444.650239:0:6485:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c246ddf0380 x1870961901193344/t0(0) o256->MGC192.168.202.106@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784290460 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290444.650263:0:3616:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf1880 x1870961901193088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784290459 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1784290444.650264:0:6485:0:(mgc_request.c:1599:mgc_process_recover_log()) Latest version 125, more 0. 00010000:00080000:2.0:1784290444.650266:0:96797:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1784290444.650280:0:96797:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:2.0:1784290444.650288:0:96797:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 10000000:00000040:1.0:1784290444.650300:0:6485:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0001 00000100:00100000:0.0:1784290444.650301:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246ddf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901193088:0@lo:8:ll_cfg_requeue.0 00000100:00000040:1.0:1784290444.650324:0:6485:0:(lustre_peer.c:232:class_check_uuid()) check if uuid 192.168.202.106@tcp has 192.168.202.106@tcp. 00000100:00000040:0.0:1784290444.650327:0:3616:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c246ddf1880 x1870961901193088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784290459 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784290444.650369:0:96797:0:(import.c:65:import_set_state_nolock()) ffff9c2458110000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:2.0:1784290444.650376:0:96797:0:(genops.c:1231:class_import_get()) import ffff9c2458110000 refcount=6 obd=lustre-OST0000-osc-MDT0000 00000020:00000040:0.0:1784290444.650382:0:3616:0:(genops.c:1244:class_import_put()) import ffff9c2458110000 refcount=5 obd=lustre-OST0000-osc-MDT0000 10000000:00000040:1.0:1784290444.650388:0:6485:0:(mgc_request.c:1469:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0001 target is obsoleted(1/2), reconnect 00000100:00000040:2.0:1784290444.650400:0:96797:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000002e585af] to pc [ptlrpcd_rcv+-1] req@ffff9c2475818000 x1870961901193472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784290444.650402:0:6485:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9c2341ead000 already not connected (conn 4, was 0): DISCONN 00000020:00000040:2.0:1784290444.650428:0:96797:0:(genops.c:1244:class_import_put()) import ffff9c2458110000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1784290444.650429:0:6485:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 64 to 0@lo 00000100:00000040:0.0:1784290444.650442:0:3616:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2475818000 x1870961901193472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290444.650444:0:6485:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c247b2be100 refcount 64 to 0@lo 00000100:00000040:1.0:1784290444.650459:0:6485:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.202.106@tcp -> ffff9c247b2be100 00010000:00080000:1.0:1784290444.650470:0:6485:0:(ldlm_lib.c:85:import_set_conn()) imp ffff9c2341ead000@lustre-OST0000-osc-MDT0001: found existing conn 192.168.202.106@tcp, moved to head 00000100:00100000:0.0:1784290444.650478:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1870961901193472:0@lo:400:ldlm_lock_repla.0 00010000:00000040:1.0:1784290444.650487:0:6485:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 63 to 0@lo 00000100:00000040:0.0:1784290444.650503:0:3616:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff9c2475818000 x1870961901193472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784290460 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784290444.650509:0:6485:0:(import.c:65:import_set_state_nolock()) ffff9c2341ead000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:0.0:1784290444.650522:0:3616:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1784290444.650530:0:6485:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 62 to 0@lo 00000100:00000040:1.0:1784290444.650538:0:6485:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 63 to 0@lo 00000020:00000040:1.0:1784290444.650544:0:6485:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b306f19e 00000100:00000040:0.0:1784290444.650545:0:3616:0:(events.c:337:request_in_callback()) incoming req@ffff9c246ddf1880 x1870961901193472 msgsize 224 00000020:00000040:1.0:1784290444.650553:0:6485:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c2a800 refcount=4 00000100:00000040:1.0:1784290444.650568:0:6485:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 62 to 0@lo 00000100:00100000:0.0:1784290444.650568:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1784290444.650584:0:6485:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 63 to 0@lo 00000020:00000040:1.0:1784290444.650588:0:6485:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c2a800 : new refcount 3 00000100:00080000:1.0:1784290444.650595:0:6485:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c2341ead000 using connection 192.168.202.106@tcp/0@lo 00000100:00000040:0.0:1784290444.650602:0:3616:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2475818000 x1870961901193472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784290460 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1784290444.650611:0:6485:0:(genops.c:1231:class_import_get()) import ffff9c2341ead000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:2.0:1784290444.650625:0:26254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901193472 00000100:00000040:0.0:1784290444.650630:0:3616:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 1967 usecs (2 jiffies) 00000100:00100000:2.0:1784290444.650633:0:26254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901193472 00000020:00000040:2.0:1784290444.650638:0:26254:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b3076246 00000100:00100000:1.0:1784290444.650645:0:6485:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c2344e90e00 x1870961901193600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1784290444.650647:0:26254:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce2000 refcount=5 00000100:00000040:1.0:1784290444.650675:0:6485:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000026796d34] to pc [ptlrpcd_rcv+-1] req@ffff9c2344e90e00 x1870961901193600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290444.650682:0:26254:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost at +6s 10000000:00000040:1.0:1784290444.650713:0:6485:0:(mgc_request.c:1486:mgc_apply_recover_logs()) ir apply logs 125/125 for lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1784290444.650738:0:3616:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2344e90e00 x1870961901193600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290444.650740:0:6485:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c246ddf0380 x1870961901193344/t0(0) o256->MGC192.168.202.106@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1784290460 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290444.650743:0:26254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1643 00000100:00000040:2.0:1784290444.650761:0:26254:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce2000 : new rpc_count 1 00000100:00000040:2.0:1784290444.650784:0:26254:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246ddf1880 x1870961901193472/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:465/0 lens 224/0 e 0 to 0 dl 1784290455 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290444.650864:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2344e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901193600:0@lo:8:ll_cfg_requeue.0 00000020:00000040:1.0:1784290444.650872:0:6485:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=4 obd=MGC192.168.202.106@tcp 00000020:00000040:1.0:1784290444.650883:0:6485:0:(genops.c:1244:class_import_put()) import ffff9c2447cad800 refcount=3 obd=MGC192.168.202.106@tcp 00000100:00000040:0.0:1784290444.650897:0:3616:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9c2344e90e00 x1870961901193600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784290464 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290444.650910:0:3616:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1784290444.650915:0:26254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ddf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3616:x1870961901193472:12345-0@lo:400:ldlm_lock_repla.0 00000100:00000040:0.0:1784290444.650931:0:3616:0:(events.c:337:request_in_callback()) incoming req@ffff9c246ddf0a80 x1870961901193600 msgsize 520 00000020:00000040:2.0:1784290444.650933:0:26254:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246ddf1880 x1870961901193472/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:465/0 lens 224/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1784290444.650937:0:6485:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000100:00100000:0.0:1784290444.650951:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000040:1.0:1784290444.650965:0:6485:0:(lustre_handles.c:147:class_handle2object()) GET ldlm ffff9c246dd26200 refcount=3 00010000:00000040:2.0:1784290444.650966:0:26254:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce2000 : new rpc_count 2 00000100:00000040:0.0:1784290444.650976:0:3616:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2344e90e00 x1870961901193600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784290464 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1784290444.650984:0:26254:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9c246ddf1880 x1870961901193472/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:465/0 lens 224/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1784290444.650984:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.106@tcp lock: ffff9c246dd26200/0x5953bbf6b30762b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30762bd expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1784290444.650988:0:3616:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 1398 usecs (2 jiffies) 00000100:00100000:3.0:1784290444.651011:0:26251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901193600 00000100:00100000:3.0:1784290444.651022:0:26251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901193600 00000020:00000040:3.0:1784290444.651030:0:26251:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b306f1b3 00010000:00010000:1.0:1784290444.651050:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.106@tcp lock: ffff9c246dd26200/0x5953bbf6b30762b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5953bbf6b30762bd expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1784290444.651055:0:26254:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf1880 x1870961901193472/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:465/0 lens 224/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1784290444.651061:0:96639:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00100000:3.0:1784290444.651081:0:26251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5051 00000100:00000040:3.0:1784290444.651099:0:26251:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246ddf0a80 x1870961901193600/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1784290464 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290444.651111:0:26254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ddf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3616:x1870961901193472:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 210us (563us total) trans 0 rc 0/-999 10000000:00000040:1.0:1784290444.651111:0:6485:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff9c2470e22c00) refs 3 00000100:00100000:2.0:1784290444.651139:0:26254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1643 00000100:00100000:3.0:1784290444.651140:0:26251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ddf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3616:x1870961901193600:12345-0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1784290444.651143:0:26254:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce2000 : new rpc_count 1 00000020:00000040:3.0:1784290444.651156:0:26251:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2445c14d40) now 9 - find 00010000:00000040:3.0:1784290444.651167:0:26251:0:(ldlm_lib.c:1264:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:3.0:1784290444.651173:0:26251:0:(ldlm_lib.c:938:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9c246dce1000, cookie 0x5953bbf6b307623f 00010000:00080000:3.0:1784290444.651182:0:26251:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9c246dce1000 cur 2185 last 1784290443 00000001:00000040:3.0:1784290444.651193:0:26251:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.202.106@tcp 00000001:00000040:3.0:1784290444.651196:0:26251:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9c2344606400) : new refcount 21 00000020:00000040:3.0:1784290444.651200:0:26251:0:(genops.c:889:class_export_get()) GET export ffff9c246dce1000 refcount=4 00000001:00000040:3.0:1784290444.651202:0:26251:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9c2344606400) : new refcount 22 00000001:00000040:3.0:1784290444.651205:0:26251:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9c2344606400) : new refcount 21 00002000:00100000:3.0:1784290444.651209:0:26251:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9c246dce1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136ad ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1784290444.651212:0:26251:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1784290444.651215:0:26251:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:3.0:1784290444.651220:0:26251:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff9c247d337cc0 for nid 0@lo - ref 3 00000020:00000040:3.0:1784290444.651228:0:26251:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9c2445c14d40) now 10 - import 00000020:00000040:3.0:1784290444.651245:0:26251:0:(genops.c:1244:class_import_put()) import ffff9c24753bc800 refcount=1 obd=lustre-OST0000 00000020:00000040:3.0:1784290444.651251:0:26251:0:(genops.c:889:class_export_get()) GET export ffff9c246dce1000 refcount=5 00000100:00000040:3.0:1784290444.651253:0:26251:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export ffff9c246dce1000 : new rpc_count 1 00000100:00000040:3.0:1784290444.651257:0:26251:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 64 to 0@lo 00000100:00000040:3.0:1784290444.651261:0:26251:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9c247b2be100 refcount 64 to 0@lo 00000020:00000040:3.0:1784290444.651263:0:26251:0:(genops.c:889:class_export_get()) GET export ffff9c246dce1000 refcount=6 00000100:00000040:3.0:1784290444.651269:0:26251:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 65 to 0@lo 00000100:00080000:3.0:1784290444.651275:0:26251:0:(import.c:65:import_set_state_nolock()) ffff9c24753bc800 : changing import state from RECOVER to FULL 00000020:00000040:3.0:1784290444.651289:0:26251:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce1000 : new refcount 5 00000020:00000040:3.0:1784290444.651292:0:26251:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9c2445c14d40) now 10 - find 00010000:00000040:3.0:1784290444.651300:0:26251:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968631, transno 0, xid 1870961901193600 00010000:00080000:0.0:1784290444.651306:0:96639:0:(ldlm_lib.c:2545:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00000040:3.0:1784290444.651308:0:26251:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c247b2be100 refcount 66 to 0@lo 00010000:00000040:0.0:1784290444.651315:0:96639:0:(ldlm_lib.c:2874:target_recovery_thread()) 1: request replay stage - 2 clients from t4294968654 00000100:00000040:3.0:1784290444.651316:0:26251:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00080000:0.0:1784290444.651321:0:96639:0:(ldlm_lib.c:2683:replay_request_or_update()) Waiting for transno 4294968654 00010000:00080000:0.0:1784290444.651326:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 1, req_transno: 4294968654, next_transno: 4294968654 00010000:00080000:0.0:1784290444.651329:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968654) 00010000:00080000:0.0:1784290444.651337:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896310528 t4294968654 from 192.168.202.6@tcp req@ffff9c2447ccb480 x1870961896310528/t0(4294968654) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00000040:3.0:1784290444.651382:0:26251:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9c2344e90e00 x1870961901193600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1784290464 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784290444.651391:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2447ccb480 x1870961896310528/t0(4294968654) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784290444.651430:0:96639:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x763:0x0] 00000100:00000040:3.0:1784290444.651438:0:26251:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c247b2be100 refcount 65 to 0@lo 00000100:00000040:3.0:1784290444.651448:0:26251:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf0a80 x1870961901193600/t0(0) o8->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1784290464 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1784290444.651458:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c2344e90e00 x1870961901193600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784290464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290444.651464:0:26251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ddf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3616:x1870961901193600:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 327us (527us total) trans 0 rc 0/0 00000100:00000040:2.0:1784290444.651468:0:3616:0:(client.c:3108:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294968631 00000100:00000040:2.0:1784290444.651475:0:3616:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9c2344e90e00 x1870961901193600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784290464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290444.651481:0:26251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5051 00000100:00080000:2.0:1784290444.651487:0:3616:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00000040:3.0:1784290444.651488:0:26251:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce1000 : new rpc_count 0 00000020:00000040:2.0:1784290444.651490:0:3616:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b306f19e 00000020:00000040:2.0:1784290444.651495:0:3616:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c2475c2a800 refcount=4 00000020:00000040:2.0:1784290444.651500:0:3616:0:(genops.c:900:class_export_put()) PUTting export ffff9c2475c2a800 : new refcount 3 00000020:00000040:3.0:1784290444.651502:0:26251:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce1000 : new refcount 4 00000100:00080000:2.0:1784290444.651503:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ead000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1784290444.651509:0:3616:0:(import.c:1700:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1784290444.651511:0:3616:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294968631 gen 2 00000100:00000040:2.0:1784290444.651519:0:3616:0:(client.c:3222:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:2.0:1784290444.651522:0:3616:0:(recover.c:53:ptlrpc_replay_next()) import ffff9c2341ead000 from lustre-OST0000_UUID committed 4294968631 last 0 00000100:00080000:2.0:1784290444.651524:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c2341ead000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:2.0:1784290444.651529:0:3616:0:(genops.c:1231:class_import_get()) import ffff9c2341ead000 refcount=5 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1784290444.651726:0:3616:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2344e90e00 x1870961901193600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784290464 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1784290444.651732:0:96798:0:(ldlm_request.c:2972:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1784290444.651738:0:96798:0:(ldlm_request.c:2888:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:2.0:1784290444.651743:0:96798:0:(ldlm_request.c:2901:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00100000:3.0:1784290444.651748:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2344e90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901193600:0@lo:8:ll_cfg_requeue.0 00000100:00000040:3.0:1784290444.651759:0:3616:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9c2344e90e00 x1870961901193600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784290464 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784290444.651785:0:3616:0:(genops.c:1244:class_import_put()) import ffff9c2341ead000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00080000:2.0:1784290444.651788:0:96798:0:(import.c:65:import_set_state_nolock()) ffff9c2341ead000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:2.0:1784290444.651797:0:96798:0:(genops.c:1231:class_import_get()) import ffff9c2341ead000 refcount=5 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:2.0:1784290444.651816:0:96798:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f67269e2] to pc [ptlrpcd_rcv+-1] req@ffff9c2475819180 x1870961901193728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1784290444.651842:0:96798:0:(genops.c:1244:class_import_put()) import ffff9c2341ead000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1784290444.651883:0:3616:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9c2475819180 x1870961901193728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290444.651898:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2475819180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1870961901193728:0@lo:400:ldlm_lock_repla.0 00000100:00000040:3.0:1784290444.651919:0:3616:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff9c2475819180 x1870961901193728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784290460 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290444.651931:0:3616:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1784290444.651951:0:3616:0:(events.c:337:request_in_callback()) incoming req@ffff9c2447ccbb80 x1870961901193728 msgsize 224 00000100:00100000:3.0:1784290444.651956:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1784290444.651975:0:3616:0:(client.c:2862:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9c2475819180 x1870961901193728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784290460 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290444.651980:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901193728 00000100:00100000:2.0:1784290444.651986:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901193728 00000020:00000040:2.0:1784290444.651989:0:9000:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307623f 00000100:00000040:3.0:1784290444.651992:0:3616:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 1396 usecs (2 jiffies) 00000020:00000040:2.0:1784290444.651993:0:9000:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce1000 refcount=5 00000100:00100000:2.0:1784290444.652035:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1644 00000100:00000040:2.0:1784290444.652038:0:9000:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce1000 : new rpc_count 1 00000100:00000040:2.0:1784290444.652043:0:9000:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2447ccbb80 x1870961901193728/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:465/0 lens 224/0 e 0 to 0 dl 1784290455 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290444.652054:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1870961901193728:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:2.0:1784290444.652063:0:9000:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2447ccbb80 x1870961901193728/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:465/0 lens 224/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1784290444.652070:0:9000:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce1000 : new rpc_count 2 00010000:00080000:2.0:1784290444.652072:0:9000:0:(ldlm_lib.c:3137:target_queue_recovery_request()) @@@ queue final req req@ffff9c2447ccbb80 x1870961901193728/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:465/0 lens 224/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290444.652093:0:9000:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2447ccbb80 x1870961901193728/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:465/0 lens 224/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290444.652100:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1870961901193728:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 49us (148us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784290444.652106:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1644 00000100:00000040:2.0:1784290444.652108:0:9000:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce1000 : new rpc_count 1 00000001:00000040:0.0:1784290444.652168:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 1 00000020:00000040:0.0:1784290444.652172:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=6 00010000:00000040:0.0:1784290444.652218:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968654, xid 1870961896310528 00000100:00000040:0.0:1784290444.652229:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290444.652233:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290444.652267:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:0.0:1784290444.652281:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 101 seconds 00010000:00000040:0.0:1784290444.652288:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:0.0:1784290444.652298:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 5 00010000:00080000:0.0:1784290444.652303:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968655 00010000:00080000:0.0:1784290444.652308:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968655 00000100:00000040:0.0:1784290444.653780:0:3611:0:(events.c:337:request_in_callback()) incoming req@ffff9c246ddf3b80 x1870961896312448 msgsize 440 00000100:00100000:0.0:1784290444.653785:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290444.653838:0:25104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896312448 00000100:00100000:3.0:1784290444.653845:0:25104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896312448 00000020:00000040:3.0:1784290444.653858:0:25104:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:3.0:1784290444.653862:0:25104:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=6 00000100:00000040:3.0:1784290444.653875:0:25104:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784290444.653913:0:25104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 399 00000100:00000040:3.0:1784290444.653917:0:25104:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:3.0:1784290444.653923:0:25104:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246ddf3b80 x1870961896312448/t0(4294968655) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.653937:0:25104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ddf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2396:x1870961896312448:12345-192.168.202.6@tcp:10:dd.0 00000020:00000040:3.0:1784290444.653946:0:25104:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246ddf3b80 x1870961896312448/t0(4294968655) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784290444.653955:0:25104:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968655, current: 4294968655, replaying 00010000:00000040:3.0:1784290444.653958:0:25104:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:3.0:1784290444.653980:0:25104:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf3b80 x1870961896312448/t0(4294968655) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784290444.653983:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968655, next_transno: 4294968655 00010000:00080000:0.0:1784290444.653989:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968655) 00010000:00080000:0.0:1784290444.653999:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896312448 t4294968655 from 192.168.202.6@tcp req@ffff9c246ddf3b80 x1870961896312448/t0(4294968655) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.654002:0:25104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ddf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+6:2396:x1870961896312448:12345-192.168.202.6@tcp:10:dd.0 Request processed in 64us (217us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784290444.654022:0:25104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 399 00000020:00000040:0.0:1784290444.654026:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246ddf3b80 x1870961896312448/t0(4294968655) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00000040:3.0:1784290444.654027:0:25104:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00002000:00000040:0.0:1784290444.654046:0:96639:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x764:0x0] 00000001:00000040:0.0:1784290444.654099:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 2 00000020:00000040:0.0:1784290444.654101:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=7 00010000:00000040:0.0:1784290444.654113:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968655, xid 1870961896312448 00000100:00000040:0.0:1784290444.654118:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290444.654121:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290444.654142:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:0.0:1784290444.654147:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784290444.654150:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:0.0:1784290444.654156:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 6 00010000:00080000:0.0:1784290444.654158:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968656 00010000:00080000:0.0:1784290444.654162:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968656 00000100:00000040:2.0:1784290444.654914:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c247581a300 x1870961896312832 msgsize 440 00000100:00100000:2.0:1784290444.654920:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290444.654967:0:25096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896312832 00000100:00100000:3.0:1784290444.654973:0:25096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896312832 00000020:00000040:3.0:1784290444.654975:0:25096:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:3.0:1784290444.654978:0:25096:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=7 00000100:00000040:3.0:1784290444.654993:0:25096:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784290444.655023:0:25096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 400 00000100:00000040:3.0:1784290444.655027:0:25096:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:3.0:1784290444.655033:0:25096:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c247581a300 x1870961896312832/t0(4294968656) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.655046:0:25096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2396:x1870961896312832:12345-192.168.202.6@tcp:10:dd.0 00000020:00000040:3.0:1784290444.655054:0:25096:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c247581a300 x1870961896312832/t0(4294968656) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784290444.655063:0:25096:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968656, current: 4294968656, replaying 00010000:00000040:3.0:1784290444.655065:0:25096:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:3.0:1784290444.655077:0:25096:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c247581a300 x1870961896312832/t0(4294968656) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784290444.655081:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968656, next_transno: 4294968656 00010000:00080000:0.0:1784290444.655088:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968656) 00010000:00080000:0.0:1784290444.655098:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896312832 t4294968656 from 192.168.202.6@tcp req@ffff9c247581a300 x1870961896312832/t0(4294968656) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.655099:0:25096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2396:x1870961896312832:12345-192.168.202.6@tcp:10:dd.0 Request processed in 51us (180us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784290444.655119:0:25096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 400 00000020:00000040:0.0:1784290444.655124:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c247581a300 x1870961896312832/t0(4294968656) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00000040:3.0:1784290444.655126:0:25096:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00002000:00000040:0.0:1784290444.655139:0:96639:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x765:0x0] 00000001:00000040:0.0:1784290444.655194:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 3 00000020:00000040:0.0:1784290444.655196:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=8 00010000:00000040:0.0:1784290444.655207:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968656, xid 1870961896312832 00000100:00000040:0.0:1784290444.655212:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290444.655215:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290444.655237:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:0.0:1784290444.655242:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784290444.655245:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:0.0:1784290444.655250:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 7 00010000:00080000:0.0:1784290444.655252:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968657 00010000:00080000:0.0:1784290444.655255:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968657 00000100:00000040:3.0:1784290444.656076:0:3610:0:(events.c:337:request_in_callback()) incoming req@ffff9c2447cc9180 x1870961896314240 msgsize 440 00000100:00100000:3.0:1784290444.656081:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290444.656150:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896314240 00000100:00100000:1.0:1784290444.656174:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896314240 00000020:00000040:1.0:1784290444.656178:0:8409:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:1.0:1784290444.656184:0:8409:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=8 00000100:00000040:1.0:1784290444.656206:0:8409:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784290444.656258:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 401 00000100:00000040:1.0:1784290444.656264:0:8409:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:1.0:1784290444.656273:0:8409:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2447cc9180 x1870961896314240/t0(4294968657) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.656292:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:2396:x1870961896314240:12345-192.168.202.6@tcp:10:dd.0 00000020:00000040:1.0:1784290444.656306:0:8409:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2447cc9180 x1870961896314240/t0(4294968657) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784290444.656319:0:8409:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968657, current: 4294968657, replaying 00010000:00000040:1.0:1784290444.656324:0:8409:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:1.0:1784290444.656379:0:8409:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2447cc9180 x1870961896314240/t0(4294968657) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784290444.656392:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968657, next_transno: 4294968657 00000100:00100000:1.0:1784290444.656395:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+8:2396:x1870961896314240:12345-192.168.202.6@tcp:10:dd.0 Request processed in 105us (314us total) trans 0 rc 0/-999 00010000:00080000:0.0:1784290444.656400:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968657) 00010000:00080000:0.0:1784290444.656417:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896314240 t4294968657 from 192.168.202.6@tcp req@ffff9c2447cc9180 x1870961896314240/t0(4294968657) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.656422:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 401 00000100:00000040:1.0:1784290444.656436:0:8409:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00000020:00000040:0.0:1784290444.656465:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2447cc9180 x1870961896314240/t0(4294968657) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784290444.656485:0:96639:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x769:0x0] 00000001:00000040:0.0:1784290444.656542:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 4 00000020:00000040:0.0:1784290444.656550:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=9 00010000:00000040:0.0:1784290444.656565:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968657, xid 1870961896314240 00000100:00000040:0.0:1784290444.656570:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290444.656574:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290444.656595:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:0.0:1784290444.656600:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784290444.656605:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:0.0:1784290444.656614:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 8 00010000:00080000:0.0:1784290444.656617:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968658 00010000:00080000:0.0:1784290444.656620:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968658 00000100:00000040:1.0:1784290444.657478:0:3611:0:(events.c:337:request_in_callback()) incoming req@ffff9c2344e91500 x1870961896315776 msgsize 440 00000100:00100000:1.0:1784290444.657489:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290444.657539:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896315776 00000100:00100000:3.0:1784290444.657548:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896315776 00000020:00000040:3.0:1784290444.657551:0:8408:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:3.0:1784290444.657555:0:8408:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=9 00000100:00000040:3.0:1784290444.657573:0:8408:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784290444.657607:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 402 00000100:00000040:3.0:1784290444.657610:0:8408:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:3.0:1784290444.657614:0:8408:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2344e91500 x1870961896315776/t0(4294968658) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.657625:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:2396:x1870961896315776:12345-192.168.202.6@tcp:10:dd.0 00000020:00000040:3.0:1784290444.657634:0:8408:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2344e91500 x1870961896315776/t0(4294968658) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784290444.657640:0:8408:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968658, current: 4294968658, replaying 00010000:00000040:3.0:1784290444.657644:0:8408:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:3.0:1784290444.657654:0:8408:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2344e91500 x1870961896315776/t0(4294968658) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.657661:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344e91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+9:2396:x1870961896315776:12345-192.168.202.6@tcp:10:dd.0 Request processed in 39us (183us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784290444.657668:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 402 00000100:00000040:3.0:1784290444.657670:0:8408:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:0.0:1784290444.657689:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968658, next_transno: 4294968658 00010000:00080000:0.0:1784290444.657693:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968658) 00010000:00080000:0.0:1784290444.657700:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896315776 t4294968658 from 192.168.202.6@tcp req@ffff9c2344e91500 x1870961896315776/t0(4294968658) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784290444.657711:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2344e91500 x1870961896315776/t0(4294968658) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784290444.657726:0:96639:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x762:0x0] 00000001:00000040:0.0:1784290444.657787:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 5 00000020:00000040:0.0:1784290444.657790:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=10 00010000:00000040:0.0:1784290444.657806:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968658, xid 1870961896315776 00000100:00000040:0.0:1784290444.657812:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290444.657818:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290444.657858:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:0.0:1784290444.657865:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784290444.657871:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:0.0:1784290444.657880:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 9 00010000:00080000:0.0:1784290444.657884:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968659 00010000:00080000:0.0:1784290444.657888:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968659 00000100:00000040:2.0:1784290444.658566:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c247581ad80 x1870961896317056 msgsize 440 00000100:00100000:2.0:1784290444.658573:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290444.658608:0:25102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896317056 00000100:00100000:0.0:1784290444.658613:0:25102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896317056 00000020:00000040:0.0:1784290444.658615:0:25102:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:0.0:1784290444.658618:0:25102:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=10 00000100:00000040:0.0:1784290444.658629:0:25102:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784290444.658651:0:25102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 403 00000100:00000040:0.0:1784290444.658654:0:25102:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:0.0:1784290444.658659:0:25102:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c247581ad80 x1870961896317056/t0(4294968659) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.658668:0:25102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247581ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:2396:x1870961896317056:12345-192.168.202.6@tcp:10:dd.0 00000020:00000040:0.0:1784290444.658674:0:25102:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c247581ad80 x1870961896317056/t0(4294968659) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784290444.658680:0:25102:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968659, current: 4294968659, replaying 00010000:00000040:0.0:1784290444.658682:0:25102:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:0.0:1784290444.658690:0:25102:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c247581ad80 x1870961896317056/t0(4294968659) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.658696:0:25102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247581ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+10:2396:x1870961896317056:12345-192.168.202.6@tcp:10:dd.0 Request processed in 30us (129us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784290444.658701:0:25102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 403 00000100:00000040:0.0:1784290444.658703:0:25102:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:3.0:1784290444.658729:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968659, next_transno: 4294968659 00010000:00080000:3.0:1784290444.658734:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968659) 00010000:00080000:3.0:1784290444.658742:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896317056 t4294968659 from 192.168.202.6@tcp req@ffff9c247581ad80 x1870961896317056/t0(4294968659) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.658771:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c247581ad80 x1870961896317056/t0(4294968659) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1784290444.658791:0:96639:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76c:0x0] 00000001:00000040:3.0:1784290444.658894:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 6 00000020:00000040:3.0:1784290444.658898:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=11 00010000:00000040:3.0:1784290444.658920:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968659, xid 1870961896317056 00000100:00000040:3.0:1784290444.658927:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290444.658932:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:3.0:1784290444.658960:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:3.0:1784290444.658966:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784290444.658970:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:3.0:1784290444.658977:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 10 00010000:00080000:3.0:1784290444.658981:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968660 00010000:00080000:3.0:1784290444.658985:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968660 00000100:00000040:3.0:1784290444.659711:0:3610:0:(events.c:337:request_in_callback()) incoming req@ffff9c2447cca680 x1870961896317184 msgsize 440 00000100:00100000:3.0:1784290444.659718:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290444.659752:0:25104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896317184 00000100:00100000:0.0:1784290444.659756:0:25104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896317184 00000020:00000040:0.0:1784290444.659757:0:25104:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:0.0:1784290444.659759:0:25104:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=11 00000100:00000040:0.0:1784290444.659769:0:25104:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784290444.659790:0:25104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 404 00000100:00000040:0.0:1784290444.659792:0:25104:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:0.0:1784290444.659802:0:25104:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2447cca680 x1870961896317184/t0(4294968660) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.659812:0:25104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:2396:x1870961896317184:12345-192.168.202.6@tcp:10:dd.0 00000020:00000040:0.0:1784290444.659817:0:25104:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2447cca680 x1870961896317184/t0(4294968660) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784290444.659823:0:25104:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968660, current: 4294968660, replaying 00010000:00000040:0.0:1784290444.659825:0:25104:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:0.0:1784290444.659833:0:25104:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2447cca680 x1870961896317184/t0(4294968660) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.659840:0:25104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:2396:x1870961896317184:12345-192.168.202.6@tcp:10:dd.0 Request processed in 29us (128us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784290444.659856:0:25104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 404 00010000:00080000:3.0:1784290444.659859:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968660, next_transno: 4294968660 00000100:00000040:0.0:1784290444.659860:0:25104:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:3.0:1784290444.659867:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968660) 00010000:00080000:3.0:1784290444.659877:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896317184 t4294968660 from 192.168.202.6@tcp req@ffff9c2447cca680 x1870961896317184/t0(4294968660) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.659893:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2447cca680 x1870961896317184/t0(4294968660) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1784290444.659911:0:96639:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x766:0x0] 00000001:00000040:3.0:1784290444.659983:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 7 00000020:00000040:3.0:1784290444.659986:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=12 00010000:00000040:3.0:1784290444.660003:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968660, xid 1870961896317184 00000100:00000040:3.0:1784290444.660014:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290444.660020:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:3.0:1784290444.660046:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:3.0:1784290444.660052:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784290444.660057:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:3.0:1784290444.660064:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 11 00010000:00080000:3.0:1784290444.660067:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968661 00010000:00080000:3.0:1784290444.660071:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968661 00000100:00000040:1.0:1784290444.661461:0:3611:0:(events.c:337:request_in_callback()) incoming req@ffff9c2344e90700 x1870961896318848 msgsize 440 00000100:00100000:1.0:1784290444.661475:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290444.661536:0:25096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896318848 00000100:00100000:3.0:1784290444.661542:0:25096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896318848 00000020:00000040:3.0:1784290444.661544:0:25096:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:3.0:1784290444.661548:0:25096:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=12 00000100:00000040:3.0:1784290444.661564:0:25096:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784290444.661594:0:25096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 405 00000100:00000040:3.0:1784290444.661598:0:25096:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:3.0:1784290444.661604:0:25096:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2344e90700 x1870961896318848/t0(4294968661) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.661619:0:25096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344e90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+12:2396:x1870961896318848:12345-192.168.202.6@tcp:10:dd.0 00000020:00000040:3.0:1784290444.661628:0:25096:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2344e90700 x1870961896318848/t0(4294968661) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784290444.661636:0:25096:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968661, current: 4294968661, replaying 00010000:00000040:3.0:1784290444.661639:0:25096:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:3.0:1784290444.661651:0:25096:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2344e90700 x1870961896318848/t0(4294968661) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.661659:0:25096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344e90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+12:2396:x1870961896318848:12345-192.168.202.6@tcp:10:dd.0 Request processed in 43us (199us total) trans 0 rc 0/-999 00010000:00080000:0.0:1784290444.661663:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968661, next_transno: 4294968661 00000100:00100000:3.0:1784290444.661666:0:25096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 405 00010000:00080000:0.0:1784290444.661669:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968661) 00000100:00000040:3.0:1784290444.661677:0:25096:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:0.0:1784290444.661678:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896318848 t4294968661 from 192.168.202.6@tcp req@ffff9c2344e90700 x1870961896318848/t0(4294968661) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784290444.661694:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2344e90700 x1870961896318848/t0(4294968661) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784290444.661712:0:96639:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x767:0x0] 00000001:00000040:0.0:1784290444.661776:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 8 00000020:00000040:0.0:1784290444.661780:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=13 00010000:00000040:0.0:1784290444.661798:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968661, xid 1870961896318848 00000100:00000040:0.0:1784290444.661805:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290444.661810:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290444.661864:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:0.0:1784290444.661872:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784290444.661879:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:0.0:1784290444.661889:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 12 00010000:00080000:0.0:1784290444.661893:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968662 00010000:00080000:0.0:1784290444.661899:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968662 00000100:00000040:3.0:1784290444.662544:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c2447cc8000 x1870961896319744 msgsize 440 00000100:00100000:3.0:1784290444.662558:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290444.662620:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896319744 00000100:00100000:1.0:1784290444.662633:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896319744 00000020:00000040:1.0:1784290444.662636:0:8409:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:1.0:1784290444.662642:0:8409:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=13 00000100:00000040:1.0:1784290444.662676:0:8409:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784290444.662732:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 406 00000100:00000040:1.0:1784290444.662738:0:8409:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:1.0:1784290444.662748:0:8409:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2447cc8000 x1870961896319744/t0(4294968662) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.662768:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+13:2396:x1870961896319744:12345-192.168.202.6@tcp:10:dd.0 00000020:00000040:1.0:1784290444.662781:0:8409:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2447cc8000 x1870961896319744/t0(4294968662) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784290444.662792:0:8409:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968662, current: 4294968662, replaying 00010000:00000040:1.0:1784290444.662796:0:8409:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:1.0:1784290444.662812:0:8409:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2447cc8000 x1870961896319744/t0(4294968662) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784290444.662820:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968662, next_transno: 4294968662 00010000:00080000:0.0:1784290444.662829:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968662) 00000100:00100000:1.0:1784290444.662831:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+13:2396:x1870961896319744:12345-192.168.202.6@tcp:10:dd.0 Request processed in 62us (280us total) trans 0 rc 0/-999 00010000:00080000:0.0:1784290444.662862:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896319744 t4294968662 from 192.168.202.6@tcp req@ffff9c2447cc8000 x1870961896319744/t0(4294968662) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.662877:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 406 00000020:00000040:0.0:1784290444.662884:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2447cc8000 x1870961896319744/t0(4294968662) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00000040:1.0:1784290444.662886:0:8409:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00002000:00000040:0.0:1784290444.662914:0:96639:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x768:0x0] 00000001:00000040:0.0:1784290444.662972:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 9 00000020:00000040:0.0:1784290444.662975:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=14 00010000:00000040:0.0:1784290444.662987:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968662, xid 1870961896319744 00000100:00000040:0.0:1784290444.662993:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290444.662997:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290444.663021:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:0.0:1784290444.663026:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784290444.663031:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:0.0:1784290444.663038:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 13 00010000:00080000:0.0:1784290444.663040:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968663 00010000:00080000:0.0:1784290444.663043:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968663 00000100:00000040:3.0:1784290444.663828:0:3610:0:(events.c:337:request_in_callback()) incoming req@ffff9c2447cca300 x1870961896321664 msgsize 440 00000100:00100000:3.0:1784290444.663836:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290444.663955:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896321664 00000100:00100000:1.0:1784290444.663969:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896321664 00000020:00000040:1.0:1784290444.663973:0:8408:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:1.0:1784290444.663980:0:8408:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=14 00000100:00000040:1.0:1784290444.664010:0:8408:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784290444.664075:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 407 00000100:00000040:1.0:1784290444.664083:0:8408:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:1.0:1784290444.664095:0:8408:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2447cca300 x1870961896321664/t0(4294968663) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.664116:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+14:2396:x1870961896321664:12345-192.168.202.6@tcp:10:dd.0 00000020:00000040:1.0:1784290444.664146:0:8408:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2447cca300 x1870961896321664/t0(4294968663) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784290444.664157:0:8408:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968663, current: 4294968663, replaying 00010000:00000040:1.0:1784290444.664161:0:8408:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:1.0:1784290444.664183:0:8408:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2447cca300 x1870961896321664/t0(4294968663) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.664196:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+14:2396:x1870961896321664:12345-192.168.202.6@tcp:10:dd.0 Request processed in 85us (365us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784290444.664205:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 407 00000100:00000040:1.0:1784290444.664210:0:8408:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:0.0:1784290444.664229:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968663, next_transno: 4294968663 00010000:00080000:0.0:1784290444.664235:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968663) 00010000:00080000:0.0:1784290444.664245:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896321664 t4294968663 from 192.168.202.6@tcp req@ffff9c2447cca300 x1870961896321664/t0(4294968663) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784290444.664269:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2447cca300 x1870961896321664/t0(4294968663) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784290444.664286:0:96639:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x770:0x0] 00000001:00000040:0.0:1784290444.664381:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 10 00000020:00000040:0.0:1784290444.664386:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=15 00010000:00000040:0.0:1784290444.664410:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968663, xid 1870961896321664 00000100:00000040:0.0:1784290444.664416:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290444.664420:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290444.664442:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:0.0:1784290444.664447:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784290444.664451:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:0.0:1784290444.664457:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 14 00010000:00080000:0.0:1784290444.664460:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968664 00010000:00080000:0.0:1784290444.664463:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968664 00000100:00000040:1.0:1784290444.665212:0:3611:0:(events.c:337:request_in_callback()) incoming req@ffff9c2344e92d80 x1870961896321792 msgsize 440 00000100:00100000:1.0:1784290444.665226:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290444.665282:0:25102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896321792 00000100:00100000:0.0:1784290444.665291:0:25102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896321792 00000020:00000040:0.0:1784290444.665294:0:25102:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:0.0:1784290444.665298:0:25102:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=15 00000100:00000040:0.0:1784290444.665315:0:25102:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784290444.665388:0:25102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 408 00000100:00000040:0.0:1784290444.665393:0:25102:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:0.0:1784290444.665401:0:25102:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2344e92d80 x1870961896321792/t0(4294968664) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.665424:0:25102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+15:2396:x1870961896321792:12345-192.168.202.6@tcp:10:dd.0 00000020:00000040:0.0:1784290444.665437:0:25102:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2344e92d80 x1870961896321792/t0(4294968664) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784290444.665462:0:25102:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968664, current: 4294968664, replaying 00010000:00000040:0.0:1784290444.665465:0:25102:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:0.0:1784290444.665482:0:25102:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2344e92d80 x1870961896321792/t0(4294968664) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.665493:0:25102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344e92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+15:2396:x1870961896321792:12345-192.168.202.6@tcp:10:dd.0 Request processed in 80us (281us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784290444.665503:0:25102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 408 00000100:00000040:0.0:1784290444.665507:0:25102:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:3.0:1784290444.665522:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968664, next_transno: 4294968664 00010000:00080000:3.0:1784290444.665527:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968664) 00010000:00080000:3.0:1784290444.665535:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896321792 t4294968664 from 192.168.202.6@tcp req@ffff9c2344e92d80 x1870961896321792/t0(4294968664) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.665556:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2344e92d80 x1870961896321792/t0(4294968664) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1784290444.665575:0:96639:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76a:0x0] 00000001:00000040:3.0:1784290444.665659:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 11 00000020:00000040:3.0:1784290444.665662:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=16 00010000:00000040:3.0:1784290444.665678:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968664, xid 1870961896321792 00000100:00000040:3.0:1784290444.665685:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290444.665689:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:3.0:1784290444.665719:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:3.0:1784290444.665725:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784290444.665731:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:3.0:1784290444.665739:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 15 00010000:00080000:3.0:1784290444.665743:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968665 00010000:00080000:3.0:1784290444.665748:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968665 00000100:00000040:3.0:1784290444.666451:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c2447cc9f80 x1870961896323712 msgsize 440 00000100:00100000:3.0:1784290444.666458:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290444.666491:0:25104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896323712 00000100:00100000:0.0:1784290444.666495:0:25104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896323712 00000020:00000040:0.0:1784290444.666497:0:25104:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:0.0:1784290444.666499:0:25104:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=16 00000100:00000040:0.0:1784290444.666508:0:25104:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784290444.666529:0:25104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 409 00000100:00000040:0.0:1784290444.666531:0:25104:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:0.0:1784290444.666534:0:25104:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2447cc9f80 x1870961896323712/t0(4294968665) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.666543:0:25104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+16:2396:x1870961896323712:12345-192.168.202.6@tcp:10:dd.0 00000020:00000040:0.0:1784290444.666549:0:25104:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2447cc9f80 x1870961896323712/t0(4294968665) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784290444.666555:0:25104:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968665, current: 4294968665, replaying 00010000:00000040:0.0:1784290444.666558:0:25104:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:0.0:1784290444.666566:0:25104:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2447cc9f80 x1870961896323712/t0(4294968665) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.666572:0:25104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+16:2396:x1870961896323712:12345-192.168.202.6@tcp:10:dd.0 Request processed in 30us (120us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784290444.666584:0:25104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 409 00000100:00000040:0.0:1784290444.666586:0:25104:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:3.0:1784290444.666604:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968665, next_transno: 4294968665 00010000:00080000:3.0:1784290444.666610:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968665) 00010000:00080000:3.0:1784290444.666625:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896323712 t4294968665 from 192.168.202.6@tcp req@ffff9c2447cc9f80 x1870961896323712/t0(4294968665) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.666643:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2447cc9f80 x1870961896323712/t0(4294968665) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1784290444.666663:0:96639:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x775:0x0] 00000001:00000040:3.0:1784290444.666739:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 12 00000020:00000040:3.0:1784290444.666742:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=17 00010000:00000040:3.0:1784290444.666759:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968665, xid 1870961896323712 00000100:00000040:3.0:1784290444.666765:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290444.666770:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:3.0:1784290444.666797:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:3.0:1784290444.666804:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784290444.666809:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:3.0:1784290444.666815:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 16 00010000:00080000:3.0:1784290444.666819:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968666 00010000:00080000:3.0:1784290444.666823:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968666 00000100:00000040:0.0:1784290444.667623:0:3610:0:(events.c:337:request_in_callback()) incoming req@ffff9c246ddf2a00 x1870961896324992 msgsize 440 00000100:00100000:0.0:1784290444.667628:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290444.667670:0:25096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896324992 00000100:00100000:3.0:1784290444.667676:0:25096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896324992 00000020:00000040:3.0:1784290444.667678:0:25096:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:3.0:1784290444.667681:0:25096:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=17 00000100:00000040:3.0:1784290444.667696:0:25096:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784290444.667724:0:25096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 410 00000100:00000040:3.0:1784290444.667728:0:25096:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:3.0:1784290444.667734:0:25096:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246ddf2a00 x1870961896324992/t0(4294968666) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.667749:0:25096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ddf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+17:2396:x1870961896324992:12345-192.168.202.6@tcp:10:dd.0 00000020:00000040:3.0:1784290444.667758:0:25096:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246ddf2a00 x1870961896324992/t0(4294968666) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784290444.667774:0:25096:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968666, current: 4294968666, replaying 00010000:00000040:3.0:1784290444.667777:0:25096:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:3.0:1784290444.667792:0:25096:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf2a00 x1870961896324992/t0(4294968666) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.667804:0:25096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ddf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+17:2396:x1870961896324992:12345-192.168.202.6@tcp:10:dd.0 Request processed in 56us (178us total) trans 0 rc 0/-999 00010000:00080000:0.0:1784290444.667807:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968666, next_transno: 4294968666 00010000:00080000:0.0:1784290444.667813:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968666) 00000100:00100000:3.0:1784290444.667815:0:25096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 410 00000100:00000040:3.0:1784290444.667820:0:25096:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:0.0:1784290444.667822:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896324992 t4294968666 from 192.168.202.6@tcp req@ffff9c246ddf2a00 x1870961896324992/t0(4294968666) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784290444.667836:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246ddf2a00 x1870961896324992/t0(4294968666) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784290444.667865:0:96639:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76b:0x0] 00000001:00000040:0.0:1784290444.667922:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 13 00000020:00000040:0.0:1784290444.667924:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=18 00010000:00000040:0.0:1784290444.667936:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968666, xid 1870961896324992 00000100:00000040:0.0:1784290444.667941:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290444.667944:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290444.667965:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:0.0:1784290444.667969:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784290444.667973:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:0.0:1784290444.667979:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 17 00010000:00080000:0.0:1784290444.667982:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968667 00010000:00080000:0.0:1784290444.667985:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968667 00000100:00000040:1.0:1784290444.668907:0:3611:0:(events.c:337:request_in_callback()) incoming req@ffff9c2344e91f80 x1870961896325888 msgsize 440 00000100:00100000:1.0:1784290444.668918:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290444.668969:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896325888 00000100:00100000:2.0:1784290444.668976:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896325888 00000020:00000040:2.0:1784290444.668977:0:8409:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:2.0:1784290444.668980:0:8409:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=18 00000100:00000040:2.0:1784290444.668993:0:8409:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784290444.669019:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 411 00000100:00000040:2.0:1784290444.669022:0:8409:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:2.0:1784290444.669027:0:8409:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2344e91f80 x1870961896325888/t0(4294968667) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290444.669037:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+18:2396:x1870961896325888:12345-192.168.202.6@tcp:10:dd.0 00000020:00000040:2.0:1784290444.669044:0:8409:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2344e91f80 x1870961896325888/t0(4294968667) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784290444.669050:0:8409:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968667, current: 4294968667, replaying 00010000:00000040:2.0:1784290444.669052:0:8409:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:2.0:1784290444.669061:0:8409:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2344e91f80 x1870961896325888/t0(4294968667) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784290444.669073:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968667, next_transno: 4294968667 00010000:00080000:0.0:1784290444.669081:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968667) 00000100:00100000:2.0:1784290444.669085:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344e91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+18:2396:x1870961896325888:12345-192.168.202.6@tcp:10:dd.0 Request processed in 48us (177us total) trans 0 rc 0/-999 00010000:00080000:0.0:1784290444.669092:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896325888 t4294968667 from 192.168.202.6@tcp req@ffff9c2344e91f80 x1870961896325888/t0(4294968667) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290444.669097:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 411 00000100:00000040:2.0:1784290444.669103:0:8409:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00000020:00000040:0.0:1784290444.669124:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2344e91f80 x1870961896325888/t0(4294968667) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784290444.669137:0:96639:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76d:0x0] 00000001:00000040:0.0:1784290444.669191:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 14 00000020:00000040:0.0:1784290444.669194:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=19 00010000:00000040:0.0:1784290444.669205:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968667, xid 1870961896325888 00000100:00000040:0.0:1784290444.669210:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290444.669213:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290444.669249:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:0.0:1784290444.669253:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784290444.669257:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:0.0:1784290444.669263:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 18 00010000:00080000:0.0:1784290444.669266:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968668 00010000:00080000:0.0:1784290444.669269:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968668 00000100:00000040:3.0:1784290444.670062:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c2447cc8700 x1870961896326400 msgsize 440 00000100:00100000:3.0:1784290444.670070:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290444.670148:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896326400 00000100:00100000:1.0:1784290444.670158:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896326400 00000020:00000040:1.0:1784290444.670160:0:8408:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:1.0:1784290444.670165:0:8408:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=19 00000100:00000040:1.0:1784290444.670183:0:8408:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784290444.670223:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 412 00000100:00000040:1.0:1784290444.670227:0:8408:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:1.0:1784290444.670235:0:8408:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2447cc8700 x1870961896326400/t0(4294968668) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.670254:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+19:2396:x1870961896326400:12345-192.168.202.6@tcp:10:dd.0 00000020:00000040:1.0:1784290444.670265:0:8408:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2447cc8700 x1870961896326400/t0(4294968668) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784290444.670290:0:8408:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968668, current: 4294968668, replaying 00010000:00000040:1.0:1784290444.670293:0:8408:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:1.0:1784290444.670309:0:8408:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2447cc8700 x1870961896326400/t0(4294968668) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.670320:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+19:2396:x1870961896326400:12345-192.168.202.6@tcp:10:dd.0 Request processed in 71us (256us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784290444.670328:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 412 00000100:00000040:1.0:1784290444.670331:0:8408:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:0.0:1784290444.670405:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968668, next_transno: 4294968668 00010000:00080000:0.0:1784290444.670410:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968668) 00010000:00080000:0.0:1784290444.670419:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896326400 t4294968668 from 192.168.202.6@tcp req@ffff9c2447cc8700 x1870961896326400/t0(4294968668) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784290444.670435:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2447cc8700 x1870961896326400/t0(4294968668) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784290444.670451:0:96639:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76f:0x0] 00000001:00000040:0.0:1784290444.670514:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 15 00000020:00000040:0.0:1784290444.670517:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=20 00010000:00000040:0.0:1784290444.670530:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968668, xid 1870961896326400 00000100:00000040:0.0:1784290444.670535:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290444.670539:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290444.670570:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:0.0:1784290444.670576:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784290444.670580:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:0.0:1784290444.670586:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 19 00010000:00080000:0.0:1784290444.670591:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968669 00010000:00080000:0.0:1784290444.670596:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968669 00000100:00000040:3.0:1784290444.671402:0:3610:0:(events.c:337:request_in_callback()) incoming req@ffff9c2447ccad80 x1870961896328448 msgsize 440 00000100:00100000:3.0:1784290444.671409:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290444.671441:0:25102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896328448 00000100:00100000:0.0:1784290444.671446:0:25102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896328448 00000020:00000040:0.0:1784290444.671448:0:25102:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:0.0:1784290444.671450:0:25102:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=20 00000100:00000040:0.0:1784290444.671462:0:25102:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784290444.671484:0:25102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 413 00000100:00000040:0.0:1784290444.671487:0:25102:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:0.0:1784290444.671491:0:25102:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2447ccad80 x1870961896328448/t0(4294968669) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.671501:0:25102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+20:2396:x1870961896328448:12345-192.168.202.6@tcp:10:dd.0 00000020:00000040:0.0:1784290444.671507:0:25102:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2447ccad80 x1870961896328448/t0(4294968669) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784290444.671513:0:25102:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968669, current: 4294968669, replaying 00010000:00000040:0.0:1784290444.671515:0:25102:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:0.0:1784290444.671524:0:25102:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2447ccad80 x1870961896328448/t0(4294968669) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.671531:0:25102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+20:2396:x1870961896328448:12345-192.168.202.6@tcp:10:dd.0 Request processed in 31us (128us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784290444.671536:0:25102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 413 00000100:00000040:0.0:1784290444.671538:0:25102:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:3.0:1784290444.671560:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968669, next_transno: 4294968669 00010000:00080000:3.0:1784290444.671565:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968669) 00010000:00080000:3.0:1784290444.671573:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896328448 t4294968669 from 192.168.202.6@tcp req@ffff9c2447ccad80 x1870961896328448/t0(4294968669) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.671591:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2447ccad80 x1870961896328448/t0(4294968669) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1784290444.671609:0:96639:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x76e:0x0] 00000001:00000040:3.0:1784290444.671691:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 16 00000020:00000040:3.0:1784290444.671695:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=21 00010000:00000040:3.0:1784290444.671712:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968669, xid 1870961896328448 00000100:00000040:3.0:1784290444.671719:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290444.671724:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:3.0:1784290444.671753:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:3.0:1784290444.671760:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784290444.671772:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:3.0:1784290444.671781:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 20 00010000:00080000:3.0:1784290444.671785:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968670 00010000:00080000:3.0:1784290444.671789:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968670 00000100:00000040:1.0:1784290444.672664:0:3611:0:(events.c:337:request_in_callback()) incoming req@ffff9c2344e91c00 x1870961896329344 msgsize 440 00000100:00100000:1.0:1784290444.672693:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290444.672780:0:25104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896329344 00000100:00100000:0.0:1784290444.672796:0:25104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896329344 00000020:00000040:0.0:1784290444.672799:0:25104:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:0.0:1784290444.672803:0:25104:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=21 00000100:00000040:0.0:1784290444.672818:0:25104:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784290444.672864:0:25104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 414 00000100:00000040:0.0:1784290444.672868:0:25104:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:0.0:1784290444.672883:0:25104:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2344e91c00 x1870961896329344/t0(4294968670) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.672900:0:25104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+21:2396:x1870961896329344:12345-192.168.202.6@tcp:10:dd.0 00000020:00000040:0.0:1784290444.672911:0:25104:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2344e91c00 x1870961896329344/t0(4294968670) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784290444.672918:0:25104:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968670, current: 4294968670, replaying 00010000:00000040:0.0:1784290444.672920:0:25104:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:0.0:1784290444.672931:0:25104:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2344e91c00 x1870961896329344/t0(4294968670) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.672937:0:25104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344e91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+21:2396:x1870961896329344:12345-192.168.202.6@tcp:10:dd.0 Request processed in 42us (273us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784290444.672943:0:25104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 414 00000100:00000040:0.0:1784290444.672945:0:25104:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:3.0:1784290444.672971:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968670, next_transno: 4294968670 00010000:00080000:3.0:1784290444.672977:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968670) 00010000:00080000:3.0:1784290444.672986:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896329344 t4294968670 from 192.168.202.6@tcp req@ffff9c2344e91c00 x1870961896329344/t0(4294968670) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.673002:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2344e91c00 x1870961896329344/t0(4294968670) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1784290444.673018:0:96639:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x771:0x0] 00000001:00000040:3.0:1784290444.673088:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 17 00000020:00000040:3.0:1784290444.673092:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=22 00010000:00000040:3.0:1784290444.673107:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968670, xid 1870961896329344 00000100:00000040:3.0:1784290444.673113:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290444.673117:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:3.0:1784290444.673146:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:3.0:1784290444.673152:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784290444.673159:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:3.0:1784290444.673170:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 21 00010000:00080000:3.0:1784290444.673174:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968671 00010000:00080000:3.0:1784290444.673179:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968671 00000100:00000040:0.0:1784290444.674024:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c246ddf0000 x1870961896329472 msgsize 440 00000100:00100000:0.0:1784290444.674029:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290444.674064:0:25096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896329472 00000100:00100000:3.0:1784290444.674068:0:25096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896329472 00000020:00000040:3.0:1784290444.674070:0:25096:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:3.0:1784290444.674072:0:25096:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=22 00000100:00000040:3.0:1784290444.674082:0:25096:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784290444.674102:0:25096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 415 00000100:00000040:3.0:1784290444.674111:0:25096:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:3.0:1784290444.674116:0:25096:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246ddf0000 x1870961896329472/t0(4294968671) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.674126:0:25096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ddf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+22:2396:x1870961896329472:12345-192.168.202.6@tcp:10:dd.0 00000020:00000040:3.0:1784290444.674132:0:25096:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246ddf0000 x1870961896329472/t0(4294968671) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784290444.674138:0:25096:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968671, current: 4294968671, replaying 00010000:00000040:3.0:1784290444.674141:0:25096:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:3.0:1784290444.674150:0:25096:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf0000 x1870961896329472/t0(4294968671) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.674157:0:25096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ddf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+22:2396:x1870961896329472:12345-192.168.202.6@tcp:10:dd.0 Request processed in 33us (132us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784290444.674163:0:25096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 415 00010000:00080000:0.0:1784290444.674163:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968671, next_transno: 4294968671 00000100:00000040:3.0:1784290444.674168:0:25096:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:0.0:1784290444.674169:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968671) 00010000:00080000:0.0:1784290444.674178:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896329472 t4294968671 from 192.168.202.6@tcp req@ffff9c246ddf0000 x1870961896329472/t0(4294968671) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784290444.674192:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246ddf0000 x1870961896329472/t0(4294968671) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784290444.674213:0:96639:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x772:0x0] 00000001:00000040:0.0:1784290444.674282:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 18 00000020:00000040:0.0:1784290444.674285:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=23 00010000:00000040:0.0:1784290444.674298:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968671, xid 1870961896329472 00000100:00000040:0.0:1784290444.674303:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290444.674307:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290444.674328:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:0.0:1784290444.674333:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784290444.674336:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:0.0:1784290444.674397:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 22 00010000:00080000:0.0:1784290444.674528:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968672 00010000:00080000:0.0:1784290444.674535:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968672 00000100:00000040:0.0:1784290444.675193:0:3610:0:(events.c:337:request_in_callback()) incoming req@ffff9c246ddf2300 x1870961896331264 msgsize 440 00000100:00100000:0.0:1784290444.675198:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290444.675236:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896331264 00000100:00100000:2.0:1784290444.675242:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896331264 00000020:00000040:2.0:1784290444.675244:0:8409:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:2.0:1784290444.675246:0:8409:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=23 00000100:00000040:2.0:1784290444.675268:0:8409:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784290444.675298:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 416 00000100:00000040:2.0:1784290444.675302:0:8409:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:2.0:1784290444.675309:0:8409:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246ddf2300 x1870961896331264/t0(4294968672) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290444.675323:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ddf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+23:2396:x1870961896331264:12345-192.168.202.6@tcp:10:dd.0 00000020:00000040:2.0:1784290444.675330:0:8409:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246ddf2300 x1870961896331264/t0(4294968672) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784290444.675335:0:8409:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968672, current: 4294968672, replaying 00010000:00000040:2.0:1784290444.675338:0:8409:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:2.0:1784290444.675373:0:8409:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf2300 x1870961896331264/t0(4294968672) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784290444.675380:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968672, next_transno: 4294968672 00010000:00080000:0.0:1784290444.675385:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968672) 00000100:00100000:2.0:1784290444.675389:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ddf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+23:2396:x1870961896331264:12345-192.168.202.6@tcp:10:dd.0 Request processed in 64us (190us total) trans 0 rc 0/-999 00010000:00080000:0.0:1784290444.675395:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896331264 t4294968672 from 192.168.202.6@tcp req@ffff9c246ddf2300 x1870961896331264/t0(4294968672) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290444.675406:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 416 00000100:00000040:2.0:1784290444.675411:0:8409:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00000020:00000040:0.0:1784290444.675418:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246ddf2300 x1870961896331264/t0(4294968672) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784290444.675433:0:96639:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x773:0x0] 00000001:00000040:0.0:1784290444.675487:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 19 00000020:00000040:0.0:1784290444.675490:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=24 00010000:00000040:0.0:1784290444.675502:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968672, xid 1870961896331264 00000100:00000040:0.0:1784290444.675507:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290444.675510:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290444.675531:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:0.0:1784290444.675542:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784290444.675547:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:0.0:1784290444.675553:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 23 00010000:00080000:0.0:1784290444.675556:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968673 00010000:00080000:0.0:1784290444.675559:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968673 00000100:00000040:1.0:1784290444.676276:0:3611:0:(events.c:337:request_in_callback()) incoming req@ffff9c2344e93100 x1870961896331520 msgsize 440 00000100:00100000:1.0:1784290444.676288:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290444.676380:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896331520 00000100:00100000:3.0:1784290444.676386:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896331520 00000020:00000040:3.0:1784290444.676389:0:8408:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:3.0:1784290444.676393:0:8408:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=24 00000100:00000040:3.0:1784290444.676403:0:8408:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784290444.676424:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 417 00000100:00000040:3.0:1784290444.676426:0:8408:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:3.0:1784290444.676431:0:8408:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2344e93100 x1870961896331520/t0(4294968673) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.676440:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+24:2396:x1870961896331520:12345-192.168.202.6@tcp:10:dd.0 00000020:00000040:3.0:1784290444.676446:0:8408:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2344e93100 x1870961896331520/t0(4294968673) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784290444.676458:0:8408:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968673, current: 4294968673, replaying 00010000:00000040:3.0:1784290444.676460:0:8408:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:3.0:1784290444.676469:0:8408:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2344e93100 x1870961896331520/t0(4294968673) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.676475:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344e93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+24:2396:x1870961896331520:12345-192.168.202.6@tcp:10:dd.0 Request processed in 37us (200us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784290444.676481:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 417 00000100:00000040:3.0:1784290444.676483:0:8408:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:0.0:1784290444.676486:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968673, next_transno: 4294968673 00010000:00080000:0.0:1784290444.676490:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968673) 00010000:00080000:0.0:1784290444.676497:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896331520 t4294968673 from 192.168.202.6@tcp req@ffff9c2344e93100 x1870961896331520/t0(4294968673) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784290444.676508:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2344e93100 x1870961896331520/t0(4294968673) o10->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 440/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1784290444.676523:0:96639:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x774:0x0] 00000001:00000040:0.0:1784290444.676576:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 20 00000020:00000040:0.0:1784290444.676578:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=25 00010000:00000040:0.0:1784290444.676589:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968673, xid 1870961896331520 00000100:00000040:0.0:1784290444.676593:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290444.676597:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290444.676620:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:0.0:1784290444.676625:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784290444.676629:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:0.0:1784290444.676636:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 24 00010000:00080000:0.0:1784290444.676639:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968674 00010000:00080000:0.0:1784290444.676642:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968674 00000100:00000040:3.0:1784290444.677363:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c2447cc8380 x1870961896332160 msgsize 1512 00000100:00100000:3.0:1784290444.677370:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290444.677400:0:25102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896332160 00000100:00100000:0.0:1784290444.677405:0:25102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896332160 00000020:00000040:0.0:1784290444.677406:0:25102:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:0.0:1784290444.677409:0:25102:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=25 00000100:00000040:0.0:1784290444.677419:0:25102:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784290444.677483:0:25102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 418 00000100:00000040:0.0:1784290444.677487:0:25102:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:0.0:1784290444.677492:0:25102:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2447cc8380 x1870961896332160/t0(4294968674) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.677502:0:25102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+25:2396:x1870961896332160:12345-192.168.202.6@tcp:4:dd.0 00000020:00000040:0.0:1784290444.677508:0:25102:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2447cc8380 x1870961896332160/t0(4294968674) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784290444.677513:0:25102:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968674, current: 4294968674, replaying 00010000:00000040:0.0:1784290444.677516:0:25102:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:0.0:1784290444.677524:0:25102:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2447cc8380 x1870961896332160/t0(4294968674) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.677530:0:25102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+25:2396:x1870961896332160:12345-192.168.202.6@tcp:4:dd.0 Request processed in 30us (166us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784290444.677535:0:25102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 418 00000100:00000040:0.0:1784290444.677538:0:25102:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:3.0:1784290444.677556:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968674, next_transno: 4294968674 00010000:00080000:3.0:1784290444.677562:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968674) 00010000:00080000:3.0:1784290444.677570:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896332160 t4294968674 from 192.168.202.6@tcp req@ffff9c2447cc8380 x1870961896332160/t0(4294968674) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.677588:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2447cc8380 x1870961896332160/t0(4294968674) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1784290444.677629:0:96639:0:(ofd_dev.c:430:ofd_object_init()) object init, fid = [0x280000401:0x0:0x0] 00002000:00080000:3.0:1784290444.677687:0:96639:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00000020:00000040:3.0:1784290444.677750:0:96639:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1784290444.677787:0:96639:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 12575 MB/s 00000020:00000040:3.0:1784290444.677790:0:96639:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1784290444.678047:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 21 00000020:00000040:3.0:1784290444.678050:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=26 00010000:00000040:3.0:1784290444.678244:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968674, xid 1870961896332160 00000100:00000040:3.0:1784290444.678259:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290444.678262:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:3.0:1784290444.678287:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:3.0:1784290444.678293:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784290444.678296:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:3.0:1784290444.678301:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 25 00010000:00080000:3.0:1784290444.678304:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968675 00010000:00080000:3.0:1784290444.678306:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968675 00000100:00000040:3.0:1784290444.679160:0:3610:0:(events.c:337:request_in_callback()) incoming req@ffff9c24483cad80 x1870961896332416 msgsize 1512 00000100:00100000:3.0:1784290444.679194:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290444.679240:0:25104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896332416 00000100:00100000:0.0:1784290444.679244:0:25104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896332416 00000020:00000040:0.0:1784290444.679246:0:25104:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:0.0:1784290444.679248:0:25104:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=26 00000100:00000040:0.0:1784290444.679258:0:25104:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784290444.679285:0:25104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 419 00000100:00000040:0.0:1784290444.679287:0:25104:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:0.0:1784290444.679290:0:25104:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c24483cad80 x1870961896332416/t0(4294968675) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.679299:0:25104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+26:2396:x1870961896332416:12345-192.168.202.6@tcp:4:dd.0 00000020:00000040:0.0:1784290444.679305:0:25104:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c24483cad80 x1870961896332416/t0(4294968675) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784290444.679317:0:25104:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968675, current: 4294968675, replaying 00010000:00000040:0.0:1784290444.679320:0:25104:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:0.0:1784290444.679331:0:25104:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c24483cad80 x1870961896332416/t0(4294968675) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.679337:0:25104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+26:2396:x1870961896332416:12345-192.168.202.6@tcp:4:dd.0 Request processed in 40us (177us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784290444.679367:0:25104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 419 00000100:00000040:0.0:1784290444.679369:0:25104:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:3.0:1784290444.679376:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968675, next_transno: 4294968675 00010000:00080000:3.0:1784290444.679381:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968675) 00010000:00080000:3.0:1784290444.679390:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896332416 t4294968675 from 192.168.202.6@tcp req@ffff9c24483cad80 x1870961896332416/t0(4294968675) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.679406:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c24483cad80 x1870961896332416/t0(4294968675) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.679458:0:96639:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1784290444.679469:0:96639:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 12575 MB/s 00000020:00000040:3.0:1784290444.679472:0:96639:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1784290444.679573:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 22 00000020:00000040:3.0:1784290444.679577:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=27 00010000:00000040:3.0:1784290444.679681:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968675, xid 1870961896332416 00000100:00000040:3.0:1784290444.679689:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290444.679695:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:3.0:1784290444.679723:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:3.0:1784290444.679731:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784290444.679738:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:3.0:1784290444.679746:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 26 00010000:00080000:3.0:1784290444.679751:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968676 00010000:00080000:3.0:1784290444.679755:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968676 00000100:00000040:1.0:1784290444.680538:0:3611:0:(events.c:337:request_in_callback()) incoming req@ffff9c2344e93800 x1870961896332672 msgsize 1512 00000100:00100000:1.0:1784290444.680551:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290444.680601:0:25096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896332672 00000100:00100000:3.0:1784290444.680607:0:25096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896332672 00000020:00000040:3.0:1784290444.680608:0:25096:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:3.0:1784290444.680611:0:25096:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=27 00000100:00000040:3.0:1784290444.680624:0:25096:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784290444.680647:0:25096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 420 00000100:00000040:3.0:1784290444.680650:0:25096:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:3.0:1784290444.680654:0:25096:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2344e93800 x1870961896332672/t0(4294968676) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.680662:0:25096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+27:2396:x1870961896332672:12345-192.168.202.6@tcp:4:dd.0 00000020:00000040:3.0:1784290444.680669:0:25096:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2344e93800 x1870961896332672/t0(4294968676) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784290444.680674:0:25096:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968676, current: 4294968676, replaying 00010000:00000040:3.0:1784290444.680677:0:25096:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:3.0:1784290444.680689:0:25096:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2344e93800 x1870961896332672/t0(4294968676) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.680696:0:25096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344e93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+27:2396:x1870961896332672:12345-192.168.202.6@tcp:4:dd.0 Request processed in 34us (158us total) trans 0 rc 0/-999 00010000:00080000:0.0:1784290444.680700:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968676, next_transno: 4294968676 00000100:00100000:3.0:1784290444.680703:0:25096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 420 00010000:00080000:0.0:1784290444.680706:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968676) 00000100:00000040:3.0:1784290444.680707:0:25096:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:0.0:1784290444.680714:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896332672 t4294968676 from 192.168.202.6@tcp req@ffff9c2344e93800 x1870961896332672/t0(4294968676) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784290444.680727:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2344e93800 x1870961896332672/t0(4294968676) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784290444.680782:0:96639:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784290444.680796:0:96639:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 12575 MB/s 00000020:00000040:0.0:1784290444.680799:0:96639:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1784290444.680953:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 23 00000020:00000040:0.0:1784290444.680956:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=28 00010000:00000040:0.0:1784290444.681082:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968676, xid 1870961896332672 00000100:00000040:0.0:1784290444.681088:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290444.681092:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290444.681116:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:0.0:1784290444.681121:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784290444.681127:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:0.0:1784290444.681133:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 27 00010000:00080000:0.0:1784290444.681141:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968677 00010000:00080000:0.0:1784290444.681144:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968677 00000100:00000040:0.0:1784290444.681906:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c246ddf0e00 x1870961896332928 msgsize 1512 00000100:00100000:0.0:1784290444.681912:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290444.681955:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896332928 00000100:00100000:2.0:1784290444.681966:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896332928 00000020:00000040:2.0:1784290444.681968:0:8409:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:2.0:1784290444.681971:0:8409:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=28 00000100:00000040:2.0:1784290444.681981:0:8409:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784290444.682005:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 421 00000100:00000040:2.0:1784290444.682008:0:8409:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:2.0:1784290444.682013:0:8409:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246ddf0e00 x1870961896332928/t0(4294968677) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290444.682023:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ddf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+28:2396:x1870961896332928:12345-192.168.202.6@tcp:4:dd.0 00000020:00000040:2.0:1784290444.682030:0:8409:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246ddf0e00 x1870961896332928/t0(4294968677) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784290444.682036:0:8409:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968677, current: 4294968677, replaying 00010000:00000040:2.0:1784290444.682038:0:8409:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:2.0:1784290444.682046:0:8409:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf0e00 x1870961896332928/t0(4294968677) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290444.682054:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ddf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+28:2396:x1870961896332928:12345-192.168.202.6@tcp:4:dd.0 Request processed in 30us (145us total) trans 0 rc 0/-999 00010000:00080000:0.0:1784290444.682054:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968677, next_transno: 4294968677 00010000:00080000:0.0:1784290444.682060:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968677) 00000100:00100000:2.0:1784290444.682066:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 421 00000100:00000040:2.0:1784290444.682070:0:8409:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:0.0:1784290444.682072:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896332928 t4294968677 from 192.168.202.6@tcp req@ffff9c246ddf0e00 x1870961896332928/t0(4294968677) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784290444.682088:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246ddf0e00 x1870961896332928/t0(4294968677) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784290444.682127:0:96639:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784290444.682136:0:96639:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 12575 MB/s 00000020:00000040:0.0:1784290444.682138:0:96639:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1784290444.682222:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 24 00000020:00000040:0.0:1784290444.682225:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=29 00010000:00000040:0.0:1784290444.682392:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968677, xid 1870961896332928 00000100:00000040:0.0:1784290444.682398:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290444.682401:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290444.682423:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:0.0:1784290444.682428:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784290444.682432:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:0.0:1784290444.682437:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 28 00010000:00080000:0.0:1784290444.682440:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968678 00010000:00080000:0.0:1784290444.682443:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968678 00000100:00000040:3.0:1784290444.683195:0:3610:0:(events.c:337:request_in_callback()) incoming req@ffff9c24483ca300 x1870961896333184 msgsize 1512 00000100:00100000:3.0:1784290444.683200:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290444.683263:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896333184 00000100:00100000:1.0:1784290444.683273:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896333184 00000020:00000040:1.0:1784290444.683276:0:8408:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:1.0:1784290444.683279:0:8408:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=29 00000100:00000040:1.0:1784290444.683299:0:8408:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784290444.683397:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 422 00000100:00000040:1.0:1784290444.683404:0:8408:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:1.0:1784290444.683414:0:8408:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c24483ca300 x1870961896333184/t0(4294968678) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.683432:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+29:2396:x1870961896333184:12345-192.168.202.6@tcp:4:dd.0 00000020:00000040:1.0:1784290444.683444:0:8408:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c24483ca300 x1870961896333184/t0(4294968678) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784290444.683469:0:8408:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968678, current: 4294968678, replaying 00010000:00000040:1.0:1784290444.683473:0:8408:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:1.0:1784290444.683492:0:8408:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c24483ca300 x1870961896333184/t0(4294968678) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.683503:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+29:2396:x1870961896333184:12345-192.168.202.6@tcp:4:dd.0 Request processed in 75us (305us total) trans 0 rc 0/-999 00010000:00080000:0.0:1784290444.683509:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968678, next_transno: 4294968678 00000100:00100000:1.0:1784290444.683522:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 422 00010000:00080000:0.0:1784290444.683523:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968678) 00010000:00080000:0.0:1784290444.683555:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896333184 t4294968678 from 192.168.202.6@tcp req@ffff9c24483ca300 x1870961896333184/t0(4294968678) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00000040:1.0:1784290444.683556:0:8408:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00000020:00000040:0.0:1784290444.683585:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c24483ca300 x1870961896333184/t0(4294968678) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784290444.683625:0:96639:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784290444.683644:0:96639:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 12575 MB/s 00000020:00000040:0.0:1784290444.683646:0:96639:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1784290444.683720:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 25 00000020:00000040:0.0:1784290444.683723:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=30 00010000:00000040:0.0:1784290444.683881:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968678, xid 1870961896333184 00000100:00000040:0.0:1784290444.683888:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290444.683891:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290444.683915:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:0.0:1784290444.683920:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784290444.683924:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:0.0:1784290444.683930:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 29 00010000:00080000:0.0:1784290444.683934:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968679 00010000:00080000:0.0:1784290444.683937:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968679 00000100:00000040:1.0:1784290444.684771:0:3611:0:(events.c:337:request_in_callback()) incoming req@ffff9c2344e92680 x1870961896333440 msgsize 1512 00000100:00100000:1.0:1784290444.684786:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290444.684876:0:25102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896333440 00000100:00100000:0.0:1784290444.684884:0:25102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896333440 00000020:00000040:0.0:1784290444.684886:0:25102:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:0.0:1784290444.684890:0:25102:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=30 00000100:00000040:0.0:1784290444.684903:0:25102:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784290444.684932:0:25102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 423 00000100:00000040:0.0:1784290444.684935:0:25102:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:0.0:1784290444.684939:0:25102:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2344e92680 x1870961896333440/t0(4294968679) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.684949:0:25102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344e92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+30:2396:x1870961896333440:12345-192.168.202.6@tcp:4:dd.0 00000020:00000040:0.0:1784290444.684956:0:25102:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2344e92680 x1870961896333440/t0(4294968679) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784290444.684970:0:25102:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968679, current: 4294968679, replaying 00010000:00000040:0.0:1784290444.684973:0:25102:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:0.0:1784290444.684985:0:25102:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2344e92680 x1870961896333440/t0(4294968679) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.684992:0:25102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344e92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+30:2396:x1870961896333440:12345-192.168.202.6@tcp:4:dd.0 Request processed in 45us (221us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784290444.684998:0:25102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 423 00000100:00000040:0.0:1784290444.685001:0:25102:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:3.0:1784290444.685005:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968679, next_transno: 4294968679 00010000:00080000:3.0:1784290444.685009:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968679) 00010000:00080000:3.0:1784290444.685017:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896333440 t4294968679 from 192.168.202.6@tcp req@ffff9c2344e92680 x1870961896333440/t0(4294968679) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.685040:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2344e92680 x1870961896333440/t0(4294968679) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.685076:0:96639:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1784290444.685085:0:96639:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 12575 MB/s 00000020:00000040:3.0:1784290444.685087:0:96639:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1784290444.685164:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 26 00000020:00000040:3.0:1784290444.685167:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=31 00010000:00000040:3.0:1784290444.685314:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968679, xid 1870961896333440 00000100:00000040:3.0:1784290444.685320:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290444.685323:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:3.0:1784290444.685364:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:3.0:1784290444.685370:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784290444.685374:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:3.0:1784290444.685380:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 30 00010000:00080000:3.0:1784290444.685386:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968680 00010000:00080000:3.0:1784290444.685392:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968680 00000100:00000040:3.0:1784290444.685989:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c24483c8700 x1870961896333696 msgsize 1512 00000100:00100000:3.0:1784290444.685994:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290444.686035:0:25104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896333696 00000100:00100000:0.0:1784290444.686041:0:25104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896333696 00000020:00000040:0.0:1784290444.686042:0:25104:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:0.0:1784290444.686045:0:25104:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=31 00000100:00000040:0.0:1784290444.686056:0:25104:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784290444.686084:0:25104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 424 00000100:00000040:0.0:1784290444.686088:0:25104:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:0.0:1784290444.686096:0:25104:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c24483c8700 x1870961896333696/t0(4294968680) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.686111:0:25104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+31:2396:x1870961896333696:12345-192.168.202.6@tcp:4:dd.0 00000020:00000040:0.0:1784290444.686121:0:25104:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c24483c8700 x1870961896333696/t0(4294968680) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784290444.686130:0:25104:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968680, current: 4294968680, replaying 00010000:00000040:0.0:1784290444.686133:0:25104:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:0.0:1784290444.686147:0:25104:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c24483c8700 x1870961896333696/t0(4294968680) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784290444.686150:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968680, next_transno: 4294968680 00010000:00080000:3.0:1784290444.686157:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968680) 00010000:00080000:3.0:1784290444.686166:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896333696 t4294968680 from 192.168.202.6@tcp req@ffff9c24483c8700 x1870961896333696/t0(4294968680) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.686172:0:25104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+31:2396:x1870961896333696:12345-192.168.202.6@tcp:4:dd.0 Request processed in 59us (176us total) trans 0 rc 0/-999 00000020:00000040:3.0:1784290444.686182:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c24483c8700 x1870961896333696/t0(4294968680) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.686197:0:25104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 424 00000100:00000040:0.0:1784290444.686202:0:25104:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00000020:00000040:3.0:1784290444.686228:0:96639:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1784290444.686236:0:96639:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 12575 MB/s 00000020:00000040:3.0:1784290444.686243:0:96639:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1784290444.686319:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 27 00000020:00000040:3.0:1784290444.686323:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=32 00010000:00000040:3.0:1784290444.686438:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968680, xid 1870961896333696 00000100:00000040:3.0:1784290444.686444:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290444.686447:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:3.0:1784290444.686467:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:3.0:1784290444.686472:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784290444.686476:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:3.0:1784290444.686481:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 31 00010000:00080000:3.0:1784290444.686483:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968681 00010000:00080000:3.0:1784290444.686486:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968681 00000100:00000040:0.0:1784290444.687289:0:3610:0:(events.c:337:request_in_callback()) incoming req@ffff9c246ddf1500 x1870961896333952 msgsize 1512 00000100:00100000:0.0:1784290444.687298:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290444.687330:0:25096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896333952 00000100:00100000:3.0:1784290444.687334:0:25096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896333952 00000020:00000040:3.0:1784290444.687335:0:25096:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:3.0:1784290444.687337:0:25096:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=32 00000100:00000040:3.0:1784290444.687370:0:25096:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784290444.687393:0:25096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 425 00000100:00000040:3.0:1784290444.687396:0:25096:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:3.0:1784290444.687400:0:25096:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246ddf1500 x1870961896333952/t0(4294968681) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.687409:0:25096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ddf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+32:2396:x1870961896333952:12345-192.168.202.6@tcp:4:dd.0 00000020:00000040:3.0:1784290444.687415:0:25096:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246ddf1500 x1870961896333952/t0(4294968681) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784290444.687420:0:25096:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968681, current: 4294968681, replaying 00010000:00000040:3.0:1784290444.687423:0:25096:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:3.0:1784290444.687435:0:25096:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf1500 x1870961896333952/t0(4294968681) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784290444.687446:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968681, next_transno: 4294968681 00010000:00080000:0.0:1784290444.687454:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968681) 00000100:00100000:3.0:1784290444.687458:0:25096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ddf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+32:2396:x1870961896333952:12345-192.168.202.6@tcp:4:dd.0 Request processed in 47us (165us total) trans 0 rc 0/-999 00010000:00080000:0.0:1784290444.687466:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896333952 t4294968681 from 192.168.202.6@tcp req@ffff9c246ddf1500 x1870961896333952/t0(4294968681) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.687470:0:25096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 425 00000100:00000040:3.0:1784290444.687475:0:25096:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00000020:00000040:0.0:1784290444.687489:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246ddf1500 x1870961896333952/t0(4294968681) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784290444.687530:0:96639:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784290444.687538:0:96639:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 12575 MB/s 00000020:00000040:0.0:1784290444.687540:0:96639:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1784290444.687624:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 28 00000020:00000040:0.0:1784290444.687627:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=33 00010000:00000040:0.0:1784290444.687802:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968681, xid 1870961896333952 00000100:00000040:0.0:1784290444.687808:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290444.687812:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290444.687833:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:0.0:1784290444.687838:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784290444.687842:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:0.0:1784290444.687860:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 32 00010000:00080000:0.0:1784290444.687864:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968682 00010000:00080000:0.0:1784290444.687868:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968682 00000100:00000040:1.0:1784290444.688574:0:3611:0:(events.c:337:request_in_callback()) incoming req@ffff9c2344e90e00 x1870961896334208 msgsize 1512 00000100:00100000:1.0:1784290444.688587:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290444.688679:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896334208 00000100:00100000:2.0:1784290444.688686:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896334208 00000020:00000040:2.0:1784290444.688687:0:8409:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:2.0:1784290444.688690:0:8409:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=33 00000100:00000040:2.0:1784290444.688702:0:8409:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1784290444.688731:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 426 00000100:00000040:2.0:1784290444.688734:0:8409:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:2.0:1784290444.688738:0:8409:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2344e90e00 x1870961896334208/t0(4294968682) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290444.688762:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344e90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+33:2396:x1870961896334208:12345-192.168.202.6@tcp:4:dd.0 00000020:00000040:2.0:1784290444.688769:0:8409:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2344e90e00 x1870961896334208/t0(4294968682) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1784290444.688775:0:8409:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968682, current: 4294968682, replaying 00010000:00000040:2.0:1784290444.688778:0:8409:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:2.0:1784290444.688788:0:8409:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2344e90e00 x1870961896334208/t0(4294968682) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1784290444.688794:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344e90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+33:2396:x1870961896334208:12345-192.168.202.6@tcp:4:dd.0 Request processed in 36us (221us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784290444.688800:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 426 00000100:00000040:2.0:1784290444.688802:0:8409:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:0.0:1784290444.688824:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968682, next_transno: 4294968682 00010000:00080000:0.0:1784290444.688830:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968682) 00010000:00080000:0.0:1784290444.688861:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896334208 t4294968682 from 192.168.202.6@tcp req@ffff9c2344e90e00 x1870961896334208/t0(4294968682) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784290444.688876:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2344e90e00 x1870961896334208/t0(4294968682) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784290444.688916:0:96639:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784290444.688925:0:96639:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 12575 MB/s 00000020:00000040:0.0:1784290444.688927:0:96639:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1784290444.689011:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 29 00000020:00000040:0.0:1784290444.689014:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=34 00010000:00000040:0.0:1784290444.689186:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968682, xid 1870961896334208 00000100:00000040:0.0:1784290444.689192:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290444.689195:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290444.689221:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:0.0:1784290444.689226:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784290444.689230:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:0.0:1784290444.689239:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 33 00010000:00080000:0.0:1784290444.689242:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968683 00010000:00080000:0.0:1784290444.689245:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968683 00000100:00000040:3.0:1784290444.690000:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c24483caa00 x1870961896334464 msgsize 1512 00000100:00100000:3.0:1784290444.690005:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290444.690100:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896334464 00000100:00100000:1.0:1784290444.690111:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896334464 00000020:00000040:1.0:1784290444.690114:0:8408:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:1.0:1784290444.690118:0:8408:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=34 00000100:00000040:1.0:1784290444.690140:0:8408:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784290444.690187:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 427 00000100:00000040:1.0:1784290444.690192:0:8408:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:1.0:1784290444.690199:0:8408:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c24483caa00 x1870961896334464/t0(4294968683) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.690217:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+34:2396:x1870961896334464:12345-192.168.202.6@tcp:4:dd.0 00000020:00000040:1.0:1784290444.690231:0:8408:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c24483caa00 x1870961896334464/t0(4294968683) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784290444.690241:0:8408:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968683, current: 4294968683, replaying 00010000:00000040:1.0:1784290444.690257:0:8408:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:1.0:1784290444.690278:0:8408:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c24483caa00 x1870961896334464/t0(4294968683) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.690290:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+34:2396:x1870961896334464:12345-192.168.202.6@tcp:4:dd.0 Request processed in 77us (287us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784290444.690301:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 427 00000100:00000040:1.0:1784290444.690306:0:8408:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:0.0:1784290444.690308:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968683, next_transno: 4294968683 00010000:00080000:0.0:1784290444.690314:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968683) 00010000:00080000:0.0:1784290444.690326:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896334464 t4294968683 from 192.168.202.6@tcp req@ffff9c24483caa00 x1870961896334464/t0(4294968683) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784290444.690384:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c24483caa00 x1870961896334464/t0(4294968683) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784290444.690438:0:96639:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784290444.690447:0:96639:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 12575 MB/s 00000020:00000040:0.0:1784290444.690449:0:96639:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1784290444.690543:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 30 00000020:00000040:0.0:1784290444.690546:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=35 00010000:00000040:0.0:1784290444.690697:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968683, xid 1870961896334464 00000100:00000040:0.0:1784290444.690704:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290444.690708:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290444.690731:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:0.0:1784290444.690736:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784290444.690740:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:0.0:1784290444.690747:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 34 00010000:00080000:0.0:1784290444.690750:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968684 00010000:00080000:0.0:1784290444.690753:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968684 00000100:00000040:3.0:1784290444.691500:0:3610:0:(events.c:337:request_in_callback()) incoming req@ffff9c24483c8a80 x1870961896334720 msgsize 1512 00000100:00100000:3.0:1784290444.691507:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290444.691545:0:25102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896334720 00000100:00100000:0.0:1784290444.691552:0:25102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896334720 00000020:00000040:0.0:1784290444.691554:0:25102:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:0.0:1784290444.691558:0:25102:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=35 00000100:00000040:0.0:1784290444.691573:0:25102:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784290444.691605:0:25102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 428 00000100:00000040:0.0:1784290444.691610:0:25102:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:0.0:1784290444.691617:0:25102:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c24483c8a80 x1870961896334720/t0(4294968684) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.691628:0:25102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+35:2396:x1870961896334720:12345-192.168.202.6@tcp:4:dd.0 00000020:00000040:0.0:1784290444.691634:0:25102:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c24483c8a80 x1870961896334720/t0(4294968684) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784290444.691640:0:25102:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968684, current: 4294968684, replaying 00010000:00000040:0.0:1784290444.691643:0:25102:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:0.0:1784290444.691653:0:25102:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c24483c8a80 x1870961896334720/t0(4294968684) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.691660:0:25102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+35:2396:x1870961896334720:12345-192.168.202.6@tcp:4:dd.0 Request processed in 34us (159us total) trans 0 rc 0/-999 00010000:00080000:3.0:1784290444.691671:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968684, next_transno: 4294968684 00010000:00080000:3.0:1784290444.691675:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968684) 00000100:00100000:0.0:1784290444.691676:0:25102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 428 00000100:00000040:0.0:1784290444.691681:0:25102:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:3.0:1784290444.691686:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896334720 t4294968684 from 192.168.202.6@tcp req@ffff9c24483c8a80 x1870961896334720/t0(4294968684) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.691701:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c24483c8a80 x1870961896334720/t0(4294968684) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.691741:0:96639:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1784290444.691749:0:96639:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 12575 MB/s 00000020:00000040:3.0:1784290444.691751:0:96639:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1784290444.691838:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 31 00000020:00000040:3.0:1784290444.691841:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=36 00010000:00000040:3.0:1784290444.691957:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968684, xid 1870961896334720 00000100:00000040:3.0:1784290444.691963:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290444.691967:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:3.0:1784290444.691989:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:3.0:1784290444.691994:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784290444.691998:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:3.0:1784290444.692004:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 35 00010000:00080000:3.0:1784290444.692012:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968685 00010000:00080000:3.0:1784290444.692015:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968685 00000100:00000040:1.0:1784290444.692753:0:3611:0:(events.c:337:request_in_callback()) incoming req@ffff9c2344e92300 x1870961896334976 msgsize 1512 00000100:00100000:1.0:1784290444.692766:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290444.692845:0:25104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896334976 00000100:00100000:0.0:1784290444.692866:0:25104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896334976 00000020:00000040:0.0:1784290444.692869:0:25104:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:0.0:1784290444.692873:0:25104:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=36 00000100:00000040:0.0:1784290444.692889:0:25104:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784290444.692926:0:25104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 429 00000100:00000040:0.0:1784290444.692929:0:25104:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:0.0:1784290444.692934:0:25104:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2344e92300 x1870961896334976/t0(4294968685) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.692946:0:25104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344e92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+36:2396:x1870961896334976:12345-192.168.202.6@tcp:4:dd.0 00000020:00000040:0.0:1784290444.692955:0:25104:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2344e92300 x1870961896334976/t0(4294968685) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784290444.692961:0:25104:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968685, current: 4294968685, replaying 00010000:00000040:0.0:1784290444.692963:0:25104:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:0.0:1784290444.692977:0:25104:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2344e92300 x1870961896334976/t0(4294968685) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.692985:0:25104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344e92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+36:2396:x1870961896334976:12345-192.168.202.6@tcp:4:dd.0 Request processed in 41us (233us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784290444.692991:0:25104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 429 00000100:00000040:0.0:1784290444.692993:0:25104:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:1.0:1784290444.693026:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968685, next_transno: 4294968685 00010000:00080000:1.0:1784290444.693035:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968685) 00010000:00080000:1.0:1784290444.693056:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896334976 t4294968685 from 192.168.202.6@tcp req@ffff9c2344e92300 x1870961896334976/t0(4294968685) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784290444.693083:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2344e92300 x1870961896334976/t0(4294968685) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784290444.693193:0:96639:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1784290444.693228:0:96639:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 12575 MB/s 00000020:00000040:1.0:1784290444.693232:0:96639:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1784290444.693584:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 32 00000020:00000040:1.0:1784290444.693590:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=37 00010000:00000040:1.0:1784290444.693721:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968685, xid 1870961896334976 00000100:00000040:1.0:1784290444.693732:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:1.0:1784290444.693741:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:1.0:1784290444.693789:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:1.0:1784290444.693800:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784290444.693809:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:1.0:1784290444.693822:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 36 00010000:00080000:1.0:1784290444.693837:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968686 00010000:00080000:1.0:1784290444.693843:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968686 00000100:00000040:0.0:1784290444.694495:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c246ddf0700 x1870961896335232 msgsize 1512 00000100:00100000:0.0:1784290444.694503:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290444.694533:0:25096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896335232 00000100:00100000:3.0:1784290444.694538:0:25096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896335232 00000020:00000040:3.0:1784290444.694540:0:25096:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:3.0:1784290444.694543:0:25096:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=37 00000100:00000040:3.0:1784290444.694555:0:25096:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784290444.694580:0:25096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 430 00000100:00000040:3.0:1784290444.694582:0:25096:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:3.0:1784290444.694586:0:25096:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246ddf0700 x1870961896335232/t0(4294968686) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.694598:0:25096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ddf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+37:2396:x1870961896335232:12345-192.168.202.6@tcp:4:dd.0 00000020:00000040:3.0:1784290444.694611:0:25096:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246ddf0700 x1870961896335232/t0(4294968686) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784290444.694618:0:25096:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968686, current: 4294968686, replaying 00010000:00000040:3.0:1784290444.694620:0:25096:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:3.0:1784290444.694631:0:25096:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf0700 x1870961896335232/t0(4294968686) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.694640:0:25096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ddf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+37:2396:x1870961896335232:12345-192.168.202.6@tcp:4:dd.0 Request processed in 44us (143us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784290444.694649:0:25096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 430 00010000:00080000:1.0:1784290444.694651:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968686, next_transno: 4294968686 00000100:00000040:3.0:1784290444.694652:0:25096:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:1.0:1784290444.694662:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968686) 00010000:00080000:1.0:1784290444.694678:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896335232 t4294968686 from 192.168.202.6@tcp req@ffff9c246ddf0700 x1870961896335232/t0(4294968686) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784290444.694698:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246ddf0700 x1870961896335232/t0(4294968686) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1784290444.694761:0:96639:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1784290444.694775:0:96639:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 12575 MB/s 00000020:00000040:1.0:1784290444.694777:0:96639:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1784290444.694971:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 33 00000020:00000040:1.0:1784290444.694977:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=38 00010000:00000040:1.0:1784290444.695095:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968686, xid 1870961896335232 00000100:00000040:1.0:1784290444.695106:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:1.0:1784290444.695113:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:1.0:1784290444.695159:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:1.0:1784290444.695172:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1784290444.695189:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:1.0:1784290444.695208:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 37 00010000:00080000:1.0:1784290444.695213:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968687 00010000:00080000:1.0:1784290444.695220:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968687 00000100:00000040:0.0:1784290444.695945:0:3610:0:(events.c:337:request_in_callback()) incoming req@ffff9c246ddf0380 x1870961896335488 msgsize 1512 00000100:00100000:0.0:1784290444.695959:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290444.696055:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896335488 00000100:00100000:1.0:1784290444.696066:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896335488 00000020:00000040:1.0:1784290444.696069:0:8409:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:1.0:1784290444.696074:0:8409:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=38 00000100:00000040:1.0:1784290444.696094:0:8409:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784290444.696139:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 431 00000100:00000040:1.0:1784290444.696154:0:8409:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:1.0:1784290444.696162:0:8409:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246ddf0380 x1870961896335488/t0(4294968687) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.696180:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ddf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+38:2396:x1870961896335488:12345-192.168.202.6@tcp:4:dd.0 00000020:00000040:1.0:1784290444.696192:0:8409:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246ddf0380 x1870961896335488/t0(4294968687) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784290444.696201:0:8409:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968687, current: 4294968687, replaying 00010000:00000040:1.0:1784290444.696204:0:8409:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:1.0:1784290444.696222:0:8409:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf0380 x1870961896335488/t0(4294968687) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.696234:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ddf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+38:2396:x1870961896335488:12345-192.168.202.6@tcp:4:dd.0 Request processed in 57us (285us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784290444.696246:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 431 00000100:00000040:1.0:1784290444.696250:0:8409:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:3.0:1784290444.696257:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968687, next_transno: 4294968687 00010000:00080000:3.0:1784290444.696262:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968687) 00010000:00080000:3.0:1784290444.696274:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896335488 t4294968687 from 192.168.202.6@tcp req@ffff9c246ddf0380 x1870961896335488/t0(4294968687) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.696301:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246ddf0380 x1870961896335488/t0(4294968687) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.696376:0:96639:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1784290444.696387:0:96639:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 12575 MB/s 00000020:00000040:3.0:1784290444.696390:0:96639:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1784290444.696508:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 34 00000020:00000040:3.0:1784290444.696512:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=39 00010000:00000040:3.0:1784290444.696633:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968687, xid 1870961896335488 00000100:00000040:3.0:1784290444.696640:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290444.696643:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:3.0:1784290444.696670:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:3.0:1784290444.696676:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784290444.696681:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:3.0:1784290444.696689:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 38 00010000:00080000:3.0:1784290444.696692:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968688 00010000:00080000:3.0:1784290444.696695:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968688 00000100:00000040:0.0:1784290444.697397:0:3611:0:(events.c:337:request_in_callback()) incoming req@ffff9c246ddf1c00 x1870961896335744 msgsize 1512 00000100:00100000:0.0:1784290444.697404:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290444.697458:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896335744 00000100:00100000:1.0:1784290444.697468:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896335744 00000020:00000040:1.0:1784290444.697471:0:8408:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:1.0:1784290444.697475:0:8408:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=39 00000100:00000040:1.0:1784290444.697500:0:8408:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784290444.697541:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 432 00000100:00000040:1.0:1784290444.697546:0:8408:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:1.0:1784290444.697555:0:8408:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246ddf1c00 x1870961896335744/t0(4294968688) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.697573:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246ddf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+39:2396:x1870961896335744:12345-192.168.202.6@tcp:4:dd.0 00000020:00000040:1.0:1784290444.697586:0:8408:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246ddf1c00 x1870961896335744/t0(4294968688) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784290444.697605:0:8408:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968688, current: 4294968688, replaying 00010000:00000040:1.0:1784290444.697608:0:8408:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:1.0:1784290444.697626:0:8408:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246ddf1c00 x1870961896335744/t0(4294968688) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.697641:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246ddf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+39:2396:x1870961896335744:12345-192.168.202.6@tcp:4:dd.0 Request processed in 69us (237us total) trans 0 rc 0/-999 00010000:00080000:3.0:1784290444.697648:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968688, next_transno: 4294968688 00000100:00100000:1.0:1784290444.697655:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 432 00010000:00080000:3.0:1784290444.697657:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968688) 00000100:00000040:1.0:1784290444.697662:0:8408:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:3.0:1784290444.697674:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896335744 t4294968688 from 192.168.202.6@tcp req@ffff9c246ddf1c00 x1870961896335744/t0(4294968688) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.697693:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246ddf1c00 x1870961896335744/t0(4294968688) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.697734:0:96639:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1784290444.697743:0:96639:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 12575 MB/s 00000020:00000040:3.0:1784290444.697745:0:96639:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1784290444.697831:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 35 00000020:00000040:3.0:1784290444.697840:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=40 00010000:00000040:3.0:1784290444.697953:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968688, xid 1870961896335744 00000100:00000040:3.0:1784290444.697960:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290444.697963:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:3.0:1784290444.697986:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:3.0:1784290444.697991:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784290444.697995:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:3.0:1784290444.698002:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 39 00010000:00080000:3.0:1784290444.698005:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968689 00010000:00080000:3.0:1784290444.698008:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968689 00000100:00000040:0.0:1784290444.698821:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c247f977480 x1870961896336000 msgsize 1512 00000100:00100000:0.0:1784290444.698829:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290444.698932:0:25102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896336000 00000100:00100000:1.0:1784290444.698941:0:25102:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896336000 00000020:00000040:1.0:1784290444.698943:0:25102:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:1.0:1784290444.698947:0:25102:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=40 00000100:00000040:1.0:1784290444.698971:0:25102:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784290444.699027:0:25102:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 433 00000100:00000040:1.0:1784290444.699034:0:25102:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:1.0:1784290444.699045:0:25102:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c247f977480 x1870961896336000/t0(4294968689) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.699065:0:25102:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+40:2396:x1870961896336000:12345-192.168.202.6@tcp:4:dd.0 00000020:00000040:1.0:1784290444.699075:0:25102:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c247f977480 x1870961896336000/t0(4294968689) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784290444.699084:0:25102:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968689, current: 4294968689, replaying 00010000:00000040:1.0:1784290444.699087:0:25102:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:1.0:1784290444.699105:0:25102:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c247f977480 x1870961896336000/t0(4294968689) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.699116:0:25102:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f977480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+40:2396:x1870961896336000:12345-192.168.202.6@tcp:4:dd.0 Request processed in 54us (291us total) trans 0 rc 0/-999 00010000:00080000:3.0:1784290444.699131:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968689, next_transno: 4294968689 00010000:00080000:3.0:1784290444.699137:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968689) 00000100:00100000:1.0:1784290444.699138:0:25102:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 433 00000100:00000040:1.0:1784290444.699146:0:25102:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:3.0:1784290444.699154:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896336000 t4294968689 from 192.168.202.6@tcp req@ffff9c247f977480 x1870961896336000/t0(4294968689) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.699171:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c247f977480 x1870961896336000/t0(4294968689) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.699212:0:96639:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1784290444.699220:0:96639:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 12575 MB/s 00000020:00000040:3.0:1784290444.699222:0:96639:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1784290444.699297:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 36 00000020:00000040:3.0:1784290444.699300:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=41 00010000:00000040:3.0:1784290444.699431:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968689, xid 1870961896336000 00000100:00000040:3.0:1784290444.699437:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290444.699441:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:3.0:1784290444.699461:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:3.0:1784290444.699466:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784290444.699470:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:3.0:1784290444.699476:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 40 00010000:00080000:3.0:1784290444.699485:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968690 00010000:00080000:3.0:1784290444.699488:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968690 00000100:00000040:0.0:1784290444.700077:0:3610:0:(events.c:337:request_in_callback()) incoming req@ffff9c246a4f9180 x1870961896336256 msgsize 1512 00000100:00100000:0.0:1784290444.700082:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290444.700120:0:25104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896336256 00000100:00100000:3.0:1784290444.700125:0:25104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896336256 00000020:00000040:3.0:1784290444.700126:0:25104:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:3.0:1784290444.700129:0:25104:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=41 00000100:00000040:3.0:1784290444.700139:0:25104:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1784290444.700161:0:25104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 434 00000100:00000040:3.0:1784290444.700164:0:25104:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:3.0:1784290444.700167:0:25104:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246a4f9180 x1870961896336256/t0(4294968690) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.700176:0:25104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a4f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+41:2396:x1870961896336256:12345-192.168.202.6@tcp:4:dd.0 00000020:00000040:3.0:1784290444.700182:0:25104:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246a4f9180 x1870961896336256/t0(4294968690) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1784290444.700188:0:25104:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968690, current: 4294968690, replaying 00010000:00000040:3.0:1784290444.700191:0:25104:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:3.0:1784290444.700206:0:25104:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246a4f9180 x1870961896336256/t0(4294968690) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1784290444.700216:0:25104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a4f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+41:2396:x1870961896336256:12345-192.168.202.6@tcp:4:dd.0 Request processed in 39us (136us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784290444.700224:0:25104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 434 00000100:00000040:3.0:1784290444.700228:0:25104:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:0.0:1784290444.700237:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968690, next_transno: 4294968690 00010000:00080000:0.0:1784290444.700241:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968690) 00010000:00080000:0.0:1784290444.700249:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896336256 t4294968690 from 192.168.202.6@tcp req@ffff9c246a4f9180 x1870961896336256/t0(4294968690) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784290444.700263:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246a4f9180 x1870961896336256/t0(4294968690) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1784290444.700305:0:96639:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1784290444.700314:0:96639:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 12575 MB/s 00000020:00000040:0.0:1784290444.700317:0:96639:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1784290444.700444:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 37 00000020:00000040:0.0:1784290444.700447:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=42 00010000:00000040:0.0:1784290444.700565:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968690, xid 1870961896336256 00000100:00000040:0.0:1784290444.700572:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:0.0:1784290444.700575:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:0.0:1784290444.700597:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:0.0:1784290444.700603:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1784290444.700606:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:0.0:1784290444.700613:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 41 00010000:00080000:0.0:1784290444.700615:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968691 00010000:00080000:0.0:1784290444.700618:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968691 00000100:00000040:0.0:1784290444.701257:0:3611:0:(events.c:337:request_in_callback()) incoming req@ffff9c2345c25880 x1870961896336512 msgsize 1512 00000100:00100000:0.0:1784290444.701268:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290444.701297:0:25096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896336512 00000100:00100000:3.0:1784290444.701303:0:25096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896336512 00000020:00000040:3.0:1784290444.701305:0:25096:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:3.0:1784290444.701307:0:25096:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=42 00000100:00000040:3.0:1784290444.701318:0:25096:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1784290444.701375:0:25097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 435 00000100:00000040:0.0:1784290444.701378:0:25097:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:0.0:1784290444.701384:0:25097:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2345c25880 x1870961896336512/t0(4294968691) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.701396:0:25097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+42:2396:x1870961896336512:12345-192.168.202.6@tcp:4:dd.0 00000020:00000040:0.0:1784290444.701403:0:25097:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2345c25880 x1870961896336512/t0(4294968691) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1784290444.701409:0:25097:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968691, current: 4294968691, replaying 00010000:00000040:0.0:1784290444.701411:0:25097:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:0.0:1784290444.701421:0:25097:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2345c25880 x1870961896336512/t0(4294968691) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1784290444.701429:0:25097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+42:2396:x1870961896336512:12345-192.168.202.6@tcp:4:dd.0 Request processed in 34us (169us total) trans 0 rc 0/-999 00000100:00100000:0.0:1784290444.701438:0:25097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 435 00000100:00000040:0.0:1784290444.701441:0:25097:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:3.0:1784290444.701442:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968691, next_transno: 4294968691 00010000:00080000:3.0:1784290444.701446:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968691) 00010000:00080000:3.0:1784290444.701455:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896336512 t4294968691 from 192.168.202.6@tcp req@ffff9c2345c25880 x1870961896336512/t0(4294968691) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.701482:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2345c25880 x1870961896336512/t0(4294968691) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.701523:0:96639:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1784290444.701531:0:96639:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 12575 MB/s 00000020:00000040:3.0:1784290444.701534:0:96639:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1784290444.701623:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 38 00000020:00000040:3.0:1784290444.701626:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=43 00010000:00000040:3.0:1784290444.701793:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968691, xid 1870961896336512 00000100:00000040:3.0:1784290444.701799:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290444.701803:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:3.0:1784290444.701824:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:3.0:1784290444.701829:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784290444.701833:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:3.0:1784290444.701838:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 42 00010000:00080000:3.0:1784290444.701840:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968692 00010000:00080000:3.0:1784290444.701843:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968692 00000100:00000040:3.0:1784290444.702508:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c24483ca680 x1870961896336768 msgsize 1512 00000100:00100000:3.0:1784290444.702513:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290444.702615:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896336768 00000100:00100000:1.0:1784290444.702625:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896336768 00000020:00000040:1.0:1784290444.702627:0:8409:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:1.0:1784290444.702631:0:8409:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=43 00000100:00000040:1.0:1784290444.702655:0:8409:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784290444.702699:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 436 00000100:00000040:1.0:1784290444.702706:0:8409:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:1.0:1784290444.702713:0:8409:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c24483ca680 x1870961896336768/t0(4294968692) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.702728:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+43:2396:x1870961896336768:12345-192.168.202.6@tcp:4:dd.0 00000020:00000040:1.0:1784290444.702738:0:8409:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c24483ca680 x1870961896336768/t0(4294968692) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784290444.702746:0:8409:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968692, current: 4294968692, replaying 00010000:00000040:1.0:1784290444.702749:0:8409:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:1.0:1784290444.702765:0:8409:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c24483ca680 x1870961896336768/t0(4294968692) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.702778:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+43:2396:x1870961896336768:12345-192.168.202.6@tcp:4:dd.0 Request processed in 49us (264us total) trans 0 rc 0/-999 00010000:00080000:3.0:1784290444.702781:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968692, next_transno: 4294968692 00010000:00080000:3.0:1784290444.702796:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968692) 00000100:00100000:1.0:1784290444.702805:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 436 00010000:00080000:3.0:1784290444.702820:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896336768 t4294968692 from 192.168.202.6@tcp req@ffff9c24483ca680 x1870961896336768/t0(4294968692) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00000040:1.0:1784290444.702836:0:8409:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00000020:00000040:3.0:1784290444.702900:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c24483ca680 x1870961896336768/t0(4294968692) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.702946:0:96639:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1784290444.702956:0:96639:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 12575 MB/s 00000020:00000040:3.0:1784290444.702958:0:96639:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1784290444.703057:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 39 00000020:00000040:3.0:1784290444.703061:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=44 00010000:00000040:3.0:1784290444.703171:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968692, xid 1870961896336768 00000100:00000040:3.0:1784290444.703176:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290444.703180:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:3.0:1784290444.703200:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:3.0:1784290444.703204:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784290444.703208:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:3.0:1784290444.703214:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 43 00010000:00080000:3.0:1784290444.703216:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968693 00010000:00080000:3.0:1784290444.703219:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968693 00000100:00000040:0.0:1784290444.703961:0:3610:0:(events.c:337:request_in_callback()) incoming req@ffff9c2345cfd180 x1870961896337024 msgsize 1512 00000100:00100000:0.0:1784290444.703968:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290444.704048:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896337024 00000100:00100000:1.0:1784290444.704057:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896337024 00000020:00000040:1.0:1784290444.704059:0:8408:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:1.0:1784290444.704063:0:8408:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=44 00000100:00000040:1.0:1784290444.704090:0:8408:0:(service.c:1432:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1784290444.704127:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 437 00000100:00000040:1.0:1784290444.704131:0:8408:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00000040:1.0:1784290444.704138:0:8408:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2345cfd180 x1870961896337024/t0(4294968693) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.704152:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2345cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+44:2396:x1870961896337024:12345-192.168.202.6@tcp:4:dd.0 00000020:00000040:1.0:1784290444.704161:0:8408:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2345cfd180 x1870961896337024/t0(4294968693) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1784290444.704168:0:8408:0:(ldlm_lib.c:3228:target_queue_recovery_request()) Next recovery transno: 4294968693, current: 4294968693, replaying 00010000:00000040:1.0:1784290444.704171:0:8408:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000100:00000040:1.0:1784290444.704184:0:8408:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2345cfd180 x1870961896337024/t0(4294968693) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1784290444.704194:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2345cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+44:2396:x1870961896337024:12345-192.168.202.6@tcp:4:dd.0 Request processed in 44us (230us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784290444.704204:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 437 00000100:00000040:1.0:1784290444.704208:0:8408:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00010000:00080000:3.0:1784290444.704215:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294968693, next_transno: 4294968693 00010000:00080000:3.0:1784290444.704219:0:96639:0:(ldlm_lib.c:2246:check_for_next_transno()) waking for next (4294968693) 00010000:00080000:3.0:1784290444.704228:0:96639:0:(ldlm_lib.c:2747:replay_request_or_update()) @@@ processing x1870961896337024 t4294968693 from 192.168.202.6@tcp req@ffff9c2345cfd180 x1870961896337024/t0(4294968693) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.704242:0:96639:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2345cfd180 x1870961896337024/t0(4294968693) o4->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 1512/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1784290444.704293:0:96639:0:(tgt_handler.c:2891:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1784290444.704302:0:96639:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 12575 MB/s 00000020:00000040:3.0:1784290444.704304:0:96639:0:(tgt_handler.c:1914:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1784290444.704412:0:96639:0:(tgt_lastrcvd.c:1006:tgt_last_commit_cb_add()) callback GETting export ffff9c246dce7800 : new cb_count 40 00000020:00000040:3.0:1784290444.704415:0:96639:0:(genops.c:889:class_export_get()) GET export ffff9c246dce7800 refcount=45 00010000:00000040:3.0:1784290444.704508:0:96639:0:(ldlm_lib.c:3305:target_committed_to_req()) last_committed 4294968653, transno 4294968693, xid 1870961896337024 00000100:00000040:3.0:1784290444.704514:0:96639:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9c2341df1780 refcount 11 to 192.168.202.6@tcp 00000100:00000040:3.0:1784290444.704524:0:96639:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.6@tcp 00000100:00000040:3.0:1784290444.704545:0:96639:0:(lustre_net.h:1975:ptlrpc_connection_put()) PUT conn=ffff9c2341df1780 refcount 10 to 192.168.202.6@tcp 00010000:00080000:3.0:1784290444.704551:0:96639:0:(ldlm_lib.c:2100:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1784290444.704556:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:3.0:1784290444.704563:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 44 00010000:00080000:3.0:1784290444.704566:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968694 00010000:00080000:3.0:1784290444.704569:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294968694 00000100:00000040:0.0:1784290444.705686:0:3611:0:(events.c:337:request_in_callback()) incoming req@ffff9c247d29e680 x1870961896339200 msgsize 328 00000100:00100000:0.0:1784290444.705695:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00000040:0.0:1784290444.705821:0:3610:0:(events.c:337:request_in_callback()) incoming req@ffff9c2474e8c700 x1870961896339328 msgsize 328 00000100:00100000:0.0:1784290444.705828:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290444.705923:0:26262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896339200 00000100:00100000:1.0:1784290444.705932:0:26262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896339200 00000020:00000040:1.0:1784290444.705935:0:26262:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:1.0:1784290444.705938:0:26262:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=45 00000100:00100000:3.0:1784290444.705958:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896339328 00000100:00100000:1.0:1784290444.706002:0:26262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5052 00000100:00000040:1.0:1784290444.706009:0:26262:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 1 00000100:00100000:3.0:1784290444.706016:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896339328 00000020:00000040:3.0:1784290444.706023:0:26252:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000100:00000040:1.0:1784290444.706023:0:26262:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c247d29e680 x1870961896339200/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784290444.706031:0:26252:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=46 00000100:00000040:0.0:1784290444.706040:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c2468792680 x1870961896339456 msgsize 328 00000100:00100000:0.0:1784290444.706062:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290444.706070:0:26262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+46:2396:x1870961896339200:12345-192.168.202.6@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1784290444.706098:0:26262:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c247d29e680 x1870961896339200/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290444.706107:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c2468791c00 x1870961896339584 msgsize 328 00010000:00000040:1.0:1784290444.706108:0:26262:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00010000:00080000:1.0:1784290444.706120:0:26262:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c247d29e680 x1870961896339200/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290444.706141:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00000040:1.0:1784290444.706160:0:26262:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c247d29e680 x1870961896339200/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290444.706170:0:26262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247d29e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+46:2396:x1870961896339200:12345-192.168.202.6@tcp:101:ldlm_lock_repla.0 Request processed in 110us (482us total) trans 0 rc 0/-999 00000100:00100000:1.0:1784290444.706179:0:26262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5052 00000100:00000040:1.0:1784290444.706182:0:26262:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00000100:00100000:3.0:1784290444.706186:0:26252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896339456 00000100:00100000:3.0:1784290444.706192:0:26252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896339456 00000100:00100000:2.0:1784290444.706193:0:26255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896339584 00000020:00000040:3.0:1784290444.706197:0:26252:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:3.0:1784290444.706200:0:26252:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=47 00000100:00100000:2.0:1784290444.706201:0:26255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896339584 00000100:00100000:1.0:1784290444.706208:0:26262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5053 00000020:00000040:2.0:1784290444.706209:0:26255:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000100:00000040:1.0:1784290444.706212:0:26262:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 2 00000020:00000040:2.0:1784290444.706219:0:26255:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=48 00000100:00000040:1.0:1784290444.706225:0:26262:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2474e8c700 x1870961896339328/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290444.706229:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c246a540e00 x1870961896339712 msgsize 328 00000100:00100000:3.0:1784290444.706242:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5054 00000100:00000040:3.0:1784290444.706254:0:26252:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 3 00000100:00100000:0.0:1784290444.706272:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:1.0:1784290444.706283:0:26262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2474e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+48:2396:x1870961896339328:12345-192.168.202.6@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1784290444.706292:0:26262:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2474e8c700 x1870961896339328/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290444.706294:0:26255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896339712 00000100:00100000:2.0:1784290444.706304:0:26255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896339712 00010000:00000040:1.0:1784290444.706309:0:26262:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 4 00000020:00000040:2.0:1784290444.706311:0:26255:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:2.0:1784290444.706316:0:26255:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=49 00000100:00000040:0.0:1784290444.706317:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c246a543480 x1870961896339840 msgsize 328 00010000:00080000:1.0:1784290444.706322:0:26262:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c2474e8c700 x1870961896339328/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1784290444.706366:0:26252:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2468792680 x1870961896339456/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290444.706366:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290444.706382:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+49:2396:x1870961896339456:12345-192.168.202.6@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1784290444.706413:0:26252:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2468792680 x1870961896339456/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1784290444.706416:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c2445d6c380 x1870961896339968 msgsize 328 00000100:00000040:1.0:1784290444.706419:0:26262:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2474e8c700 x1870961896339328/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290444.706434:0:26255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896339840 00000100:00100000:2.0:1784290444.706445:0:26255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896339840 00000100:00100000:0.0:1784290444.706450:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000020:00000040:2.0:1784290444.706456:0:26255:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:2.0:1784290444.706466:0:26255:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=50 00010000:00000040:3.0:1784290444.706486:0:26252:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 5 00010000:00080000:3.0:1784290444.706494:0:26252:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c2468792680 x1870961896339456/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290444.706500:0:26255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896339968 00000100:00100000:2.0:1784290444.706510:0:26255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896339968 00000020:00000040:2.0:1784290444.706516:0:26255:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:2.0:1784290444.706523:0:26255:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=51 00000100:00000040:0.0:1784290444.706531:0:3612:0:(events.c:337:request_in_callback()) incoming req@ffff9c246a42ed80 x1870961896340096 msgsize 328 00000100:00100000:2.0:1784290444.706572:0:26255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5055 00000100:00100000:0.0:1784290444.706572:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00000040:2.0:1784290444.706583:0:26255:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 6 00000100:00100000:1.0:1784290444.706583:0:26262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2474e8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+51:2396:x1870961896339328:12345-192.168.202.6@tcp:101:ldlm_lock_repla.0 Request processed in 304us (755us total) trans 0 rc 0/-999 00000100:00000040:3.0:1784290444.706585:0:26252:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468792680 x1870961896339456/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290444.706608:0:26255:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2468791c00 x1870961896339584/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784290444.706609:0:26262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5053 00000100:00100000:0.0:1784290444.706617:0:26259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896340096 00000100:00000040:1.0:1784290444.706620:0:26262:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 5 00000100:00100000:0.0:1784290444.706629:0:26259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896340096 00000020:00000040:0.0:1784290444.706634:0:26259:0:(genops.c:825:class_conn2export()) looking for export cookie 0x5953bbf6b307624d 00000020:00000040:0.0:1784290444.706640:0:26259:0:(lustre_handles.c:147:class_handle2object()) GET export ffff9c246dce7800 refcount=52 00000100:00100000:1.0:1784290444.706653:0:26262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5056 00000100:00100000:2.0:1784290444.706669:0:26255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+52:2396:x1870961896339584:12345-192.168.202.6@tcp:101:ldlm_lock_repla.0 00000100:00000040:1.0:1784290444.706670:0:26262:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 6 00000100:00000040:1.0:1784290444.706694:0:26262:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246a540e00 x1870961896339712/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290444.706695:0:26259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5057 00000020:00000040:2.0:1784290444.706699:0:26255:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2468791c00 x1870961896339584/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290444.706701:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+52:2396:x1870961896339456:12345-192.168.202.6@tcp:101:ldlm_lock_repla.0 Request processed in 314us (651us total) trans 0 rc 0/-999 00000100:00000040:0.0:1784290444.706709:0:26259:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 7 00000100:00000040:0.0:1784290444.706727:0:26259:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246a543480 x1870961896339840/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290444.706748:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5054 00000100:00000040:3.0:1784290444.706763:0:26252:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 6 00000100:00100000:3.0:1784290444.706789:0:26252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5058 00010000:00000040:2.0:1784290444.706793:0:26255:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 7 00000100:00000040:3.0:1784290444.706797:0:26252:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 8 00000100:00100000:1.0:1784290444.706803:0:26262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+52:2396:x1870961896339712:12345-192.168.202.6@tcp:101:ldlm_lock_repla.0 00000100:00000040:3.0:1784290444.706813:0:26252:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c2445d6c380 x1870961896339968/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1784290444.706815:0:26255:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c2468791c00 x1870961896339584/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784290444.706816:0:26259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+52:2396:x1870961896339840:12345-192.168.202.6@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1784290444.706824:0:26262:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246a540e00 x1870961896339712/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1784290444.706861:0:26259:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246a543480 x1870961896339840/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290444.706880:0:26252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2445d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+52:2396:x1870961896339968:12345-192.168.202.6@tcp:101:ldlm_lock_repla.0 00000100:00000040:2.0:1784290444.706903:0:26255:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2468791c00 x1870961896339584/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1784290444.706920:0:26252:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c2445d6c380 x1870961896339968/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1784290444.706932:0:26262:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 9 00010000:00000040:0.0:1784290444.706934:0:26259:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 10 00010000:00080000:0.0:1784290444.706962:0:26259:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c246a543480 x1870961896339840/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1784290444.706964:0:26252:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 11 00010000:00080000:1.0:1784290444.706964:0:26262:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c246a540e00 x1870961896339712/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290444.706971:0:26255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+52:2396:x1870961896339584:12345-192.168.202.6@tcp:101:ldlm_lock_repla.0 Request processed in 316us (856us total) trans 0 rc 0/-999 00010000:00080000:3.0:1784290444.706978:0:26252:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c2445d6c380 x1870961896339968/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290444.707018:0:26255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5055 00000100:00000040:0.0:1784290444.707027:0:26259:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246a543480 x1870961896339840/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290444.707036:0:26255:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 10 00000100:00100000:2.0:1784290444.707063:0:26255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 5059 00000100:00000040:3.0:1784290444.707064:0:26252:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c2445d6c380 x1870961896339968/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290444.707074:0:26262:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246a540e00 x1870961896339712/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290444.707077:0:26255:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 11 00000100:00100000:0.0:1784290444.707088:0:26259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+52:2396:x1870961896339840:12345-192.168.202.6@tcp:101:ldlm_lock_repla.0 Request processed in 273us (757us total) trans 0 rc 0/-999 00000100:00000040:2.0:1784290444.707096:0:26255:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9c246a42ed80 x1870961896340096/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784290444.707112:0:26252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2445d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+52:2396:x1870961896339968:12345-192.168.202.6@tcp:101:ldlm_lock_repla.0 Request processed in 236us (686us total) trans 0 rc 0/-999 00000100:00100000:3.0:1784290444.707159:0:26252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5058 00000100:00000040:3.0:1784290444.707177:0:26252:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 10 00000100:00100000:0.0:1784290444.707186:0:26259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5057 00000100:00100000:1.0:1784290444.707197:0:26262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+52:2396:x1870961896339712:12345-192.168.202.6@tcp:101:ldlm_lock_repla.0 Request processed in 388us (948us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784290444.707199:0:26255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+52:2396:x1870961896340096:12345-192.168.202.6@tcp:101:ldlm_lock_repla.0 00000100:00000040:0.0:1784290444.707199:0:26259:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 9 00010000:00080000:3.0:1784290444.707212:0:96639:0:(ldlm_lib.c:2228:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 4294968694 00010000:00080000:3.0:1784290444.707230:0:96639:0:(ldlm_lib.c:2262:check_for_next_transno()) waking for completed recovery 00010000:00000040:3.0:1784290444.707244:0:96639:0:(ldlm_lib.c:2881:target_recovery_thread()) 2: lock replay stage - 1 clients 00000100:00100000:1.0:1784290444.707247:0:26262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5056 00000020:00000040:2.0:1784290444.707248:0:26255:0:(tgt_handler.c:596:tgt_handle_recovery()) @@@ Got new replay req@ffff9c246a42ed80 x1870961896340096/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1784290444.707253:0:26262:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 8 00010000:00080000:3.0:1784290444.707254:0:96639:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1784290444.707265:0:96639:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1784290444.707278:0:96639:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.6@tcp: req@ffff9c247d29e680 x1870961896339200/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1784290444.707292:0:26255:0:(ldlm_lib.c:1774:target_request_copy_get()) RPC GETting export ffff9c246dce7800 : new rpc_count 9 00010000:02000000:3.0:1784290444.707293:0:96639:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1784290444.707303:0:26255:0:(ldlm_lib.c:3187:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9c246a42ed80 x1870961896340096/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1784290444.707320:0:26255:0:(lustre_net.h:2426:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9c246a42ed80 x1870961896340096/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784290444.707330:0:26255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+52:2396:x1870961896340096:12345-192.168.202.6@tcp:101:ldlm_lock_repla.0 Request processed in 149us (796us total) trans 0 rc 0/-999 00000100:00100000:2.0:1784290444.707337:0:26255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 5059 00000100:00000040:2.0:1784290444.707369:0:26255:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9c246dce7800 : new rpc_count 8 00010000:00000040:3.0:1784290444.710030:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 7 00000020:00000040:3.0:1784290444.710039:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 51 00010000:00080000:3.0:1784290444.710041:0:96639:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1784290444.710043:0:96639:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1784290444.710048:0:96639:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.6@tcp: req@ffff9c2474e8c700 x1870961896339328/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1784290444.710053:0:96639:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1784290444.710055:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 6 00000020:00000040:3.0:1784290444.710059:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 50 00010000:00080000:3.0:1784290444.710061:0:96639:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1784290444.710062:0:96639:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1784290444.710065:0:96639:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.6@tcp: req@ffff9c2468792680 x1870961896339456/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1784290444.710069:0:96639:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1784290444.710071:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 5 00000020:00000040:3.0:1784290444.710073:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 49 00010000:00080000:3.0:1784290444.710074:0:96639:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1784290444.710075:0:96639:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1784290444.710078:0:96639:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.6@tcp: req@ffff9c2468791c00 x1870961896339584/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1784290444.710081:0:96639:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1784290444.710083:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 4 00000020:00000040:3.0:1784290444.710086:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 48 00010000:00080000:3.0:1784290444.710087:0:96639:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1784290444.710088:0:96639:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1784290444.710098:0:96639:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.6@tcp: req@ffff9c246a543480 x1870961896339840/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1784290444.710103:0:96639:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1784290444.710104:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 3 00000020:00000040:3.0:1784290444.710107:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 47 00010000:00080000:3.0:1784290444.710108:0:96639:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1784290444.710109:0:96639:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1784290444.710111:0:96639:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.6@tcp: req@ffff9c2445d6c380 x1870961896339968/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1784290444.710116:0:96639:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1784290444.710117:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 2 00000020:00000040:3.0:1784290444.710119:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 46 00010000:00080000:3.0:1784290444.710122:0:96639:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1784290444.710124:0:96639:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1784290444.710136:0:96639:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.6@tcp: req@ffff9c246a540e00 x1870961896339712/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1784290444.710140:0:96639:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1784290444.710141:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 1 00000020:00000040:3.0:1784290444.710146:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 45 00010000:00080000:3.0:1784290444.710147:0:96639:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1784290444.710148:0:96639:0:(ldlm_lib.c:2282:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1784290444.710150:0:96639:0:(ldlm_lib.c:2888:target_recovery_thread()) @@@ processing lock from 192.168.202.6@tcp: req@ffff9c246a42ed80 x1870961896340096/t0(0) o101->711f3c77-e791-4aa8-86ee-bc854fd0bcc5@192.168.202.6@tcp:465/0 lens 328/0 e 0 to 0 dl 1784290455 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1784290444.710155:0:96639:0:(ldlm_lib.c:2889:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:3.0:1784290444.710156:0:96639:0:(ldlm_lib.c:1790:target_request_copy_put()) RPC PUTting export ffff9c246dce7800 : new rpc_count 0 00000020:00000040:3.0:1784290444.710159:0:96639:0:(genops.c:900:class_export_put()) PUTting export ffff9c246dce7800 : new refcount 44 00010000:00080000:3.0:1784290444.710161:0:96639:0:(ldlm_lib.c:2452:target_next_replay_lock()) Waiting for lock 00010000:00010000:1.0:1784290444.967552:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784290445.676862:0:96980:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784290445.991430:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1784290446.059024:0:97032:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1784290446.059247:0:97032:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:0.0:1784290446.401994:0:97082:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1784290446.402238:0:97082:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1784290446.853819:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290446.853916:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:0.0:1784290446.853948:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290446.853952:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896340352 00000100:00100000:3.0:1784290446.853966:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896340352 00000100:00100000:1.0:1784290446.853982:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896340224 00000100:00100000:2.0:1784290446.853990:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896340480 00000100:00100000:1.0:1784290446.853993:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896340224 00000100:00100000:2.0:1784290446.854000:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896340480 00000100:00100000:0.0:1784290446.854008:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00080000:0.0:1784290446.854055:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1784290446.854065:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784290446.854073:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 788 00000100:00100000:1.0:1784290446.854112:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 197 00000100:00100000:2.0:1784290446.854120:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 789 00000100:00100000:0.0:1784290446.854125:0:26251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896340608 00000100:00100000:3.0:1784290446.854129:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+51:2400:x1870961896340352:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290446.854138:0:26251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896340608 00000100:00100000:2.0:1784290446.854151:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:2399:x1870961896340480:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290446.854151:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2399:x1870961896340224:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290446.854225:0:26251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1645 00000100:00100000:0.0:1784290446.854242:0:26251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2400:x1870961896340608:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290446.854257:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:2399:x1870961896340480:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 111us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290446.854259:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+51:2400:x1870961896340352:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 136us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290446.854271:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f43450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2399:x1870961896340224:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 128us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290446.854306:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 789 00000100:00100000:0.0:1784290446.854317:0:26251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a42c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2400:x1870961896340608:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 73us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290446.854318:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 197 00000100:00100000:3.0:1784290446.854324:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 788 00000100:00100000:0.0:1784290446.854342:0:26251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1645 00000100:00080000:0.0:1784290446.854422:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784290447.016433:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784290447.527687:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901193856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1784290447.527780:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290447.527893:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901193856 00000100:00100000:0.0:1784290447.527906:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901193856 00000100:00100000:0.0:1784290447.528001:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00080000:2.0:1784290447.528014:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784290447.528019:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901193856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1784290447.528063:0:8405:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1784290447.528144:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344e90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1870961901193856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290447.528156:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:1.0:1784290447.528222:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1870961901193856:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1784290448.039642:0:19681:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784290448.475538:0:97274:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg206-client.virtnet: executing wait_import_state_mount REPLAY_LOCKS osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 1475 0 00000100:00100000:1.0:1784290448.551601:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2468abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901193984:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1784290448.551694:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1784290448.551703:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784290448.551712:0:83795:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:2.0:1784290448.551757:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784290448.551763:0:83795:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:1.0:1784290448.551771:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901194496:0@lo:400:kworker.0 00000100:00100000:2.0:1784290448.551897:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345b77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901194112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1784290448.551974:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290448.552037:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c244405aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901194624:0@lo:400:kworker.0 00000100:00100000:2.0:1784290448.552092:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290448.552130:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1870961901195136:0@lo:400:kworker.0 00000100:00100000:2.0:1784290448.552172:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290448.552230:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784290448.552244:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901195008:0@lo:400:kworker.0 00000100:00100000:2.0:1784290448.552287:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290448.552338:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2345b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901194240:0@lo:400:kworker.0 00000100:00100000:2.0:1784290448.552434:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290448.552524:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901194752:0@lo:400:kworker.0 00000100:00100000:2.0:1784290448.552561:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290448.552603:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1870961901195264:0@lo:400:kworker.0 00000100:00100000:1.0:1784290448.552641:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290448.552681:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901195008 00000100:00100000:2.0:1784290448.552696:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901195008 00000100:00100000:1.0:1784290448.552726:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c24483c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901195520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784290448.552799:0:9000:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901194752 00000100:00100000:1.0:1784290448.552800:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290448.552829:0:9000:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901194752 00000100:00100000:2.0:1784290448.552902:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1646 00000100:00100000:1.0:1784290448.552917:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c245fe3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1870961901194368:0@lo:400:kworker.0 00000100:00100000:2.0:1784290448.552927:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f8e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901195008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290448.552980:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290448.553031:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1870961901194880:0@lo:400:kworker.0 00000100:00100000:2.0:1784290448.553051:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f8e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901195008:12345-0@lo:400:kworker.0 Request processed in 132us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290448.553063:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1646 00000100:00100000:1.0:1784290448.553087:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290448.553099:0:9000:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1647 00000100:00100000:2.0:1784290448.553115:0:9000:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f8e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901194752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784290448.553134:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2444059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901195392:0@lo:400:kworker.0 00000100:00100000:2.0:1784290448.553186:0:9000:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f8e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1870961901194752:12345-0@lo:400:kworker.0 Request processed in 74us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290448.553207:0:9000:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1647 00000100:00100000:1.0:1784290448.553211:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784290448.553282:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901193984 00000100:00100000:1.0:1784290448.553290:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901193984 00000100:00100000:1.0:1784290448.553377:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901194112 00000100:00100000:1.0:1784290448.553393:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901194112 00000100:00100000:1.0:1784290448.553427:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901194624 00000100:00100000:1.0:1784290448.553431:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901194624 00000100:00100000:1.0:1784290448.553471:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3921 00000100:00100000:1.0:1784290448.553486:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901193984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1784290448.553523:0:8413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445097472 avail 1298857984 00000100:00100000:1.0:1784290448.553594:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344e92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901193984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (1895us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290448.553604:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3921 00000100:00080000:2.0:1784290448.553633:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784290448.553635:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3922 00000100:00100000:1.0:1784290448.553654:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f8eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3620:x1870961901194112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1784290448.553681:0:8413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1444581376 avail 1298341888 00000100:00100000:1.0:1784290448.553736:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f8eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3620:x1870961901194112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290448.553746:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3922 00000100:00100000:2.0:1784290448.553775:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901195008:0@lo:400:kworker.0 00000100:00100000:1.0:1784290448.553777:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3923 00000100:00100000:1.0:1784290448.553800:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f8eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3620:x1870961901194624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290448.553841:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345b77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901194112:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1784290448.553919:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f8eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3620:x1870961901194624:12345-0@lo:400:kworker.0 Request processed in 120us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290448.553924:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c244405aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901194624:0@lo:400:kworker.0 00000100:00100000:1.0:1784290448.553950:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3923 00000100:00100000:2.0:1784290448.554018:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901195136 00000100:00100000:2.0:1784290448.554025:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901195136 00000100:00100000:2.0:1784290448.554127:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901194496 00000100:00100000:0.0:1784290448.554134:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901194368 00000100:00100000:2.0:1784290448.554135:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901194496 00000100:00100000:1.0:1784290448.554141:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2468abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901193984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1784290448.554152:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901194368 00000100:00100000:2.0:1784290448.554195:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901194880 00000100:00100000:2.0:1784290448.554203:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901194880 00000100:00100000:0.0:1784290448.554222:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901195392 00000100:00100000:0.0:1784290448.554232:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901195392 00000100:00100000:2.0:1784290448.554248:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:2.0:1784290448.554265:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f8ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1870961901195136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290448.554300:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:0.0:1784290448.554324:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901194496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290448.554383:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f8ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1870961901195136:12345-0@lo:400:kworker.0 Request processed in 79us (2166us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290448.554395:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:2.0:1784290448.554420:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:2.0:1784290448.554433:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2447b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1870961901194368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290448.554495:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344e93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1870961901194496:12345-0@lo:400:kworker.0 Request processed in 173us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290448.554512:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:2.0:1784290448.554519:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2447b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1870961901194368:12345-0@lo:400:kworker.0 Request processed in 85us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290448.554534:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00100000:0.0:1784290448.554560:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:2.0:1784290448.554573:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:0.0:1784290448.554585:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1870961901194880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290448.554597:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901195392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290448.554695:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1870961901194880:12345-0@lo:400:kworker.0 Request processed in 115us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290448.554708:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a48ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901195392:12345-0@lo:400:kworker.0 Request processed in 111us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290448.554722:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:2.0:1784290448.554737:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:1.0:1784290448.554750:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1870961901194368:0@lo:400:kworker.0 00000100:00100000:1.0:1784290448.554788:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444059f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1870961901194880:0@lo:400:kworker.0 00000100:00100000:2.0:1784290448.554838:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901195520 00000100:00100000:1.0:1784290448.554848:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444059880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901195392:0@lo:400:kworker.0 00000100:00100000:2.0:1784290448.554859:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901195520 00000100:00100000:0.0:1784290448.554910:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c245fe3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1870961901194496:0@lo:400:kworker.0 00000100:00100000:2.0:1784290448.554938:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1784290448.554955:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2344e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901195520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784290448.554976:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8646976 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1784290448.555084:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2344e93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1870961901195520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (2290us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290448.555094:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1784290448.555135:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901194240 00000100:00100000:2.0:1784290448.555140:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901194240 00000100:00100000:2.0:1784290448.555184:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1784290448.555197:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3617:x1870961901194240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290448.555258:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f40450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3617:x1870961901194240:12345-0@lo:400:kworker.0 Request processed in 63us (2825us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290448.555268:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1784290448.555882:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c24483c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1870961901195520:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784290448.556137:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784290448.556147:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1784290448.557172:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290448.557238:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901195264 00000100:00100000:2.0:1784290448.557248:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2345b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2e54cd1c-9dbd-4e31-b60e-998135d46053:3617:1870961901194240:0@lo:400:kworker.0 00000100:00100000:0.0:1784290448.557251:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901195264 00000100:00100000:2.0:1784290448.557277:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1870961901194752:0@lo:400:kworker.0 00000100:00100000:0.0:1784290448.557694:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:0.0:1784290448.557718:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f8eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1870961901195264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290448.557866:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f8eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1870961901195264:12345-0@lo:400:kworker.0 Request processed in 153us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290448.557884:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00080000:0.0:1784290448.557964:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784290448.558026:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1870961901195264:0@lo:400:kworker.0 00000100:00100000:0.0:1784290448.558598:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2444058a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1870961901195136:0@lo:400:kworker.0 00000001:00080000:2.0:1784290448.559443:0:96623:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294968693 is committed 00010000:00010000:3.0:1784290449.064441:0:8418:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784290449.069621:0:97323:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in REPLAY_LOCKS state after 0 sec 00000100:00100000:3.0:1784290449.575634:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a51a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901195648:0@lo:400:kworker.0 00000100:00080000:0.0:1784290449.575677:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1784290449.575681:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246a51ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1870961901195776:0@lo:400:kworker.0 00000100:00080000:0.0:1784290449.575688:0:83795:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1784290449.575741:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784290449.575778:0:83795:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784290449.575784:0:83795:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:2.0:1784290449.575816:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290449.575943:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c234326a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1870961901195904:0@lo:400:kworker.0 00000100:00100000:2.0:1784290449.575954:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1870961901196288:0@lo:400:kworker.0 00000100:00100000:3.0:1784290449.575963:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dcced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901196160:0@lo:400:kworker.0 00000100:00100000:0.0:1784290449.576062:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290449.576077:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290449.576092:0:94060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901195648 00000100:00100000:2.0:1784290449.576102:0:94060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901195648 00000100:00100000:0.0:1784290449.576139:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901196416:0@lo:400:kworker.0 00000100:00100000:3.0:1784290449.576147:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1870961901196672:0@lo:400:kworker.0 00000100:00100000:2.0:1784290449.576163:0:94060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1784290449.576189:0:94060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3620:x1870961901195648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290449.576206:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784290449.576235:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290449.576254:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901196928:0@lo:400:kworker.0 00000100:00100000:2.0:1784290449.576280:0:94060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2e54cd1c-9dbd-4e31-b60e-998135d46053+24:3620:x1870961901195648:12345-0@lo:400:kworker.0 Request processed in 94us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290449.576292:0:94060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1784290449.576320:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a51a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2e54cd1c-9dbd-4e31-b60e-998135d46053:3620:1870961901195648:0@lo:400:kworker.0 00000100:00100000:0.0:1784290449.576328:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784290449.576408:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901195776 00000100:00100000:2.0:1784290449.576414:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901195776 00000100:00100000:2.0:1784290449.576473:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901195904 00000100:00100000:2.0:1784290449.576477:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901195904 00000100:00100000:0.0:1784290449.576488:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901196672 00000100:00100000:0.0:1784290449.576499:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901196672 00000100:00100000:2.0:1784290449.576509:0:65988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901196928 00000100:00100000:2.0:1784290449.576515:0:65988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901196928 00000100:00100000:0.0:1784290449.576555:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:0.0:1784290449.576577:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c247f8e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1870961901195776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290449.576579:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:2.0:1784290449.576604:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1870961901195904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290449.576650:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c247f8e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1870961901195776:12345-0@lo:400:kworker.0 Request processed in 82us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290449.576662:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00100000:0.0:1784290449.576691:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:3.0:1784290449.576702:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784290449.576706:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1870961901196672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290449.576714:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1870961901195904:12345-0@lo:400:kworker.0 Request processed in 113us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290449.576751:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c2343269500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901196032:0@lo:400:kworker.0 00000100:00100000:2.0:1784290449.576767:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00100000:2.0:1784290449.576848:0:65988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:0.0:1784290449.576860:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1870961901196672:12345-0@lo:400:kworker.0 Request processed in 154us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290449.576867:0:65988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901196928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290449.576877:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00100000:3.0:1784290449.576884:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290449.576963:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901196416 00000100:00100000:0.0:1784290449.576974:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901196416 00000100:00100000:2.0:1784290449.576980:0:65988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1870961901196928:12345-0@lo:400:kworker.0 Request processed in 120us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290449.576993:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901196544:0@lo:400:kworker.0 00000100:00100000:2.0:1784290449.577012:0:65988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:2.0:1784290449.577062:0:8999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901196160 00000100:00100000:2.0:1784290449.577068:0:8999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901196160 00000100:00100000:0.0:1784290449.577074:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901196032 00000100:00100000:0.0:1784290449.577082:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901196032 00000100:00100000:3.0:1784290449.577096:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290449.577147:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3924 00000100:00100000:2.0:1784290449.577149:0:8999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901196544 00000100:00100000:2.0:1784290449.577158:0:8999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901196544 00000100:00100000:0.0:1784290449.577165:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901196416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290449.577180:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1870961901196672:0@lo:400:kworker.0 00000100:00100000:2.0:1784290449.577200:0:8999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1648 00000100:00100000:2.0:1784290449.577213:0:8999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c24483c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901196160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290449.577244:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dccf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3618:x1870961901196416:12345-0@lo:400:kworker.0 Request processed in 87us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290449.577253:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3924 00000100:00100000:3.0:1784290449.577285:0:22091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3925 00000100:00100000:2.0:1784290449.577296:0:8999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c24483c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1870961901196160:12345-0@lo:400:kworker.0 Request processed in 86us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290449.577302:0:22091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3620:x1870961901196032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784290449.577319:0:8999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1648 00000100:00080000:0.0:1784290449.577323:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784290449.577359:0:8999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1649 00000100:00100000:2.0:1784290449.577371:0:8999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901196544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290449.577547:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290449.577593:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9c246dcce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1870961901196800:0@lo:400:kworker.0 00000100:00100000:3.0:1784290449.577612:0:22091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3620:x1870961901196032:12345-0@lo:400:kworker.0 Request processed in 312us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290449.577614:0:8999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1870961901196544:12345-0@lo:400:kworker.0 Request processed in 245us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290449.577633:0:8999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1649 00000100:00100000:3.0:1784290449.577641:0:22091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3925 00000100:00100000:0.0:1784290449.577642:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784290449.577707:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246a51ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1870961901195776:0@lo:400:kworker.0 00000100:00100000:2.0:1784290449.577726:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c2343269500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901196032:0@lo:400:kworker.0 00000100:00100000:3.0:1784290449.577769:0:74876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901196288 00000100:00100000:3.0:1784290449.577779:0:74876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901196288 00000100:00100000:2.0:1784290449.577792:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dccf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1870961901196544:0@lo:400:kworker.0 00000100:00100000:0.0:1784290449.577861:0:66008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961901196800 00000100:00100000:0.0:1784290449.577868:0:66008:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961901196800 00000100:00100000:2.0:1784290449.577878:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dcced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1870961901196160:0@lo:400:kworker.0 00000100:00100000:3.0:1784290449.577884:0:74876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:3.0:1784290449.577917:0:74876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1870961901196288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784290449.577945:0:66008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00100000:0.0:1784290449.577969:0:66008:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246dccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1870961901196800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784290449.577996:0:74876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dccca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1870961901196288:12345-0@lo:400:kworker.0 Request processed in 99us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290449.578030:0:74876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:2.0:1784290449.578064:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c234326a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1870961901195904:0@lo:400:kworker.0 00000100:00100000:0.0:1784290449.578076:0:66008:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246dccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1870961901196800:12345-0@lo:400:kworker.0 Request processed in 118us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290449.578087:0:66008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000100:00100000:2.0:1784290449.578100:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1870961901196416:0@lo:400:kworker.0 00000100:00100000:2.0:1784290449.578127:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dccd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1870961901196928:0@lo:400:kworker.0 00000100:00100000:0.0:1784290449.578142:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1870961901196288:0@lo:400:kworker.0 00000100:00100000:0.0:1784290449.578173:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9c246dcce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1870961901196800:0@lo:400:kworker.0 00000001:02000400:0.0:1784290449.618171:0:97371:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: replay-single test_135: @@@@@@ FAIL: Unexpected sync success 00000100:00100000:3.0:1784290449.861942:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290449.861986:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:3.0:1784290449.862016:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290449.862084:0:94059:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896340736 00000100:00100000:3.0:1784290449.862096:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.6@tcp (source: 12345-192.168.202.6@tcp) 00000100:00100000:2.0:1784290449.862104:0:94059:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896340736 00000100:00100000:0.0:1784290449.862138:0:66004:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896340992 00000100:00100000:0.0:1784290449.862150:0:66004:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896340992 00000100:00100000:1.0:1784290449.862164:0:65990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896340864 00000100:00100000:3.0:1784290449.862178:0:15642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870961896341120 00000100:00100000:1.0:1784290449.862179:0:65990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896340864 00000100:00100000:2.0:1784290449.862198:0:94059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 200 00000100:00100000:3.0:1784290449.862200:0:15642:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870961896341120 00000100:00100000:2.0:1784290449.862230:0:94059:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c2468f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2398:x1870961896340736:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:0.0:1784290449.862240:0:66004:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 802 00000100:00100000:0.0:1784290449.862260:0:66004:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a51ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:2398:x1870961896340992:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:1.0:1784290449.862267:0:65990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 803 00000100:00100000:1.0:1784290449.862287:0:65990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+51:2398:x1870961896340864:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:3.0:1784290449.862306:0:15642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.6@tcp, seq: 1650 00000100:00100000:3.0:1784290449.862323:0:15642:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c246a047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2398:x1870961896341120:12345-192.168.202.6@tcp:400:kworker.0 00000100:00100000:2.0:1784290449.862334:0:94059:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c2468f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe59f8a2-9335-4b92-9e8e-cbda4b4e2e7f+10:2398:x1870961896340736:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 112us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1784290449.862415:0:94059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 200 00000100:00100000:1.0:1784290449.862417:0:65990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+51:2398:x1870961896340864:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 134us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1784290449.862433:0:65990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 803 00000100:00100000:0.0:1784290449.862434:0:66004:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a51ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+11:2398:x1870961896340992:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 175us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1784290449.862451:0:66004:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 802 00000100:00100000:3.0:1784290449.862485:0:15642:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c246a047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:711f3c77-e791-4aa8-86ee-bc854fd0bcc5+7:2398:x1870961896341120:12345-192.168.202.6@tcp:400:kworker.0 Request processed in 166us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1784290449.862494:0:15642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.6@tcp, seq: 1650 00000100:00080000:1.0:1784290449.862516:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784290449.862525:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784290449.862528:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1784290450.087550:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 58963 lines, 58963 kept, 0 dropped, 0 bad.